Norwegian version of this page

PIRC - Predictive and Intuitive Robot Companion

PIRC targets a psychology-inspired computing breakthrough through research combining insight from cognitive psychology with computational intelligence to build models that forecast future events and respond dynamically.

Robot assistant

1113194150 ? Miriam Doerr Martin Frommherz | shutterstock.com

About the project

The systems will be aware and alert for how to best act given their knowledge about themselves and perception of their environment. Humans anticipate future events more effectively than computers. We combine sensing across multiple modalities with learned knowledge to predict outcomes and choose the best actions. Can we transfer these skills to intelligent systems in human-interactive scenarios?

Artificial intelligence meets cognitive neuropsychology

In PIRC, we will apply our machine learning and robotics expertise, and collaborate with researchers in cognitive psychology. The goal is to apply recent models of human prediction and intuitive action on perception-action loops of future intelligent robot companions.

Our work will allow such robots to adapt and act more seamlessly with their environment than the current technology. We will equip the robots with these new skills and in addition, provide them with the knowledge that users they are interacting with, apply the same mechanisms. This will include mechanisms for adaptive response time from quick and intuitive to slower and well-reasoned. The models will be applied in two robotics applications with potential for very wide impact: physical rehabilitation and home care robot support for older people.

See more information and ROBIN student master projects here.

Publications

  • Kwak, Dongho; Baselizadeh, Adel; van Otterdijk, Marieke; Saplacan, Diana & T?rresen, Jim (2024). "Noisy" Matching of Motion Velocity of an Assistive Robot to the Users' Walking Velocity. ACM/IEEE International Conference on Human-Robot Interaction (HRI). ISSN 2167-2121. doi: 10.1145/3610978.3640546.
  • van Otterdijk, Marieke; Saplacan, Diana; Laeng, Bruno & T?rresen, Jim (2024). An Exploratory Study on People's Intuitive Understanding of Expressive Robot Behavior. ACM/IEEE International Conference on Human-Robot Interaction (HRI). ISSN 2167-2121. p. 1072–1076. doi: 10.1145/3610978.3640568.
  • van Otterdijk, Marieke; Laeng, Bruno; Saplacan, Diana & T?rresen, Jim (2024). The Effect of Expressive Robot Behavior on Users’ Mental Effort: A Pupillometry Study. IEEE Transactions on Cognitive and Developmental Systems. ISSN 2379-8920. 16(2), p. 474–484. doi: 10.1109/TCDS.2024.3352893.
  • Saplacan, Diana; van Otterdijk, Marieke & T?rresen, Jim (2024). Qualitative Observational Video-Based Study on Perceived Privacy in Social Robots’ Based on Robots Appearances. Advanced Robotics and its Social Impacts (ARSO). ISSN 2162-7568. doi: 10.1109/ARSO60199.2024.10557941. Full text in Research Archive
  • Carlsen, Per Antoine; Taylor, Angelique; Chan, Darren M; Uddin, Md Zia; Riek, Laurel & T?rresen, Jim (2024). Real-Time Person Re-Identification to Improve Human-Robot Interaction. In Zhang, Houxiang & Shi, Qing (Ed.), Proceedings of the 2024 IEEE International Conference on Real-time Computing and Robotics (RCAR). IEEE conference proceedings. ISSN 979-8-3503-7260-1. p. 425–430. doi: 10.1109/RCAR61438.2024.10671043.
  • van Otterdijk, Maria Theodorus Henricus; Neggers, Margot; T?rresen, Jim & Barakova, Emilia (2024). A Study on Congruency in Expressive Robot Movement While Delivering Food to Seniors. In Zhang, Houxiang & Shi, Qing (Ed.), Proceedings of the 2024 IEEE International Conference on Real-time Computing and Robotics (RCAR). IEEE conference proceedings. ISSN 979-8-3503-7260-1. doi: 10.1109/RCAR61438.2024.10670931.
  • Hemaz, Said; Thorsen, Ola; Esema, Emmanuel; Ellefsen, Kai Olav; Herrebr?den, Henrik & von Arnim, Hugh Alexander [Show all 7 contributors for this article] (2024). Can machine learning help reveal the competitive advantage of elite beach volleyball players? . In Westphal, Florian; Peretz-Andersson, Einav; Riveiro, Maria; Bach, Kerstin & Heintz, Fredrik (Ed.), 14th Scandinavian Conference on Artificial Intelligence - SCAI 2024. Swedish Artificial Intelligence Society. ISSN 978-91-8075-709-6. p. 57–66. doi: doi.org/10.3384/ecp208007.
  • Baselizadeh, Adel; Uddin, Md Zia; Khaksar, Weria; Saplacan, Diana & T?rresen, Jim (2024). PriMA-Care: Privacy-Preserving Multi-modal Dataset for Human Activity Recognition in Care Robots. ACM/IEEE International Conference on Human-Robot Interaction (HRI). ISSN 2167-2121. p. 233–237. doi: 10.1145/3610978.3640701.
  • Sandanger, Tonje Viddal; Sivachandran, Annica; Eriksen, Roman Stenseth; Baselizadeh, Adel; van Otterdijk, Maria & Kwak, Dongho [Show all 7 contributors for this article] (2024). Users’ perception and dynamic motion velocity matching in human-robot approach scenarios. In Harada, Kensuke; Demircan, Emel & Weiss, Astrid (Ed.), Proceedings of 2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO 2024). IEEE (Institute of Electrical and Electronics Engineers). ISSN 9798350344646. p. 67–73. doi: 10.1109/ARSO60199.2024.10557976.
  • Helgesen, Sander Elias Magnussen; Nakashima, Kazuto; T?rresen, Jim & Kurazume, Ryo (2024). Fast LiDAR Upsampling using Conditional Diffusion Models. In Sgorbissa, Antonio & Wei, Lei (Ed.), 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN). IEEE (Institute of Electrical and Electronics Engineers). ISSN 979-8-3503-7502-2. p. 272–277. doi: 10.1109/RO-MAN60168.2024.10731454.
  • van Otterdijk, Marieke; Saplacan, Diana; Baselizadeh, Adel; Laeng, Bruno & T?rresen, Jim (2023). To Shake or Not to Shake: Intuitive Reactions of Senior Adults to a Robot Handshake in a Western Culture, Proceedings of the 32nd IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) 2023. IEEE conference proceedings. ISSN 979-8-3503-3671-9. p. 890–896. doi: 10.1109/RO-MAN57019.2023.10309608. Full text in Research Archive
  • Baselizadeh, Adel; Khaksar, Weria; Uddin, Md Zia; Saplacan, Diana & T?rresen, Jim (2023). Privacy-Preserving User Pose Prediction for Safe and Efficient Human-Robot Interaction, Proceedings of the 2023 19th IEEE International Conference on Automation Science and Engineering (CASE) . IEEE conference proceedings. ISSN 979-8-3503-2070-1. doi: 10.1109/CASE56687.2023.10260298. Full text in Research Archive
  • T?rresen, Jim; Saplacan, Diana; Baselizadeh, Adel & Mahler, Tobias (2023). Machine Excellence Tradeoffs to Ethical and Legal Perspectives, Proceedings of the 2023 IEEE Conference on Artificial Intelligence (IEEE CAI). IEEE conference proceedings. ISSN 979-8-3503-3984-0. p. 237–240. doi: 10.1109/CAI54212.2023.00109. Full text in Research Archive
  • Str?mmen, Knut Joar; T?rresen, Jim & C?té-Allard, Ulysse Teller Masao (2023). Latent space unsupervised semantic segmentation. Frontiers in Physiology. ISSN 1664-042X. 14. doi: 10.3389/fphys.2023.1151312.
  • Tariverdi, Abbas; C?té-Allard, Ulysse Teller Masao; Mathiassen, Kim; Elle, Ole Jakob; Kalv?y, H?vard & Martinsen, ?rjan Gr?ttem (2023). Reinforcement Learning-Based Switching Controller for a Milliscale Robot in a Constrained Environment. IEEE Transactions on Automation Science and Engineering. ISSN 1545-5955. 21(2), p. 2000–2016. doi: 10.1109/TASE.2023.3259905.
  • Noori, Farzan Majeed; Hafeez, Azeem; Malik, Hafiz; Uddin, Md Zia & T?rresen, Jim (2023). Source Linking Framework in Vehicular Networks for Security of Electric Vehicles using Machine Learning. In Coleri, Sinem; Altintas, Onur & Kargl, Frank (Ed.), 2023 IEEE Vehicular Networking Conference (VNC) proceedings. IEEE conference proceedings. ISSN 979-8-3503-3549-1. p. 207–214. doi: 10.1109/VNC57357.2023.10136272.
  • Strand, ?rjan; Reilstad, Didrik Spanne; Wu, Zhenying; Castro da Silva, Bruno; T?rresen, Jim & Ellefsen, Kai Olav (2023). RADAR: Reactive and Deliberative Adaptive Reasoning - Learning When to Think Fast and When to Think Slow, 2022 IEEE International Conference on Development and Learning (ICDL). IEEE conference proceedings. ISSN 9781665413121. p. 184–189. doi: 10.1109/ICDL53763.2022.9962202.
  • Saplacan, Diana; Schulz, Trenton; T?rresen, Jim & Pajalic, Zada (2023). Health Professionals’ Views on the Use of Social Robots with Vulnerable Users: A Scenario-Based Qualitative Study Using Story Dialogue Method , Proceedings of the 32nd IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) 2023. IEEE conference proceedings. ISSN 979-8-3503-3671-9. p. 421–428. doi: 10.1109/RO-MAN57019.2023.10309644. Full text in Research Archive
  • Saplacan, Diana & T?rresen, Jim (2022). Robots as Welfare Technologies to Reduce Falls Amongst Older Adults: An Explorative Study from Norway, Human Aspects of IT for the Aged Population. Technology in Everyday Living. Lecture Notes in Computer Science. LNCS 13331. Springer Nature Switzerland AG. ISSN 978-3-031-05654-3. p. 88–106. doi: doi.org/10.1007/978-3-031-05654-3_6.
  • van Otterdijk, Marieke; Song, Heqiu; Tsiakas, Konstantinos; van Zeijl, Ilka & Barakova, Emilia (2022). Nonverbal Cues Expressing Robot Personality - A Movement Analysts Perspective. In Orlandini, Andrea; Recchiuto, Carmine & Rossi, Silvia (Ed.), Proceedings of the 31st IEEE International Conference on Robot & Human Interactive Communication - RO-MAN. IEEE conference proceedings. ISSN 978-1-6654-0680-2. doi: 10.1109/RO-MAN53752.2022.9900647.
  • Nerg?rd, Katrine Linnea; Endestad, Tor & T?rresen, Jim (2022). Effect of Hand Dominance When Decoding Motor Imagery Grasping Tasks. In Ribei, Paulo Rogério de Almeida; Cota, Vinícius Rosa; Barone, Dante Augusto Couto & de Oliveira, Alexandre César Muniz (Ed.), Computational Neuroscience: Conference Proceedings Third Latin American Workshop, LAWCN 2021, S?o Luís, Brazil, December 8–10, 2021, Revised Selected Papers. Springer Nature. ISSN 978-3-031-08443-0. p. 233–249. doi: https:/doi.org/10.1007/978-3-031-08443-0_15.
  • Baselizadeh, Adel; Khaksar, Weria & T?rresen, Jim (2022). Motion Planning and Obstacle Avoidance for Robot Manipulators Using Model Predictive Control-based Reinforcement Learning. In Filev, Dimitar; Zhou, MengChu & Tunsel, Edward (Ed.), 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-6654-5257-1. p. 1584–1591. doi: 10.1109/SMC53654.2022.9945504.
  • Mantelli, Mathias; Noori, Farzan Majeed; Pittol, Diego; Maffei, Renan; T?rresen, Jim & Kolberg, Mariana (2022). Semantic Temporal Object Search System Based on Heat Maps. Journal of Intelligent & Robotic Systems. ISSN 0921-0296. 106(69). doi: 10.1007/s10846-022-01760-8.

View all works in Cristin

  • Ellefsen, Kai Olav (2024). Hva er Kunstig intelligens?
  • Saplacan, Diana (2024). Human Robot Interaction: Studies with Users.
  • Saplacan, Diana (2024). Qualitative Observational Video-Based Study on Perceived Privacy in Social Robots’ Based on Robots Appearances.
  • T?rresen, Jim (2024). Ethical and Regulatory Perspectives of Robotics and Automation.
  • Saplacan, Diana (2024). Social Robots and Socially Assistive Robots (SARs) within Elderly Care: Lessons Learned So Far.
  • T?rresen, Jim (2024). Kunstig intelligens og forskningsetiske vurderinger.
  • T?rresen, Jim (2024). Vil vi ha roboter til ? hjelpe oss n?r vi trenger hjelp?
  • T?rresen, Jim (2024). From Adaptation of the Robot Body and Control Using Rapid-Prototyping to Human–Robot Interaction with TIAGo.
  • T?rresen, Jim; Baselizadeh, Adel; Mahler, Tobias & Bygrave, Lee Andrew (2024). Machine Performance Tradeoffs to Ethical and Legal Perspectives.
  • T?rresen, Jim (2024). Ethical, Legal and Technical Challenges and Considerations.
  • T?rresen, Jim (2024). Sensing and Understanding Humans by a Robot – and vice versa.
  • Ellefsen, Kai Olav (2023). Kunstig intelligens: Verden sett gjennom en maskins ?yne.
  • Ellefsen, Kai Olav (2023). Hva er Kunstig Intelligens?
  • T?rresen, Jim (2023). What is Robotics?
  • T?rresen, Jim (2023). From Adapting Robot Body and Control to Human–Robot Interaction.
  • T?rresen, Jim (2023). What is AI?
  • Keeley, Crocket & T?rresen, Jim (2023). Workshop on Ethical Challenges within Artificial Intelligence - From Principles to Practice.
  • T?rresen, Jim (2023). Robots-assistants that Care about Privacy, Security and Safety.
  • T?rresen, Jim (2023). From Adapting Robot Body and Control Using Rapid-Prototyping to Human–Robot Interaction with TIAGo.
  • Ellefsen, Kai Olav (2023). Evolutionary Robotics.
  • T?rresen, Jim & Yao, Xin (2023). Tutorial: Ethical Risks and Challenges of Computational Intelligence.
  • Karlsen, Einar; T?rresen, Jim; Ellefsen, Kai Olav; Badescu, Claudia Andreea; van Otterdijk, Marieke & Watanabe, Shin [Show all 9 contributors for this article] (2023). M?te den nye helsearbeideren. [Business/trade/industry journal]. Elektronikk.
  • Saplacan, Diana (2023). Presentation of the paper "Health Professionals’ Views on the Use of Social Robots with Vulnerable Users: A Scenario-Based Qualitative Study Using Story Dialogue Method".
  • Saplacan, Diana (2023). Introduction on my background and on the University of Oslo, Robotics and Intelligent Systems Research Group, Norway for Human-Robot Interaction Lab, Department of Social Informatics, Kyoto University, Japan.
  • Bogen, Annika Celin & Ellefsen, Kai Olav (2023). Hvorfor mener noen at kunstig intelligens er farlig? [Internet]. ung.forskning.no.
  • Strand, ?rjan; Reilstad, Didrik Spanne; Wu, Zhenying; Castro da Silva, Bruno; Torresen, Jim & Ellefsen, Kai Olav (2023). Learning When to Think Fast and When to Think Slow.
  • Ellefsen, Kai Olav (2023). More human robot brains with inspiration from biology, psychology and neuroscience.
  • T?rresen, Jim (2023). Future Intelligent and Adaptive Robots in Real-World Environments.
  • T?rresen, Jim (2023). Human Intuition and its Impact on Human–Robot Interaction Regarding Safety and Accountability.
  • T?rresen, Jim (2023). Artificial Intelligence – diverse in methods and applications.
  • T?rresen, Jim; Saplacan, Diana & Mahler, Tobias (2023). Ethical, Legal and User Perspectives on Social and Assistive Robots (ELUPSAR) workshop.
  • Saplacan, Diana; Pajalic, Zada & T?rresen, Jim (2023). Should Social and Assistive Robots Integrated within Home- and Healthcare Services Be Universally Designed? Cambridge Handbook on Law, Policy, and Regulations for Human-Robot Interaction. Cambridge University Press. ISSN 000-0-000-00000-0. doi: ISBN%209781009386661.
  • Saplacan, Diana (2022). AI & Ethics Workshop.
  • Dahl, Heidi Elisabeth Iuell; Mehmandarov, Rustam Karim; Harkestad, Inge & Saplacan, Diana (2022). AI and Ethics workshop.
  • T?rresen, Jim (2022). Robotikk: Digitalisering av fysiske oppgaver.
  • T?rresen, Jim & Yao, Xin (2022). Tutorial: Ethical Challenges and Opportunities within Computational Intelligence System Development.
  • Cheung, Anne; Saplacan, Diana; Pietropaoli, Stefano & Weng, Yueh-Hsuan (2022). SORO – INTERDISCIPLINARY WORKSHOP ON THE GOVERNANCE FOR SOCIAL ROBOTS (HALF DAY).
  • Saplacan, Diana (2022). What do we talk about when we talk about social robots vs. robot sociomorphism ? Empirical examples from previous and ongoing research.
  • Sumioka, Hidenobu; T?rresen, Jim; Shiomi, Masahiro; Chen, Liang-Kung & Nakazawa, Atsushi (2022). Editorial: Interaction in robot-assistive elderly care. Frontiers in Robotics and AI. ISSN 2296-9144. 9. doi: 10.3389/frobt.2022.1020103.
  • T?rresen, Jim; Atsushi, Nazawa; Saplacan, Diana; Prestes, Edson; Mahler, Tobias & Weng, Yueh-Hsuan (2022). Tutorial at IROS 2022 - Ethical, Legal and User Perspectives on Robots and Systems (ELAUPORAS) – Assessments and Potential Measures.
  • Ellefsen, Kai Olav (2022). Towards more Human Robot Brains.
  • van Otterdijk, Marieke; Song, Heqiu; Tsiakas, Konstantinos; van Zeijl, Ilka & Barakova, Emilia (2022). Nonverbal Cues Expressing Robot Personality - a Movement Analysts Perspective.
  • van Otterdijk, Marieke; Saplacan, Diana; Laeng, Bruno & Torresen, Jim (2022). Explorative Study on Human Intuitive Responses to Observing Expressive Robot Behavior.
  • Saplacan, Diana (2022). Participatory Design and Human-Robot Interaction - An ethical and inclusive perspective on contemporary technologies.
  • Saplacan, Diana (2022). Healthcare Professionals’ Attitudes towards the Organization of Care Services and the Adoption of Welfare Robots in Norway.
  • Saplacan, Diana (2022). Guest Lecture: Ongoing research with Social and Assistive Robots: Research projects, empirical examples, and theory.
  • Saplacan, Diana; Baselizadeh, Adel & T?rresen, Jim (2022). Robot Demonstration: Meet TIAGo the robot! The robot showcases several tasks: brushing hair, putting the lipstick on, using a (plastic) knife, moving an object, carrying a bag.
  • Saplacan, Diana (2022). TIAGo wishes you welcome to a debate on the theme: Should a robot be involved in care tasks? (Norwegian title: TIAGo ?nsker velkommen til en debatt med tema: B?r en robot involveres i omsorgsoppgaver?).
  • Reilstad, Didrik Spanne; Strand, ?rjan; Wu, Zhenying; Castro da Silva, Bruno; Torresen, Jim & Ellefsen, Kai Olav (2022). RADAR: Reactive and Deliberative Adaptive Reasoning – Learning When to Think Fast and When to Think Slow.
  • Aas, Bendik M?ller & Ellefsen, Kai Olav (2024). Minding the Gaps: Examining the Relationship Between World Modeling and Generalization in Deep Reinforcement Learning. Universitetet i Oslo.
  • Lindblom, Diana Saplacan; T?rresen, Jim & Hakimi, Nina (2024). Dynamic Dimensions of Safety - How robot height and velocity affect human-robot interaction: An explorative study on the concept of perceived safety. University of Oslo.
  • Chen, BiHui; T?rresen, Jim & Sanfilippo, Filippo (2024). Simulation-to-real-world reinforcement learning with the PAL TIAGo robot. Universitetet i Oslo.
  • Orten, Kristine & Ellefsen, Kai Olav (2024). Exploring Dual-System Reasoning through Model-Free and Model-Based RL. Universitetet i Oslo.
  • Kocan, Danielius & Ellefsen, Kai Olav (2023). Attention-Guided Explainable Reinforcement Learning: Key State Memorization and Experience-Based Prediction. Universitetet i Oslo.
  • Taye, Eyosiyas Bisrat & Ellefsen, Kai Olav (2023). Accountability Module: Increasing Trust in Reinforcement Learning Agents. Universitetet i Oslo.
  • Lindblom, Diana Saplacan; T?rresen, Jim & Meijer, Frida (2023). In Safe Hands: Contribution of gripper material on HRI and perceived safety: An explorative study. University of Oslo.
  • Noori, Farzan Majeed; T?rresen, Jim; Uddin, Md Zia & Riegler, Michael A. (2023). Multimodal Deep Learning Approaches for Human Activity recognition. Universitetet i Oslo. ISSN 1501-7710. Full text in Research Archive
  • Olsen, Vincent Coward & T?rresen, Jim (2022). Robotic Rehabilitation Aiding with Upper-limb Impairments: Using the Robot TIAGo. Universitetet i Oslo.
  • Soma, Rebekka; Saplacan, Diana & Sikora, Magdalena Claudia (2022). Exploring personality and behavior with a robot table - a qualitative case study. Universitetet i Oslo.

View all works in Cristin

Tags: robotics, artificial intelligence, robot assistance, rehabilitation
Published Oct. 11, 2020 7:17 AM - Last modified Sep. 5, 2024 9:33 AM

Contact

Participants

Detailed list of participants