Htet, A., Bernacka, K., Marei, O. et al. (2 more authors) (2025) Hey Miro! Multimodal interaction with an animal-like robot companion with conversational abilities. In: HRI '25: Proceedings of the 2025 20th ACM/IEEE International Conference on Human-Robot Interaction. 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 04-06 Mar 2025, Melbourne, Australia. Institute of Electrical and Electronics Engineers (IEEE) , pp. 1779-1781. ISBN 9798350378948
Abstract
To make best use of large-language models (LLMs) in social robotics it is critical that verbal interaction capabilities are suitably integrated with robot perceptual and behavioral systems, including non-verbal and emotional signaling, such that the robot can use language in a grounded and context-appropriate way. This demonstration shows the integration of a LLM with the layered control architecture of the animal-like robot platform Miro-e alongside deep network models for perception and spoken language recognition and generation. This system is currently being developed as a prototype companion robot for research on robot-assisted therapy.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2025 The Authors. Except as otherwise noted, this author-accepted version of a paper published in HRI '25: Proceedings of the 2025 20th ACM/IEEE International Conference on Human-Robot Interaction is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ |
Keywords: | AI-enabled robotics; social HRI; robot companions; biologically-inspired robots; cognitive architecture |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Funding Information: | Funder Grant number WELLCOME TRUST (THE) UNSPECIFIED UK RESEARCH AND INNOVATION 10039052 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 15 May 2025 16:33 |
Last Modified: | 22 May 2025 14:10 |
Status: | Published |
Publisher: | Institute of Electrical and Electronics Engineers (IEEE) |
Refereed: | Yes |
Identification Number: | 10.1109/HRI61500.2025.10973974 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:226742 |