Hey Miro! Multimodal interaction with an animal-like robot companion with conversational abilities

Htet, A., Bernacka, K., Marei, O. et al. (2 more authors) (2025) Hey Miro! Multimodal interaction with an animal-like robot companion with conversational abilities. In: HRI '25: Proceedings of the 2025 20th ACM/IEEE International Conference on Human-Robot Interaction. 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 04-06 Mar 2025, Melbourne, Australia. Institute of Electrical and Electronics Engineers (IEEE) , pp. 1779-1781. ISBN 9798350378948

Abstract

To make best use of large-language models (LLMs) in social robotics it is critical that verbal interaction capabilities are suitably integrated with robot perceptual and behavioral systems, including non-verbal and emotional signaling, such that the robot can use language in a grounded and context-appropriate way. This demonstration shows the integration of a LLM with the layered control architecture of the animal-like robot platform Miro-e alongside deep network models for perception and spoken language recognition and generation. This system is currently being developed as a prototype companion robot for research on robot-assisted therapy.

Metadata

Item Type:	Proceedings Paper
Authors/Creators:	Htet, A. Bernacka, K. Marei, O. Holden, J.N. Prescott, T.J. https://orcid.org/0000-0003-4927-5390
Copyright, Publisher and Additional Information:	© 2025 The Authors. Except as otherwise noted, this author-accepted version of a paper published in HRI '25: Proceedings of the 2025 20th ACM/IEEE International Conference on Human-Robot Interaction is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/
Keywords:	AI-enabled robotics; social HRI; robot companions; biologically-inspired robots; cognitive architecture
Dates:	Published (online): 30 April 2025 Published: 30 April 2025
Institution:	The University of Sheffield
Academic Units:	The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield)
Funding Information:	Funder Grant number WELLCOME TRUST (THE) UNSPECIFIED UK RESEARCH AND INNOVATION 10039052
Depositing User:	Symplectic Sheffield
Date Deposited:	15 May 2025 16:33
Last Modified:	22 May 2025 14:10
Status:	Published
Publisher:	Institute of Electrical and Electronics Engineers (IEEE)
Refereed:	Yes
Identification Number:	10.1109/HRI61500.2025.10973974
Related URLs:	Conference
Open Archives Initiative ID (OAI ID):	oai:eprints.whiterose.ac.uk:226742

CORE (COnnecting REpositories)

Hey Miro! Multimodal interaction with an animal-like robot companion with conversational abilities

Abstract

Metadata

Download

Accepted Version

Export

Statistics