White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Learning by observation through system identification

Nehmzow, U., Akanyeti, O., Weinrich, C., Kyriacou, T. and Billings, S.A. (2007) Learning by observation through system identification. Research Report. ACSE Research Report no. 952 . Automatic Control and Systems Engineering, University of Sheffield


Download (1003Kb)


In our previous works, we present a new method to program mobile robots —“code identification by demonstration”— based on algorithmically transferring human behaviours to robot control code using transparent mathematical functions. Our approach has three stages: i) first extracting the trajectory of the desired behaviour by observing the human, ii) making the robot follow the human trajectory blindly to log the robot’s own perception perceived along that trajectory, and finally iii) linking the robot’s perception to the desired behaviour to obtain a generalised, sensor-based model. So far we used an external, camera based motion tracking system to log the trajectory of the human demonstrator during his initial demonstration of the desired motion. Because such tracking systems are complicated to set up and expensive, we propose an alternative method to obtain trajectory information, using the robot’s own sensor perception. In this method, we train a mathematical polynomial using the NARMAX system identification methodology which maps the position of the “red jacket” worn by the demonstrator in the image captured by the robot’s camera, to the relative position of the demonstrator in the real world according to the robot. We demonstrate the viability of this approach by teaching a Scitos G5 mobile robot to achieve door traversal behaviour.

Item Type: Monograph (Research Report)
Copyright, Publisher and Additional Information: The Department of Automatic Control and Systems Engineering research reports offer a forum for the research output of the academic staff and research students of the Department at the University of Sheffield. Papers are reviewed for quality and presentation by a departmental editor. However, the contents and opinions expressed remain the responsibility of the authors. Some papers in the series may have been subsequently published elsewhere and you are advised to cite the later published version in these instances.
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Automatic Control and Systems Engineering (Sheffield) > ACSE Research Reports
Depositing User: Miss Anthea Tucker
Date Deposited: 11 Oct 2012 15:13
Last Modified: 05 Jun 2014 19:07
Status: Published
Publisher: Automatic Control and Systems Engineering, University of Sheffield
URI: http://eprints.whiterose.ac.uk/id/eprint/74610

Actions (repository staff only: login required)