Person tracking with a mobile robot based on multi-modal anchoring

Publication Type  Conference Paper
Year of Publication  2002
Authors  Kleinehagenbrock, M. and Lang, S. and Fritsch, J. and Lomker, F. and Fink, G. A. and Sagerer, G.
Pagination  423--429
Key Words  feature extraction; gesture recognition; mobile robots; tracking; computer vision; face detection; feature; fusion module; gestural instructions; human-robot-interaction; laser range data; mobile robot; multi-modal anchoring; person tracking; vision
Abstract  

The ability to robustly track a person is an important prerequisite for human-robot-interaction. This paper presents a hybrid approach for integrating vision and laser range data to track a human. The legs of a person can be extracted from laser range data while skin-colored faces are detectable in camera images showing the upper body part of a person. As these algorithms provide different percepts originating from the same person, the perceptual results have to be combined. We link the percepts to their symbolic counterparts legs and face by anchoring processes as defined by Coradeschi and Saffiotti. To anchor the composite symbol person we extend the anchoring framework with a fusion module integrating the individual anchors. This allows to deal with perceptual algorithms having different spatio-temporal properties and provides a structured way for integrating anchors from multiple modalities. An example with a mobile robot tracking a person demonstrates the performance of our approach.