gaips_bea image1 image2 image3 image4 image5 gaips_ecute_beach_bar_banner gaips_ecute_train_incorrect_ticket_banner
Multimodal Affect Modelling and Recognition for Empathic Robotic Companions


Abstract Affect recognition for socially perceptive robots relies on representative data. While many of the existing affective corpora and databases contain posed and decontextualized affective expressions, affect resources for designing an affect recognition system in naturalistic human!robot interaction (HRI) must include context-rich expressions that emerge in the same scenario of the ̄nal application. In this paper, we propose a context-based approach to the collection and modeling of representative data for building an affect-sensitive robotic game companion. To illustrate our approach we present the key features of the Inter-ACT (INTEracting with Robots! Context Task) corpus, an affective and contextually rich multi- modal video corpus containing affective expressions of children playing chess with an iCat robot. We show how this corpus can be successfully used to train a context-sensitive a®ect recognition system (a valence detector) for a robotic game companion. Finally, we demonstrate how the integration of the affect recognition system in a modular platform for adaptive HRI makes the interaction with the robot more engaging.
Year 2013
Keywords Social Robots, Affective Computing;Social Robotic Companions;Affective Computing;
Authors Ginevra Castellano, Iolanda Leite, André Pereira, Carlos Martinho, Ana Paiva, Peter W. Mcowan
Journal International Journal of Humanoid Robotics
Volume 1
Pdf File \"pdf
BibTex bib icon or see it here down icon

@article { castellano13, abstract = {Affect recognition for socially perceptive robots relies on representative data. While many of the existing affective corpora and databases contain posed and decontextualized affective expressions, affect resources for designing an affect recognition system in naturalistic human!robot interaction (HRI) must include context-rich expressions that emerge in the same scenario of the ̄nal application. In this paper, we propose a context-based approach to the collection and modeling of representative data for building an affect-sensitive robotic game companion. To illustrate our approach we present the key features of the Inter-ACT (INTEracting with Robots! Context Task) corpus, an affective and contextually rich multi- modal video corpus containing affective expressions of children playing chess with an iCat robot. We show how this corpus can be successfully used to train a context-sensitive a®ect recognition system (a valence detector) for a robotic game companion. Finally, we demonstrate how the integration of the affect recognition system in a modular platform for adaptive HRI makes the interaction with the robot more engaging.}, journal = {International Journal of Humanoid Robotics}, keywords = {Social Robots, Affective Computing;Social Robotic Companions;Affective Computing;}, title = {Multimodal Affect Modelling and Recognition for Empathic Robotic Companions}, volume = {1}, year = {2013}, author = {Ginevra Castellano and Iolanda Leite and André Pereira and Carlos Martinho and Ana Paiva and Peter W. Mcowan} }

up icon hide this content