Emotion-based Intrinsic Motivation for Reinforcement Learning Agents


Best Paper Award

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Memphis, USA, October 9–12, 2011, pp. 326-336    Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents


Abstract
In this paper, we propose an adaptation of four common appraisal dimensions that evaluate the relation of an agent with its environment into reward features within an intrinsically motivated reinforcement learning framework. We show that, by optimizing the relative weights of such features for a given environment, the agents attain a greater degree of fitness while overcoming some of their perceptual limitations. This optimization process resembles the evolutionary adaptive process that living organisms are subject to. We illustrate the application of our method in several simulated foraging scenarios.

sequeira2011acii.pdf

Paper

sequeira2011acii_pres.pdf

Presentation

Posted on