Publications

Journal Articles (2) - Refereed Conferences / Workshops (13) - Technical Reports (2) - Thesis (1) - Other (1)

Journal Articles

Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents

Pedro Sequeira, Francisco S. Melo and Ana Paiva
Autonomous Agents and Multi-Agent Systems, 29(4), 2015, pp. 537-568. DOI 10.1007/s10458-014-9262-4 Emergence of Emotional Appraisal Signals in Reinforcement Learning AgentsEmergence of Emotional Appraisal Signals in Reinforcement Learning Agents

Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Pedro Sequeira, Francisco S. Melo and Ana Paiva
Adaptive Behavior, 22(5), 2014, pp. 330–349. DOI 10.1177/1059712314543837  Learning by Appraising: An Emotion-based Approach for Intrinsic Reward DesignLearning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Refereed Conferences / Workshops

Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)

Pedro Sequeira, Francisco S. Melo and Ana Paiva

In Proceedings of the 15th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2016, pp. 466–467.  Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)

Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies
Best Paper Award on HRI Interaction Design

Pedro Sequeira, Patrícia Alves-Oliveira, Tiago Ribeiro, Eugenio Di Tullio, Sofia Petisca, Francisco S. Melo, Ginevra Castellano, and Ana Paiva

In Proceedings of the 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2016, pp. 197–204. Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz StudiesDiscovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies

“Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the IEEE Conference on Computational Intelligence and Games (IEEE CIG 2015), pp. 399-406, Aug 31– Sep 2, Tainan, 2015. “Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game“Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game

The Development of Cooperation in Evolving Populations through Social Importance

Pedro Sequeira, Samuel Mascarenhas, Francisco S. Melo and Ana Paiva
Proceedings of the 5th International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2015), pp. 308–313, August 13-16, Providence, Rhode Island, 2015.The Development of Cooperation in Evolving Populations through Social ImportanceThe Development of Cooperation in Evolving Populations through Social Importance

The “Favors Game”: A Framework to Study the Emergence of Cooperation through Social Importance

Pedro Sequeira, Samuel Mascarenhas, Francisco S. Melo and Ana Paiva
In Proceedings of the 14th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’15), Istanbul, May 4–8, 2015 (Extended Abstract), pp. 1899-1900 The ``Favors Game'': A Framework to Study the Emergence of Cooperation through Social Importance The ``Favors Game'': A Framework to Study the Emergence of Cooperation through Social Importance

The Influence of Social Display in Competitive Multiagent Learning

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 4th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2014), Genoa, Italy, October 13-16, 2014, pp. 64–69 The Influence of Social Display in Competitive Multiagent Learning The Influence of Social Display in Competitive Multiagent Learning

An Associative State-Space Metric for Learning in Factored MDPs

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 16th Portuguese Conference on Artificial Intelligence (EPIA 2013), Azores, Portugal, September 9-12, 2013, pp. 163-174    An Associative State-Space Metric for Learning in Factored MDPs An Associative State-Space Metric for Learning in Factored MDPs

Emotion-based Intrinsic Motivation for Reinforcement Learning Agents
Best Paper Award

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Memphis, USA, October 9–12, 2011, pp. 326-336    Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents

Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning
Best Poster Award

Pedro Sequeira, Francisco S. Melo, Rui Prada and Ana Paiva
In Proceedings of the First Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2011), Frankfurt, Germany, August 24-27, 2011, pp. 1-6    Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning

Real-Time Sensory Pattern Mining for Autonomous Agents

Pedro Sequeira and Cláudia Antunes
In Proceedings of the 6th International Workshop on Agents and Data Mining Interaction (ADMI 2010), Toronto, Canada, 2010, pp. 71-83    Real-Time Sensory Pattern Mining for Autonomous Agents Real-Time Sensory Pattern Mining for Autonomous Agents

Technical Reports

Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Pedro Sequeira, Francisco S. Melo and Ana Paiva
GAIPS technical report series, GAIPS-TR-001-12, March 2012    Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Associative Metric for Learning in Factored MDPs Based on Classical Conditioning

Pedro Sequeira, Francisco S. Melo and Ana Paiva
GAIPS technical report series, GAIPS-TR-002-12, June 2012    Associative Metric for Learning in Factored MDPs Based on Classical Conditioning

Thesis

Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents

Pedro Sequeira
Ph.D. Thesis, Instituto Superior Técnico, Universidade de Lisboa, Portugal, 2013    Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents

Other

FearNot! Demo: A Virtual Environment with Synthetic Characters to Help Bullying
Best Demo Award

Marco Vala, Pedro Sequeira and Ana Paiva
In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’07), USA, May 14-18, 2007    FearNot! Demo: A Virtual Environment with Synthetic Characters to Help Bullying