Publications

2016 (2) - 2015 (3) - 2014 (3) - 2013 (2) - 2012 (2) - 2011 (2) - 2010 (1) - 2009 (1) - 2008 (1) - 2007 (2)

2016

Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)

Pedro Sequeira, Francisco S. Melo and Ana Paiva

In Proceedings of the 15th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2016, pp. 466–467.  Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents (JAAMAS Extended Abstract)

Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies
Best Paper Award on HRI Interaction Design

Pedro Sequeira, Patrícia Alves-Oliveira, Tiago Ribeiro, Eugenio Di Tullio, Sofia Petisca, Francisco S. Melo, Ginevra Castellano, and Ana Paiva

In Proceedings of the 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2016, pp. 197–204. Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz StudiesDiscovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies

2015

“Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the IEEE Conference on Computational Intelligence and Games (IEEE CIG 2015), pp. 399-406, Aug 31– Sep 2, Tainan, 2015. “Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game“Let’s Save Resources!”: A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game

The Development of Cooperation in Evolving Populations through Social Importance

Pedro Sequeira, Samuel Mascarenhas, Francisco S. Melo and Ana Paiva
Proceedings of the 5th International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2015), pp. 308–313, August 13-16, Providence, Rhode Island, 2015.The Development of Cooperation in Evolving Populations through Social ImportanceThe Development of Cooperation in Evolving Populations through Social Importance

The “Favors Game”: A Framework to Study the Emergence of Cooperation through Social Importance

Pedro Sequeira, Samuel Mascarenhas, Francisco S. Melo and Ana Paiva
In Proceedings of the 14th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’15), Istanbul, May 4–8, 2015 (Extended Abstract), pp. 1899-1900 The ``Favors Game'': A Framework to Study the Emergence of Cooperation through Social Importance The ``Favors Game'': A Framework to Study the Emergence of Cooperation through Social Importance

2014

The Influence of Social Display in Competitive Multiagent Learning

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 4th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2014), Genoa, Italy, October 13-16, 2014, pp. 64–69 The Influence of Social Display in Competitive Multiagent Learning The Influence of Social Display in Competitive Multiagent Learning

Emergence of Emotional Appraisal Signals in Reinforcement Learning Agents

Pedro Sequeira, Francisco S. Melo and Ana Paiva
Autonomous Agents and Multi-Agent Systems, 29(4), 2015, pp. 537-568. DOI 10.1007/s10458-014-9262-4 Emergence of Emotional Appraisal Signals in Reinforcement Learning AgentsEmergence of Emotional Appraisal Signals in Reinforcement Learning Agents

Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Pedro Sequeira, Francisco S. Melo and Ana Paiva
Adaptive Behavior, 22(5), 2014, pp. 330–349. DOI 10.1177/1059712314543837  Learning by Appraising: An Emotion-based Approach for Intrinsic Reward DesignLearning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

2013

Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents

Pedro Sequeira
Ph.D. Thesis, Instituto Superior Técnico, Universidade de Lisboa, Portugal, 2013    Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents Socio-Emotional Reward Design for Intrinsically Motivated Learning Agents

An Associative State-Space Metric for Learning in Factored MDPs

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 16th Portuguese Conference on Artificial Intelligence (EPIA 2013), Azores, Portugal, September 9-12, 2013, pp. 163-174    An Associative State-Space Metric for Learning in Factored MDPs An Associative State-Space Metric for Learning in Factored MDPs

2012

Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Pedro Sequeira, Francisco S. Melo and Ana Paiva
GAIPS technical report series, GAIPS-TR-001-12, March 2012    Learning by Appraising: An Emotion-based Approach for Intrinsic Reward Design

Associative Metric for Learning in Factored MDPs Based on Classical Conditioning

Pedro Sequeira, Francisco S. Melo and Ana Paiva
GAIPS technical report series, GAIPS-TR-002-12, June 2012    Associative Metric for Learning in Factored MDPs Based on Classical Conditioning

2011

Emotion-based Intrinsic Motivation for Reinforcement Learning Agents
Best Paper Award

Pedro Sequeira, Francisco S. Melo and Ana Paiva
In Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Memphis, USA, October 9–12, 2011, pp. 326-336    Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents

Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning
Best Poster Award

Pedro Sequeira, Francisco S. MeloRui Prada and Ana Paiva
In Proceedings of the First Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2011), Frankfurt, Germany, August 24-27, 2011, pp. 1-6    Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning Emerging Social Awareness: Exploring Intrinsic Motivation in Multiagent Learning

2010

Real-Time Sensory Pattern Mining for Autonomous Agents

Pedro Sequeira and Cláudia Antunes
In Proceedings of the 6th International Workshop on Agents and Data Mining Interaction (ADMI 2010), Toronto, Canada, 2010, pp. 71-83    Real-Time Sensory Pattern Mining for Autonomous Agents Real-Time Sensory Pattern Mining for Autonomous Agents

2009

ION Framework – A Simulation Environment for Worlds with Virtual Agents

Marco Vala, Guilherme RaimundoPedro Sequeira, Pedro Cuba, Rui Prada, Carlos Martinho and Ana Paiva
In Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA 2009), Amsterdam, The Netherlands, September, 2009 , pp. 418-424     ION Framework - A Simulation Environment for Worlds with Virtual Agents

2008

Learning to Interact: Connecting Perception with Action in Virtual Environments

Pedro Sequeira and Ana Paiva
In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’08), Portugal, May 12-16, 2008, pp. 1257-1260 (Extended Abstract)    Learning to Interact: Connecting Perception with Action in Virtual Environments Learning to Interact: Connecting Perception with Action in Virtual Environments

2007

“What can I do with this?” – Finding Possible Interactions between Characters and Objects

Pedro Sequeira, Marco Vala and Ana Paiva
In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’07), USA, May 14-18, 2007 , pp. 14-18    "What can I do with this?" – Finding Possible Interactions between Characters and Objects "What can I do with this?" – Finding Possible Interactions between Characters and Objects "What can I do with this?" – Finding Possible Interactions between Characters and Objects

FearNot! Demo: A Virtual Environment with Synthetic Characters to Help Bullying
Best Demo Award

Marco ValaPedro Sequeira and Ana Paiva
In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’07), USA, May 14-18, 2007    FearNot! Demo: A Virtual Environment with Synthetic Characters to Help Bullying