Learning to Interact: Connecting Perception with Action in Virtual Environments


Pedro Sequeira and Ana Paiva
In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’08), Portugal, May 12-16, 2008, pp. 1257-1260 (Extended Abstract)    Learning to Interact: Connecting Perception with Action in Virtual Environments Learning to Interact: Connecting Perception with Action in Virtual Environments


Abstract
Modeling synthetic characters which interact with objects in dynamic virtual worlds is important when we want the agents to act in an autonomous and non-preplanned way. Such interactions with objects would allow the synthetic characters to behave in a more believable way. Once objects offer innumerous uses, it is essential that the agent is able to acquire the necessary knowledge to identify action possibilities in the objects while interacting with them. We propose a conceptual framework that allows the agents to identify possible interactions with objects based in past experiences with other objects. Starting from sensory patterns collected during interactions with objects, the agent is able to acquire conceptual knowledge about regularities of the world, its internal states and its own actions. The presented work also proposes that such acquired knowledge may be used by the agent in order to satisfy its needs and goals by interacting with objects. Preliminary tests were made and it is possible to state that our agents are able to acquire valid conceptual knowledge about the regularities in the environment and its objects, its own actions and causal relations between them.

sequeira2008aamas.pdf

Paper

sequeira2008aamas_poster.pdf

Poster

Posted on