Research Projects

Post-Doc

Multi-Agent Intelligent Surveillance (2011–2013)
[CMU-Portugal Program and FCT, PI: Francisco S. Melo]:
I am applying principled sequential decision-making techniques to plan the motion of robots, and to provide decision support for security guards, both of which patrol and respond to unpredictable events in a closely-monitored environment.

[MAIS-S]
[MAIS-S]

Intelligent Smartgrid Control (currently in proposal stage):
Today's energy distribution is becoming more and more challenging due to the integration of traditional power plants, large-scale micro-generation units (e.g., solar fields), and unpredictable renewable energy sources (e.g., wind). I propose that, by leveraging recent advances in multiagent planning and optimization, future smartgrid operation can be made safer, more efficient, and more economical.

PhD

Automated Service Composition (2007–2010)
[AFOSR grant FA9550-07-1-0262, PI: Edmund Durfee]:
I developed agent-based methods for orchestrating complex activities that require coordination of interdependent services (e.g., web services, low-level control methods, or any other time or resource-intensive tasks). This work led me to formalize influence-based policy abstraction and advancing the state of the art in planning efficiency and scalability for weakly-coupled agents acting under uncertainty.

[Automated Service Composition]
[COORDINATORS]

Coordinated Decision Support Agents (2005–2007)
[DARPA/IPTO COORDINATORs, PI: Edmund Durfee]:
My entrance into multiagent planning research came from examining a rich problem context: how to strategically coordinate the operations of military field units, whose individual contributions to the mission are performed in a dynamic and uncertain environment.

Earlier

Swarming Autonomous Vehicles (2004–2005)
[at Johns' Hopkins U. Applied Physics Lab, PI: Dave Scheidt]:
I developed high-level methods for controlling unmanned vehicle swarms using the potential fields formalism (inspired by ant colonies and by gravitational fields). My methods were then evaluated in simulation and on unmanned ground vehicles (UGVs) in a variety of war game scenarios, and have since proven practical for unmanned aerial vehicles (UAVs).

[Swarm]
[PGTG]

Prison Guard Training Game. A case study of single-agent RL yielding cooperation in a multiagent game (2003)
[Cornell University Masters' Project, Advisor: Bart Selman]:
Here I developed a simple grid-world game that simulated a jail break, wherein two guard agents were trained simultaneously (but independently) using Temporal Difference Q-Learning of Neural-Network-encoded policies. See my PGTG webpage for the intriguing results, demo videos, and testbed code.

Click here to see my list of course-associated projects