Ignacio Carlucho

Heriot-Watt University and The National Robotarium.


EM G06, Heriot-Watt University

Edinburgh, UK

I am an Assistant Professor (Lecturer) in robotics and autonomous systems in the School of Engineering and Physical Sciences at Heriot-Watt University. I am also part of the the National Robotarium and the Edinburgh Centre for Robotics.

My main research interests are in robotics, reinforcement learning, and multi-agent systems, with a focus on ad hoc teamwork. With my research, I seek to develop intelligent agents, capable of making autonomous decisions in complex multi-agent environments without the need for human supervision. Particularly, I see reinforcement learning as a viable learning paradigm, which could enable adaptive and intelligent behaviour in robotic systems. Thus, the main focus of my research so far has been on the development of autonomous control policies for complex robotic platforms, such as underwater autonomous vehicle-manipulator systems.

If you are interested in doing a PhD in robotics, reinforcement learning, or multi-agent systems do not hesitate to contact me.

Ad hoc teamwork seminar series

To disseminate previous and ongoing research of the AHT research community members, we are organizing a monthly seminar series on ad hoc teamwork starting this Fall. Join us in the ad hoc teamwork seminar series!

More information on the website Or listen to the first talk by Frans Oliehoek and Robert Loftin here.


Oct 2023 I am co-organizing the workshop in ad hoc teamwork at IAAA ‘24.
Jul 2023 Join our workshop in Deep learning for field robotics to be held at ICIAP
May 2023 I joined Heriot-Watt University as an Assistant Professor
Nov 2022 I am a google cloud champion innovator! You can check my profile here
Jul 2022 Check out the proceedings of our workshop in Ad Hoc Teamwork where we played Hanabi

selected publications


  1. Enhancing AUV Autonomy With Model Predictive Path Integral Control
    Pierre Nicolay, Yvan Petillot, Mykhaylo Marfeychuk, and 2 more authors
    In OCEANS 2023, 2023
  2. dory.png
    Semi-Parametric Control Architecture for Autonomous Underwater Vehicles Subject to Time Delays
    Ignacio Carlucho, Dylan Stephens, William Ard, and 1 more author
    IEEE Access, 2023
  3. gpl.png
    A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learning
    Arrasy Rahman, Ignacio Carlucho, Niklas Höpner, and 1 more author
    Journal of Machine Learning Research, 2023
  4. brdiv.png
    Generating Teammates for Training Robust Ad Hoc Teamwork Agents via Best-Response Diversity
    Arrasy Rahman, Elliot Fosong, Ignacio Carlucho, and 1 more author
    Transactions on Machine Learning Research, 2023