Research

An overview of the research conducted in my lab.

Marine Robotics

We develop algorithms for robust autonomous operation in challenging underwater environments, focusing on the unique challenges of the marine environment, such as the limited communication, dynamic disturbances, and degraded sensing. Research questions include: how to achieve reliable localization with limited acoustic sensing; how to enable efficient multi-robot coordination under severe constraints; and how to perform robust perception and mapping in visually degraded conditions. Our work spans fundamental robotics capabilities from SLAM to motion planning and control, with particular emphasis on field deployment and validation.

Recent publications:
FRAGG-Map: Frustum Accelerated GPU-Based Grid Map
Digital Twins Below the Surface: Enhancing Underwater Teleoperation

Reinforcement Learning

Our research focuses on developing robust reinforcement learning algorithms that can handle the challenges of real-world robotics: continuous action spaces, partial observability, and safety constraints. We investigate how to enable efficient learning from limited data, how to incorporate safety constraints into the learning process, and how to transfer learned policies across different robots and tasks. A key focus is bridging the gap between simulation and reality through techniques like domain randomization and meta-learning.

Recent publications:
MarineGym: Accelerated Training for Underwater Vehicles with High-Fidelity RL Simulation
Harnessing traditional controllers for fast-track training of deep reinforcement learning control strategies

Multi-agent Systems

Our research explores the design of control and planning strategies for multi-robot teams working in real-world environment. We are particularly interested in machine learning techniques, such as reinforcement learning, to achieve distributed decision-making and efficient coordination. We investigate areas such as cooperative control, multi-agent coordination, ad hoc teamwork, and the deployment on these techniques in real world robots. By transforming how robotic tasks are approached, our focus on distributed autonomy and cooperative behavior enables the deployment of larger-scale and more robust robotic systems across a range of application domains.

Recent publications:
Learning Complex Teamwork Tasks Using a Given Sub-task Decomposition
A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learning