The work done in the article was published in the journal robotics and autonomous systems.
About the article
In this work we developed a deep RL adaptive controller for AUVs based on the well known deep deterministic policy gradient algorithm (DDPG). The proposal was a goal-oriented deep RL architecture, which takes the available raw sensory information as input and gives as output the continuous control actions which are directly the low-level commands for the AUV’s thrusters.
The research was perform at the Ocean Systems Laboratory of the Heriot-Watt University, using Nessie, the autonomous underwater vehicle developed by students and researchers of the university.