Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation

About

Multi-agent reinforcement learning is a key method for training multi-robot systems. Through rewarding or punishing robots over a series of episodes according to their performance, they can be trained and then deployed in the real world. However, poorly trained policies can lead to unsafe behaviour during early training stages. We introduce Multi-Agent Reinforcement Learning guided by language-based Inter-robot Negotiation (MARLIN), a hybrid framework in which large language models provide high-level planning before the reinforcement learning policy has learned effective behaviours. Robots use language models to negotiate actions and generate plans that guide policy learning. The system dynamically switches between reinforcement learning and language-model-based negotiation during training, enabling safer and more effective exploration. MARLIN is evaluated using both simulated and physical robots with local and remote language models. Results show that, compared to standard multi-agent reinforcement learning, the hybrid approach achieves higher performance in early training without reducing final performance. The code is available at https://github.com/SooratiLab/MARLIN.

Toby Godfrey, William Hunt, Mohammad D. Soorati• 2024

Related benchmarks

TaskDatasetResultRank
Multi-agent NavigationAsymmetrical Two Slot Corridor
Average Performance100
6
Multi-agent NavigationMaze-Like Corridor
Average Performance100
6
Multi-agent NavigationSingle Slot Corridor
Average Performance100
6
Multi-agent NavigationSymmetrical Two Slot Corridor
Average Performance100
6
Multi-agent NavigationTwo Path Corridor
Average Performance100
6
Showing 5 of 5 rows

Other info

Follow for update