MPO: Boosting LLM Agents with Meta Plan Optimization
About
Recent advancements in large language models (LLMs) have enabled LLM-based agents to successfully tackle interactive planning tasks. However, despite their successes, existing approaches often suffer from planning hallucinations and require retraining for each new agent. To address these challenges, we propose the Meta Plan Optimization (MPO) framework, , which enhances agent planning capabilities by directly incorporating explicit guidance. Unlike previous methods that rely on complex knowledge, which either require significant human effort or lack quality assurance, MPO leverages high-level general guidance through meta plans to assist agent planning and enables continuous optimization of the meta plans based on feedback from the agent's task execution. Our experiments conducted on two representative tasks demonstrate that MPO significantly outperforms existing baselines. Moreover, our analysis indicates that MPO provides a plug-and-play solution that enhances both task completion efficiency and generalization capabilities in previous unseen scenarios.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Interactive Decision-making | ScienceWorld Seen | Success Rate80.91 | 72 | |
| Interactive Decision-making | WebShop (test) | Success Rate87.5 | 37 | |
| Interactive Decision-making | ScienceWorld Unseen | Success Rate77.46 | 32 | |
| Interactive Decision-making | ALFWorld Seen | Success Rate82.9 | 32 | |
| Interactive Decision-making | ALFWorld Unseen | Success Rate78.4 | 32 | |
| Interactive Environment Task Completion | ALFWorld Seen | Average Reward88.2 | 31 | |
| Interactive Environment Task Completion | ALFWorld Unseen | Average Reward88.1 | 31 | |
| Interactive Environment Task Completion | ScienceWorld Seen | Average Reward87.8 | 22 | |
| Interactive Environment Task Completion | ScienceWorld Unseen | Average Reward89 | 22 | |
| Interactive Environment Task Completion | WebShop (Seen) | Average Reward83.5 | 22 |