DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Robotics
About
We introduce Dynamic Retrieval-Augmented Expert Networks (DRAE), a groundbreaking architecture that addresses the challenges of lifelong learning, catastrophic forgetting, and task adaptation by combining the dynamic routing capabilities of Mixture-of-Experts (MoE); leveraging the knowledge-enhancement power of Retrieval-Augmented Generation (RAG); incorporating a novel hierarchical reinforcement learning (RL) framework; and coordinating through ReflexNet-SchemaPlanner-HyperOptima (RSHO).DRAE dynamically routes expert models via a sparse MoE gating mechanism, enabling efficient resource allocation while leveraging external knowledge through parametric retrieval (P-RAG) to augment the learning process. We propose a new RL framework with ReflexNet for low-level task execution, SchemaPlanner for symbolic reasoning, and HyperOptima for long-term context modeling, ensuring continuous adaptation and memory retention. Experimental results show that DRAE significantly outperforms baseline approaches in long-term task retention and knowledge reuse, achieving an average task success rate of 82.5% across a set of dynamic robotic manipulation tasks, compared to 74.2% for traditional MoE models. Furthermore, DRAE maintains an extremely low forgetting rate, outperforming state-of-the-art methods in catastrophic forgetting mitigation. These results demonstrate the effectiveness of our approach in enabling flexible, scalable, and efficient lifelong learning for robotics.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | LLFF | PSNR26.4 | 124 | |
| Novel View Synthesis | NeRF Synthetic | PSNR27.8 | 92 | |
| Novel View Synthesis | Tanks&Temples | SSIM67.5 | 39 | |
| Planning | NAVSIM (test) | PDMS88 | 22 | |
| Novel View Synthesis | LLFF 3-shot | PSNR20 | 17 | |
| View Synthesis | Tanks&Temples | PSNR20.8 | 15 | |
| Vision-Language Navigation | HA-VLN Unseen (val) | NE5.75 | 13 | |
| Dexterous Hand Control | Adroit | Overall Avg Success Rate76 | 13 | |
| View Synthesis | Shiny-6 (test) | PSNR27.9 | 11 | |
| Humanoid Motion Generation | HumanoidML3D | FID0.35 | 9 |