Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Robotics

About

We introduce Dynamic Retrieval-Augmented Expert Networks (DRAE), a groundbreaking architecture that addresses the challenges of lifelong learning, catastrophic forgetting, and task adaptation by combining the dynamic routing capabilities of Mixture-of-Experts (MoE); leveraging the knowledge-enhancement power of Retrieval-Augmented Generation (RAG); incorporating a novel hierarchical reinforcement learning (RL) framework; and coordinating through ReflexNet-SchemaPlanner-HyperOptima (RSHO).DRAE dynamically routes expert models via a sparse MoE gating mechanism, enabling efficient resource allocation while leveraging external knowledge through parametric retrieval (P-RAG) to augment the learning process. We propose a new RL framework with ReflexNet for low-level task execution, SchemaPlanner for symbolic reasoning, and HyperOptima for long-term context modeling, ensuring continuous adaptation and memory retention. Experimental results show that DRAE significantly outperforms baseline approaches in long-term task retention and knowledge reuse, achieving an average task success rate of 82.5% across a set of dynamic robotic manipulation tasks, compared to 74.2% for traditional MoE models. Furthermore, DRAE maintains an extremely low forgetting rate, outperforming state-of-the-art methods in catastrophic forgetting mitigation. These results demonstrate the effectiveness of our approach in enabling flexible, scalable, and efficient lifelong learning for robotics.

Yayu Long, Kewei Chen, Long Jin, Mingsheng Shang• 2025

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisLLFF
PSNR26.4
124
Novel View SynthesisNeRF Synthetic
PSNR27.8
92
Novel View SynthesisTanks&Temples
SSIM67.5
39
PlanningNAVSIM (test)
PDMS88
22
Novel View SynthesisLLFF 3-shot
PSNR20
17
View SynthesisTanks&Temples
PSNR20.8
15
Vision-Language NavigationHA-VLN Unseen (val)
NE5.75
13
Dexterous Hand ControlAdroit
Overall Avg Success Rate76
13
View SynthesisShiny-6 (test)
PSNR27.9
11
Humanoid Motion GenerationHumanoidML3D
FID0.35
9
Showing 10 of 34 rows

Other info

Follow for update