BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
About
Biological laboratory automation can reduce repetitive manual work and improve reproducibility, but reliable embodied execution in wet-lab environments remains challenging. Protocols are often unstructured, labware is frequently transparent or reflective, and multi-step procedures require state-aware execution beyond one-shot instruction following. Existing robotic systems often rely on costly hardware, fixed workflows, dedicated instruments, or robotics-oriented interfaces. Here, we introduce BioProVLA-Agent, an affordable, protocol-driven, vision-enhanced embodied multi-agent system enabled by Vision-Language-Action (VLA) models for biological manipulation. The system uses protocols as the task interface and integrates protocol parsing, visual state verification, and embodied execution in a closed-loop workflow. A Tailored LLM Protocol Agent converts protocols into verifiable subtasks; a VLM-RAG Verification Agent assesses readiness and completion using observations, robot states, retrieved knowledge, and success/failure examples; and a VLA Embodied Agent executes verified subtasks through a lightweight policy. To improve robustness under wet-lab visual perturbations, we develop AugSmolVLA, an online augmentation strategy targeting transparent labware, reflections, illumination shifts, and overexposure. We evaluate the system on a hierarchical benchmark covering 15 atomic tasks, 6 composite workflows, and 3 bimanual tasks, including tube loading, sorting, waste disposal, cap twisting, and liquid pouring. Across normal and high-exposure settings, AugSmolVLA improves execution stability over ACT, X-VLA, and the original SmolVLA, especially for precise placement, transparent-object manipulation, composite workflows, and visually degraded scenes. These results suggest a practical route toward accessible, protocol-centered, and verification-capable embodied AI for biological manipulation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Clean up waste materials | Composite multi-step laboratory tasks | Completion Rate75 | 4 | |
| Close Water Bath Lid | Single-Arm Laboratory Automation | Success Rate75 | 4 | |
| Composite task | Dual-arm experimental setup | Completion Rate39.45 | 4 | |
| Discard Centrifuge Tube | Single-Arm Laboratory Automation | Success Rate90 | 4 | |
| Discard Cryotube | Single-Arm Laboratory Automation | Success Rate55 | 4 | |
| Insert Tube to Centrifuge | Single-Arm Laboratory Automation | Success Rate48.33 | 4 | |
| Loading centrifuge tube | Composite multi-step laboratory tasks | Completion Rate (CR)56.67 | 4 | |
| Loading float | Composite multi-step laboratory tasks | Completion Rate56.67 | 4 | |
| Open Centrifuge Lid | Single-Arm Laboratory Automation | Success Rate56.67 | 4 | |
| Place Centrifuge Tube to Orange Rack | Single-Arm Laboratory Automation | Success Rate53.33 | 4 |