Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LabGuard: Grounding Natural-Language Laboratory Rules into Runtime Guards for Embodied Laboratory Agents

About

Scientific embodied agents are increasingly capable of carrying out laboratory procedures, but executing these procedures safely in dynamic laboratory environments remains challenging. Current safety approaches often overlook the intermediate step of transforming laboratory natural language, including safety rules, manuals, protocols, and standard operating procedures, into machine-checkable runtime constraints. We introduce LabGuard (Laboratory Guard), a language-to-execution safety suite that grounds natural-language laboratory rules into executable specifications and deploys them as runtime guards. LabGuard includes three core components: LabGuard-IR, which defines a typed executable representation; LabGuard-Bench, which provides 812 supervised annotations expanded from 203 seed laboratory rules; and LabGuard-Grounder, which maps natural-language laboratory rules into LabGuard-IR. The resulting IR instances are handled by the LabGuard Pipeline, which compiles them into runtime monitors and applies them at the controller boundary. Experiments show that LabGuard generalizes to unseen laboratory-rule sources, achieves 79.4 task-scope F1, and reduces unsafe events from 39.5% to 23.8% after monitor compilation. In LabUtopia, its runtime monitors integrate with ACT, keeping interventions below 0.5% while preserving task success.

Jingpu Yang, Fengxian Ji, Zhengzhao Lai, Zhexuan Cui, Guangxian Ouyang, Qian Jiang, Fan Zhang, Min Peng, Qianqian Xie, Preslav Nakov, Zhuohan Xie• 2026

Related benchmarks

TaskDatasetResultRank
Laboratory-language groundingLabGuard-Bench 1.0 (source-held-out)
Tag F179.4
10
Runtime monitor executionLabUtopia L1-L4 grounding 1.0 (source-held-out)
Unsafe Events23.8
10
Laboratory-language groundingLabGuard-Bench (random 80/20 split)
Type Accuracy91.4
9
Laboratory-language groundingLabGuard-Bench chemistry-held-out hydrochloric acid 1.0
Tag F191.8
6
Runtime monitor executionLabUtopia L1-L4 chemistry-held-out grounding 1.0 (hydrochloric acid)
Unsafe Events14.3
6
Compiled-monitor replayStress benchmark
True Positives (TP)41
5
Language-to-Execution GroundingLabGuard-Bench stress benchmark (Random 80/20 split)
Tag F193.8
4
Language-to-Execution GroundingLabGuard-Bench stress benchmark (Source-held-out)
Tag F176.5
3
Showing 8 of 8 rows

Other info

Follow for update