Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning

About

The accurate extraction of scientific measurements from literature is a critical yet challenging task in AI4Science, enabling large-scale analysis and integration of quantitative research findings. However, Large Language Models (LLMs) frequently exhibit severe hallucinations, which significantly undermine the reliability of automated scientific document understanding systems. To address this problem, we propose MeasHalu, a novel framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. We first present a fine-grained taxonomy of measurement-specific hallucinations, categorizing errors across quantities, units, modifiers, and relations. Our approach incorporates a two-stage reasoning-aware fine-tuning strategy using augmented scientific data and process-based supervision. Furthermore, we introduce a progressive reward curriculum designed to penalize specific hallucination types, significantly improving extraction faithfulness. Experimental results demonstrate that MeasHalu substantially reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. This work provides a targeted solution to a key bottleneck in automated scientific knowledge extraction, facilitating more trustworthy and scalable machine-assisted scientific literature analysis.

Ruijun Huang, Zhiqiao Kang, Yuxuan Zhu, Junxiong Li, Jiahao Zhao, Minghuan Tan, Feng Jiang, Min Yang• 2026

Related benchmarks

TaskDatasetResultRank
Measurement Information ExtractionMeasEval (test)
Overall Score51.2
44
Measurement Information ExtractionMeasEval-Ext (test)
Overall Score57.8
16
Information ExtractionMeasEval-Ext
Overall Score57.8
13
Information ExtractionOpenExp-Action-100
Validity Score16.33
9
Text-to-action generationOpenExp-Action-100
Validity Score (Val)16.33
9
Showing 5 of 5 rows

Other info

Follow for update