Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SynthPert: Enhancing LLM Biological Reasoning via Synthetic Reasoning Traces for Cellular Perturbation Prediction

About

Predicting cellular responses to genetic perturbations represents a fundamental challenge in systems biology, critical for advancing therapeutic discovery and virtual cell modeling. While large language models (LLMs) show promise for biological reasoning, their application to perturbation prediction remains underexplored due to challenges in adapting them to structured experimental data. We present SynthPert, a novel method that enhances LLM performance through supervised fine-tuning on synthetic reasoning traces generated by frontier models. Using the PerturbQA benchmark, we demonstrate that our approach not only achieves state-of-the-art performance but surpasses the capabilities of the frontier model that generated the training data. Our results reveal three key insights: (1) Synthetic reasoning traces effectively distill biological knowledge even when partially inaccurate, (2) This approach enables cross-cell-type generalization with 87% accuracy on unseen RPE1 cells, and (3) Performance gains persist despite using only 2% of quality-filtered training data. This work shows the effectiveness of synthetic reasoning distillation for enhancing domain-specific reasoning in LLMs.

Lawrence Phillips, Marc Boubnovski Martell, Aditya Misra, Josefa Lia Stoisser, Cesar A. Prada-Medina, Rory Donovan-Maiye, Kaspar M\"artens• 2025

Related benchmarks

TaskDatasetResultRank
Gene regulation direction predictionPerturbQA K562
AUROC0.65
18
Gene regulation direction predictionPerturbQA RPE1
AUROC0.73
18
Gene regulation direction predictionPerturbQA (HepG2)
AUROC0.72
18
Gene regulation direction predictionPerturbQA Jurkat
AUROC0.65
18
Differential ExpressionPerturbQA K562
AUROC0.7
9
Differential ExpressionPerturbQA RPE1
AUROC78
9
Differential ExpressionPerturbQA (HepG2)
AUROC0.74
9
Showing 7 of 7 rows

Other info

Follow for update