Pretrained Battery Transformer (PBT): A battery life prediction foundation model
About
Early prediction of battery cycle life is essential for accelerating battery research, manufacturing, and deployment. Although machine learning methods have shown encouraging results, progress is hindered by data scarcity and heterogeneity arising from diverse aging conditions. In other fields, foundation models (FMs) trained on diverse datasets have achieved broad generalization through transfer learning, but no FMs have been reported for battery cycle life prediction yet. Here we present the Pretrained Battery Transformer (PBT), the first FM for battery life prediction, developed through domain-knowledge-encoded mixture-of-expert layers. Validated on the largest public battery life database, PBT learns transferable representations from 13 lithium-ion battery (LIB) datasets, outperforming existing models by an average of 19.8%. With transfer learning, PBT achieves state-of-the-art performance across 15 diverse datasets encompassing 995 batteries and 537 aging conditions of LIBs, sodium-ion batteries and Zinc-ion batteries. This work establishes a foundation model pathway for battery lifetime prediction, paving the way toward universal battery lifetime prediction systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Battery cycle life prediction | HNEI (test) | Imp97.65 | 1 | |
| Battery cycle life prediction | MATR (test) | Imp Score51.85 | 1 | |
| Battery cycle life prediction | MICH (test) | Imp Score76.01 | 1 | |
| Battery cycle life prediction | XJTU (test) | Imp Score96.04 | 1 | |
| Battery cycle life prediction | Stanford (test) | Imp9.26 | 1 | |
| Battery cycle life prediction | RWTH (test) | Imp53.14 | 1 | |
| Battery cycle life prediction | MICH_EXP (test) | Imp94.71 | 1 | |
| Battery cycle life prediction | Tongji (test) | Imp31.39 | 1 | |
| Battery cycle life prediction | HUST (test) | Imp18.95 | 1 | |
| Battery cycle life prediction | SNL (test) | Imp92.17 | 1 |