Temporal Causal Prior-Data Fitted Networks for Panel Data with Learned Reliability Signals
About
Estimating causal effects in industrial time series requires handling temporal dynamics, time-varying treatments, and unobserved confounders. Existing causal foundation models (CausalPFN, CausalFM) operate only on static cross-sectional data; neural temporal methods (CRN, G-Net) require per-dataset training; and concurrent temporal-PFN proposals have not been demonstrated at industrial scale. None output explicit per-pair reliability signals alongside their CATE estimates. We introduce Temporal Causal Prior-Data Fitted Networks (TCPFN), a foundation model for zero-shot temporal causal discovery with learned reliability signals. TCPFN makes four contributions: (1) a Causal Judgment Head that jointly predicts null-effect probability, confounding strength, identifiability, mediation fraction, and causal regime; (2) a mixed training prior covering six causal regimes (independent, direct, confounded, mediated, time-varying confounded, feedback) plus CausalFM-style front-door and instrumental-variable priors; (3) a discrete-token panel-data architecture with cross-attention masking that prevents inter-horizon leakage; (4) zero-shot inference at industrial scale via FAISS-based context selection and one-step posterior correction. On 19 benchmark datasets across five domains, TCPFN achieves competitive zero-shot causal discovery: AUROC 0.96 on Tennessee Eastman, 0.93 on SWaT, 0.98 on Causal Rivers, 0.97 on CAUSRCA. The null detector reaches NullF1 0.94, AUROC 0.99. TCPFN scales to V=1,275 on a proprietary Kraft pulp-and-paper dataset in 6 hours on a single GPU; PCMCI, a CPU-only library, on a V=666 sub-panel of the same data took 81.5 hours, extrapolating by O(V^2) to ~12.5 days at V=1,275. TCPFN's top edges identify cross-subsystem causal relationships while PCMCI's surface within-instrument controller-measurement coupling -- a scalability case study.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Causal Discovery | SWaT | F1 Score28.8 | 25 | |
| Causal Discovery | Tennessee Eastman | F1@0.538.7 | 6 | |
| Causal Discovery | CAUSRCA CNC lathe | F1 Score @ 0.544.7 | 6 | |
| Causal Discovery | Sachs biology | F1 Score (Threshold 0.5)33.7 | 6 | |
| Causal Discovery | CauseMe NVAR-5 | F1@0.580 | 6 | |
| Causal Discovery | CauseMe NVAR-10 | F1@0.566.7 | 6 | |
| Causal Discovery | Causal Rivers | F1@0.554.9 | 6 | |
| Causal Discovery | CauseMe VAR-10 | F1@0.560 | 6 | |
| Causal Discovery | CauseMe LongLag-VAR-10 | F1@0.542.6 | 3 | |
| Causal Discovery | CauseMe LongLag-NVAR-10 | F1@0.557.6 | 3 |