GRACE: Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series
About
From climate teleconnections to gene regulation, modern time-series datasets encompass tens or hundreds of interacting variables, making causal discovery increasingly challenging. Constraint-based methods offer statistical rigor but their nonlinear CI tests are infeasible at scale, while score-based alternatives avoid CI testing but require arbitrary thresholds to binarize continuous edge scores. We propose GRACE ($\textbf{G}$ated $\textbf{R}$efinement for $\textbf{A}$ccurate $\textbf{C}$ausal $\textbf{E}$dge discovery), which refines constraint-based discovery using Hard Concrete gates with $L_0$ regularization: each candidate edge has an independent gate whose values concentrate near 0 or 1, yielding a clean bimodal separation that makes the binary decision robust, unlike the narrow, overlapping score distributions produced by $L_1$ and attention-based methods. A fast linear CI skeleton provides high-recall candidates; a single gated model then prunes false positives by learning which edges genuinely improve prediction, with automatic regularization adapted to problem dimensions and skeleton density. Systematic experiments on synthetic benchmarks, spanning diverse graph topologies (scale-free, Erd\H{o}s-R'enyi, small-world) and dimensionalities up to $d=100$, show that GRACE substantially improves F1 over its base CI method while maintaining high precision, and outperforms attention-based and score-based alternatives. GRACE matches or exceeds expensive nonlinear CI tests at a fraction of the cost ($75\times$ faster). On a real-world river flow dataset, where rainfall confounders, variable propagation lags, and distributional shifts violate standard assumptions, a temporal bootstrap variant of GRACE recovers 9 of 11 causal edges along the Elbe River with only 1 false positive ($F_1 = 0.86$, AUROC${} = 0.99$), reducing the skeleton's 106 false positives by 99%.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Causal Discovery | sparse SCP | Structural Hamming Distance (SHD)9 | 80 | |
| Causal Discovery | SCP sparse | F1 Score92.9 | 80 | |
| Causal Discovery | SCP sparse (test) | Pair-level F187.8 | 24 | |
| Causal Discovery | SCP graphs T = 1000 synthetic | Runtime (s)38 | 20 | |
| Causal Discovery | Lorenz-96 with noisy observations (sigma = 0.1) | F1 Score89.4 | 12 | |
| Causal Discovery | Diverse graph topologies (d=50, T=1000) | Pair-level AUROC97.6 | 6 | |
| Causal Discovery | Elbe River’s main branch | AUROC0.986 | 3 |