Dynamic Treatment on Networks
About
In networks, effective dynamic treatment allocation requires deciding both whom to treat and also when, so as to amplify policy impact through spillovers. An early intervention at a well-connected node can trigger cascades that change which nodes are worth targeting in the next period. Existing treatment strategies under network interference are largely static while dynamic treatment frameworks typically ignore network structure altogether. We integrate these perspectives and propose Q-Ising, a three-stage pipeline that (i) estimates network adoption dynamics via a Bayesian dynamic Ising model from a single observed panel, (ii) augments treatment adoption histories with continuous posterior latent states, and (iii) learns a dynamic policy via offline reinforcement learning. The Bayesian mechanism enables uncertainty quantification over dynamic decisions, yielding posterior ensemble policies with interpretable spillover estimates. We provide a finite-sample regret upper bound that decomposes into standard offline-RL uncertainty, network abstraction error, and first stage error in Ising state estimation. We apply our method to data from Indian village microfinance networks and synthetic stochastic block models under simulated heterogeneous susceptible-infected-susceptible (SIS) dynamics and demonstrate that adaptive targeting outperforms static centrality benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Influence Maximization | Indian Microfinance Village Networks Village 18 | Mean Reward4.5 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 26 | Mean Reward0.042 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 32 | Mean Reward6.9 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 34 | Mean Reward7.1 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 38 | Mean Reward0.073 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 39 | Mean Reward0.107 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 40 | Mean Reward0.08 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 41 | Mean Reward0.046 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 5 | Mean Reward0.031 | 6 | |
| Influence Maximization | Indian Microfinance Village Networks Village 10 | Mean Reward6.7 | 6 |