TIDES: Time-Derivative Event Simulation via Deformable Reconstruction
About
Event cameras emit asynchronous events in response to environmental appearance changes. The scarcity of real-world event datasets makes simulation essential. However, most simulators infer event timestamps from frame sequences, forcing many threshold crossings to share a small set of discrete times; a failure mode we term timestamp batching that worsens under fast motion and occlusion. We present TIDES, a continuous-time event simulator built on dynamic Gaussian splatting. Because TIDES operates on an explicit 3D scene representation with learnt geometry and motion, it can derive per-pixel intensity dynamics directly from the scene, rather than by differencing rendered frames. This enables accurate threshold-crossing prediction, including multiple crossings per rendering step, without temporal upsampling or frame interpolation. The same 3D scene model reveals where objects partially occlude one another; TIDES uses this to guide adaptive time stepping, concentrating computation only in regions where occlusion dynamics make simple models of brightness change unreliable. Finally, we model finite sensor bandwidth using a tile-level arbiter whose throughput, jitter, and event drops reproduce realistic sensor artifacts. Across paired RGB-event benchmarks, TIDES attains state-of-the-art event-stream fidelity. We also show that events simulated by TIDES transfer more effectively to real downstream tasks than competitors'.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | DSEC | mIoU17.6898 | 24 | |
| Video Frame Interpolation | BS-ERGB | LPIPS0.0335 | 17 | |
| Batching diagnostics | DSEC | Same-ts0.0564 | 6 | |
| Event-stream fidelity | EDS | IG-NLL0.0037 | 6 | |
| Event-stream fidelity | HS-ERGB | IG-NLL0.0023 | 6 | |
| Event-stream fidelity | BS-ERGB | IG-NLL0.0043 | 6 | |
| Event-stream fidelity | DSEC | IG-NLL0.0684 | 6 | |
| Batching diagnostics | EDS | Same-ts0.0409 | 6 | |
| Batching diagnostics | HS-ERGB | Same-ts0.0511 | 6 | |
| Batching diagnostics | BS-ERGB | Same-ts0.0856 | 6 |