Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation
About
We present a hierarchical model for ball action anticipation in football broadcast video. Given a 30-second observation window, the system predicts actions occurring in the subsequent 5-second window across 10 classes. A shared local Transformer encodes clip-level features within each 5-second sub-window; a GRU then aggregates temporal context across all sub-windows; finally, a Transformer decoder with K input-conditioned event slots decodes the anticipation target via three decoupled heads (objectness, class, temporal offset). We introduce frequency-reweighted Hungarian matching that systematically favours rare action classes, and Gaussian soft targets for temporal bin supervision. On the SoccerNet Ball Action Anticipation benchmark, our method achieves 17.91% mAP on the test server.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Ball Action Anticipation | SoccerNet Ball Action Anticipation (BAA) (test) | mAP @1s5.6 | 1 | |
| Ball Action Anticipation | SoccerNet Ball Action Anticipation (BAA) (challenge) | mAP @1s5.5 | 1 |