Graph is a Substrate Across Data Modalities
About
Graphs provide a natural representation of relational structure that arises across diverse domains. Despite this ubiquity, graph structure is typically learned in a modality- and task-isolated manner, where graph representations are constructed within individual task contexts and discarded thereafter. As a result, structural regularities across modalities and tasks are repeatedly reconstructed rather than accumulated at the level of intermediate graph representations. This motivates a representation-learning question: how should graph structure be organized so that it can persist and accumulate across heterogeneous modalities and tasks? We adopt a representation-centric perspective in which graph structure is treated as a structural substrate that persists across learning contexts. To instantiate this perspective, we propose G-Substrate, a graph substrate framework that organizes learning around shared graph structures. G-Substrate comprises two complementary mechanisms: a unified structural schema that ensures compatibility among graph representations across heterogeneous modalities and tasks, and an interleaved role-based training strategy that exposes the same graph structure to multiple functional roles during learning. Experiments across multiple domains, modalities, and tasks show that G-Substrate outperforms task-isolated and naive multi-task learning methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Event relation extraction | MAVEN-T | F1 Score42.68 | 8 | |
| Event relation extraction | MAVEN-C | F1 Score40.91 | 8 | |
| Event relation extraction | HiEvent | F1 Score25.15 | 8 | |
| Graph Algorithmic Reasoning | GAR Shortest Path | Accuracy48.59 | 8 | |
| Graph Algorithmic Reasoning | GAR Bipartite Matching | Accuracy94.54 | 8 | |
| Graph Algorithmic Reasoning | GAR Cycle Detection | Accuracy96.97 | 8 | |
| Event relation extraction | MAVEN-S | F1 Score52.2 | 8 | |
| Graph Algorithmic Reasoning | GAR Connectivity | Accuracy98.41 | 8 | |
| Molecular Graph Description | MGD | BLEU-451.53 | 7 | |
| Scene Graph Generation | SGG | PCIs R@5025.38 | 7 |