Modality-free Graph In-context Alignment
About
In-context learning (ICL) converts static encoders into task-conditioned reasoners, enabling adaptation to new data from just a few examples without updating pretrained parameters. This capability is essential for graph foundation models (GFMs) to approach LLM-level generality. Yet current GFMs struggle with cross-domain alignment, typically relying on modality-specific encoders that fail when graphs are pre-vectorized or raw data is inaccessible. In this paper, we introduce Modality-Free Graph In-context Alignment (MF-GIA), a framework that makes a pretrained graph encoder promptable for few-shot prediction across heterogeneous domains without modality assumptions. MF-GIA captures domain characteristics through gradient fingerprints, which parameterize lightweight transformations that align pre-encoded features and indexed labels into unified semantic spaces. During pretraining, a dual prompt-aware attention mechanism with episodic objective learns to match queries against aligned support examples to establish prompt-based reasoning capabilities. At inference, MF-GIA performs parameter-update-free adaptation using only a few-shot support set to trigger cross-domain alignment and enable immediate prediction on unseen domains. Experiments demonstrate that MF-GIA achieves superior few-shot performance across diverse graph domains and strong generalization to unseen domains.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Node Classification | Cora (test) | Mean Accuracy63.98 | 861 | |
| Node Classification | ogbn-products (test) | Test Accuracy22.61 | 137 | |
| Node Classification | Computers 10-way E-commerce (test) | Accuracy53.71 | 33 | |
| Node Classification | Physics Co-authorship 5-way (test) | Accuracy88.92 | 33 | |
| Node Classification | BlogCatalog 6-way Social Media (test) | Accuracy67.31 | 33 | |
| Edge classification | WN18RR 5 way Lexical KG (test) | Accuracy68.05 | 30 | |
| Edge classification | WN18RR 10 way Lexical KG (test) | Accuracy35.12 | 30 | |
| Edge classification | FB15K237 5 way Encyclopedic KG (test) | Accuracy99.64 | 27 | |
| Edge classification | FB15K237 10 way Encyclopedic KG (test) | Accuracy91.38 | 27 | |
| Edge classification | FB15K237 40 way Encyclopedic KG (test) | Accuracy62.03 | 27 |