Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Modality-free Graph In-context Alignment

About

In-context learning (ICL) converts static encoders into task-conditioned reasoners, enabling adaptation to new data from just a few examples without updating pretrained parameters. This capability is essential for graph foundation models (GFMs) to approach LLM-level generality. Yet current GFMs struggle with cross-domain alignment, typically relying on modality-specific encoders that fail when graphs are pre-vectorized or raw data is inaccessible. In this paper, we introduce Modality-Free Graph In-context Alignment (MF-GIA), a framework that makes a pretrained graph encoder promptable for few-shot prediction across heterogeneous domains without modality assumptions. MF-GIA captures domain characteristics through gradient fingerprints, which parameterize lightweight transformations that align pre-encoded features and indexed labels into unified semantic spaces. During pretraining, a dual prompt-aware attention mechanism with episodic objective learns to match queries against aligned support examples to establish prompt-based reasoning capabilities. At inference, MF-GIA performs parameter-update-free adaptation using only a few-shot support set to trigger cross-domain alignment and enable immediate prediction on unseen domains. Experiments demonstrate that MF-GIA achieves superior few-shot performance across diverse graph domains and strong generalization to unseen domains.

Wei Zhuo, Siqiang Luo• 2026

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora (test)
Mean Accuracy63.98
861
Node Classificationogbn-products (test)
Test Accuracy22.61
137
Node ClassificationComputers 10-way E-commerce (test)
Accuracy53.71
33
Node ClassificationPhysics Co-authorship 5-way (test)
Accuracy88.92
33
Node ClassificationBlogCatalog 6-way Social Media (test)
Accuracy67.31
33
Edge classificationWN18RR 5 way Lexical KG (test)
Accuracy68.05
30
Edge classificationWN18RR 10 way Lexical KG (test)
Accuracy35.12
30
Edge classificationFB15K237 5 way Encyclopedic KG (test)
Accuracy99.64
27
Edge classificationFB15K237 10 way Encyclopedic KG (test)
Accuracy91.38
27
Edge classificationFB15K237 40 way Encyclopedic KG (test)
Accuracy62.03
27
Showing 10 of 10 rows

Other info

Follow for update