Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Text Has Curvature

About

Does text have an intrinsic curvature? Language is increasingly modeled in curved geometries - hyperbolic spaces for hierarchy, mixed-curvature manifolds for compositional structure - yet a basic scientific question remains unresolved: what does curvature mean for text itself, in a way that is native to language rather than an artifact of the embedding space we choose? We argue that text does indeed have curvature, and show how to detect it, define it, and use it. To this end, we propose Texture, a text-native, word-level discrete curvature signal, and make three contributions. (a) Existence: We provide empirical and theoretical certificates that semantic inference in natural corpora is non-flat, i.e. language has inherent curvature. (b) Definition: We define Texture by reconciling left- and right-context beliefs around a masked word through a Schrodinger bridge, yielding a curvature field that is positive where context focuses meaning and negative where it fans out into competing continuations. (c) Utility: Texture is actionable: it serves as a general-purpose measurement and control primitive enabling geometry without geometric training; we instantiate it on two representative tasks, improving long-context inference through curvature-guided compression and retrieval-augmented generation through curvature-guided routing. Together, our results establish a text-native curvature paradigm, making curvature measurable and practically useful.

Karish Grover, Hanqing Zeng, Yinglong Xia, Christos Faloutsos, Geoffrey J. Gordon• 2026

Related benchmarks

TaskDatasetResultRank
Multi-hop Question Answering2WikiMQA
F1 Score12.8
154
Question Answering2WikiMQA
F113.1
44
Question AnsweringLongBench Qasper
F10.102
8
SummarizationLongBench GovReport
ROUGE-L21
8
Question AnsweringLongBench HotpotQA
F1 Score27.8
8
SummarizationLongBench QMSum
ROUGE-L15.4
8
Multi-hop Question AnsweringHotpotQA
F1 Score29.1
5
Showing 7 of 7 rows

Other info

Follow for update