Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Text Distance from Nested and Hierarchical Repetitions: A Compression-Based Perspective

About

We present a new method for structural sequence analysis grounded in Algorithmic Information Theory (AIT). At its core is the Ladderpath approach, which extracts nested and hierarchical relationships among repeated substructures in linguistic sequences -- an instantiation of AIT's principle of describing data through minimal generative programs. These structures are then used to define three distance measures: a normalized compression distance (NCD), and two alternative distances derived directly from the Ladderpath representation. Integrated with a $k$-nearest neighbor classifier, these distances achieve strong and consistent performance across in-distribution, out-of-distribution (OOD), and few-shot text classification tasks. In particular, all three methods outperform both gzip-based NCD and BERT under OOD and low-resource settings. These results demonstrate that the structured representations captured by Ladderpath preserve intrinsic properties of sequences and provide a lightweight, interpretable, and training-free alternative for text modeling. This work highlights the potential of AIT-based approaches for structural and domain-agnostic sequence understanding.

Xiaojun Hu, Jing Wang, Jingwen Zhang, Fengyao Zhai, Xiao Xie, Hao Liao, Zengru Di, Yu Liu• 2026

Related benchmarks

TaskDatasetResultRank
Text ClassificationAGNews
Accuracy88.5
161
Text ClassificationDBpedia (DBP)
Accuracy85.7
131
Text ClassificationR8
Accuracy91.8
113
Text ClassificationR52
Accuracy86.4
98
Text ClassificationSogou News
Accuracy95.9
16
Text ClassificationKinyarwanda-News
Accuracy84.2
10
Text ClassificationKirundi-News
Accuracy90.5
10
Text ClassificationDengue-Filipino
Accuracy98.1
10
Text ClassificationSwahili-News
Accuracy89.2
10
Showing 9 of 9 rows

Other info

Follow for update