Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval

About

With the need of fast retrieval speed and small memory footprint, document hashing has been playing a crucial role in large-scale information retrieval. To generate high-quality hashing code, both semantics and neighborhood information are crucial. However, most existing methods leverage only one of them or simply combine them via some intuitive criteria, lacking a theoretical principle to guide the integration process. In this paper, we encode the neighborhood information with a graph-induced Gaussian distribution, and propose to integrate the two types of information with a graph-driven generative model. To deal with the complicated correlations among documents, we further propose a tree-structured approximation method for learning. Under the approximation, we prove that the training objective can be decomposed into terms involving only singleton or pairwise documents, enabling the model to be trained as efficiently as uncorrelated ones. Extensive experimental results on three benchmark datasets show that our method achieves superior performance over state-of-the-art methods, demonstrating the effectiveness of the proposed model for simultaneously preserving semantic and neighborhood information.\

Zijing Ou, Qinliang Su, Jianxing Yu, Bang Liu, Jingwen Wang, Ruihui Zhao, Changyou Chen, Yefeng Zheng• 2021

Related benchmarks

TaskDatasetResultRank
Unsupervised document hashing20Newsgroups
Precision67.31
36
Unsupervised document hashingReuters
Precision0.8624
32
Unsupervised document hashingTMC
Precision77.26
32
Semantic HashingReuters (test)
Precision0.8567
12
Semantic HashingTMC (test)
Precision0.8329
12
Semantic Hashing20Newsgroups (test)
Precision70.04
8
Showing 6 of 6 rows

Other info

Code

Follow for update