Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Self-Taught Hashing for Fast Similarity Search

About

The ability of fast similarity search at large scale is of great importance to many Information Retrieval (IR) applications. A promising way to accelerate similarity search is semantic hashing which designs compact binary codes for a large number of documents so that semantically similar documents are mapped to similar codes (within a short Hamming distance). Although some recently proposed techniques are able to generate high-quality codes for documents known in advance, obtaining the codes for previously unseen documents remains to be a very challenging problem. In this paper, we emphasise this issue and propose a novel Self-Taught Hashing (STH) approach to semantic hashing: we first find the optimal $l$-bit binary codes for all documents in the given corpus via unsupervised learning, and then train $l$ classifiers via supervised learning to predict the $l$-bit code for any query document unseen before. Our experiments on three real-world text datasets show that the proposed approach using binarised Laplacian Eigenmap (LapEig) and linear Support Vector Machine (SVM) outperforms state-of-the-art techniques significantly.

Dell Zhang, Jun Wang, Deng Cai, Jinsong Lu• 2010

Related benchmarks

TaskDatasetResultRank
Document Retrieval20Newsgroups (test)
Precision@10058.6
45
Document RetrievalReuters21578 (test)
Precision@10075.54
45
Document RetrievalRCV1 (test)
Precision@1000.5946
45
Document RetrievalTMC (test)
Precision@10041.81
45
Unsupervised document hashing20Newsgroups
Precision58.6
36
Unsupervised document hashingReuters
Precision0.7554
32
Unsupervised document hashingTMC
Precision41.81
32
Showing 7 of 7 rows

Other info

Follow for update