Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DEO: Training-Free Direct Embedding Optimization for Negation-Aware Retrieval

About

Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have enabled diverse retrieval methods. However, existing retrieval methods often fail to accurately retrieve results for negation and exclusion queries. To address this limitation, prior approaches rely on embedding adaptation or fine-tuning, which introduce additional computational cost and deployment complexity. We propose Direct Embedding Optimization (DEO), a training-free method for negation-aware text and multimodal retrieval. DEO decomposes queries into positive and negative components and optimizes the query embedding with a contrastive objective. Without additional training data or model updates, DEO outperforms baselines on NegConstraint, with gains of +0.0738 nDCG@10 and +0.1028 MAP@100, while improving Recall@5 by +6\% over OpenAI CLIP in multimodal retrieval. These results demonstrate the practicality of DEO for negation- and exclusion-aware retrieval in real-world settings.

Taegyeong Lee, Jiwon Park, Seunghyun Hwang, JooYoung Jang• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Image RetrievalCOCO-Neg
Recall@569.8
8
Question AnsweringNevIR 20 randomly sampled queries
Accuracy30
8
Constraint-aware RetrievalAntonym self-constructed
V@273.53
8
Constraint-aware RetrievalNegation self-constructed
V@272.55
8
Constraint-aware RetrievalExclusion self-constructed
Recall@253.85
8
Information RetrievalNevIR
V@231.1
8
Information RetrievalExcluIR
V@251.1
8
Negation RetrievalNegConstraint
MAP73.79
6
Negation RetrievalNevIR
Pairwise Score29.28
6
Showing 9 of 9 rows

Other info

Follow for update