Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Q-STRUM Debate: Query-Driven Contrastive Summarization for Recommendation Comparison

About

Query-driven recommendation with unknown items poses a challenge for users to understand why certain items are appropriate for their needs. Query-driven Contrastive Summarization (QCS) is a methodology designed to address this issue by leveraging language-based item descriptions to clarify contrasts between them. However, existing state-of-the-art contrastive summarization methods such as STRUM-LLM fall short of this goal. To overcome these limitations, we introduce Q-STRUM Debate, a novel extension of STRUM-LLM that employs debate-style prompting to generate focused and contrastive summarizations of item aspects relevant to a query. Leveraging modern large language models (LLMs) as powerful tools for generating debates, Q-STRUM Debate provides enhanced contrastive summaries. Experiments across three datasets demonstrate that Q-STRUM Debate yields significant performance improvements over existing methods on key contrastive summarization criteria, thus introducing a novel and performant debate prompting methodology for QCS.

George-Kirollos Saad, Scott Sanner• 2025

Related benchmarks

TaskDatasetResultRank
Contrastive SummarizationRestaurants
Contrast87
2
Contrastive SummarizationHotels
Contrast80
2
Contrastive SummarizationTravelDest
Contrast0.75
2
Pairwise LLM EvaluationRestaurants
Win Rate (Contrast)83
2
Pairwise LLM EvaluationHotels
Win Rate (Contrast)82
2
Pairwise LLM EvaluationTravelDest
Win Rate Contrast74
2
Query-driven contrastive summarizationRestaurants (test)
Contrast Win Rate87
2
Query-driven contrastive summarizationHotels (test)
Contrast Win Rate82
2
Query-driven contrastive summarizationTravelDest (test)
Contrast Win Rate78
2
Showing 9 of 9 rows

Other info

Code

Follow for update