Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GLARE: A Natural Language Interface for Querying Global Explanations

About

While global explanations are crucial for understanding vision models across datasets, classes, and decision contexts, their complex and monolithic nature often hinders practical exploration. Because users typically seek targeted answers to specific questions rather than static artifacts, we present an LLM-based interactive interface that provides natural language access to global explanations for black-box image classifiers. The system's core LLM acts as a mediator, translating natural language questions into structured SQL queries over local explanation data. This enables flexible aggregation without exposing users to low-level representations. For each query, the interface outputs statistics-augmented natural language responses, supporting local explanations, and intent-aligned visualizations. We evaluate the system on intent interpretation, query mapping accuracy, generalization to novel queries and datasets, and robustness to linguistic errors. Our results demonstrate that LLM-mediated querying substantially improves the accessibility and usability of global explanations for human-centered XAI.

Bhavan Vasu, Rajesh Mangannavar• 2026

Related benchmarks

TaskDatasetResultRank
Query AccuracyADE20K Fresh 500 examples (test)
Fence Accuracy100
13
Zero-shot Query AccuracyPASCAL VOC Zero-shot transfer 166 objects
Fence Accuracy100
7
Text-to-SQL generationFresh
Result Match95.4
6
Text-to-SQL generationOOD
Overall Match Accuracy40
6
Text-to-SQL generationPascal VOC
Result Match (%)90.6
6
Text-to-SQL generationRobustness perturbations
Mean Robustness Weighted Average Score85.9
6
Showing 6 of 6 rows

Other info

Follow for update