Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment

About

Understanding the multi-dimensional attributes and intensity nuances of image-evoked emotions is pivotal for advancing machine empathy and empowering diverse human-computer interaction applications. However, existing models are still limited to coarse-grained emotion perception or deficient reasoning capabilities. To bridge this gap, we introduce EEmoDB, the largest image-evoked emotion understanding dataset to date. It features $5$ analysis dimensions spanning $5$ distinct task categories, facilitating comprehensive interpretation. Specifically, we compile $1.2M$ question-answering (QA) pairs (EEmoDB-QA) from $125k$ images via automated generation, alongside a $36k$ dataset (EEmoDB-Assess) curated from $25k$ images for fine-grained assessment. Furthermore, we propose EEmo-Logic, an all-in-one multimodal large language model (MLLM) developed via instruction fine-tuning and task-customized group relative preference optimization (GRPO) with novel reward design. Extensive experiments demonstrate that EEmo-Logic achieves robust performance in in-domain and cross-domain datasets, excelling in emotion QA and fine-grained assessment. The code is available at https://anonymous.4open.science/r/EEmoLogic.

Lancheng Gao, Ziheng Jia, Zixuan Xing, Wei Sun, Huiyu Duan, Guangtao Zhai, Xiongkuo Min• 2026

Related benchmarks

TaskDatasetResultRank
Emotion PerceptionEEmo-Bench
Overall Perception Score68.54
50
Comprehensive Emotion AssessmentEEmo-Bench
Total Overall Score0.6622
25
Emotion RankingEEmo-Bench
Emotion Score67.97
25
Emotion AssessmentEEmo-Bench 1.0 (test)
Valence SRCC0.85
10
Dominant evoked emotion recognitionArtEmis
F1 Score31.58
6
Emotion-related aesthetic assessmentAesBench AesE
Emotion72.3
6
Dominant evoked emotion recognitionArtphoto
F1 Score38.68
6
Emotion-related aesthetic assessmentUNIAA Sent
Overall Score75.65
6
Showing 8 of 8 rows

Other info

Follow for update