Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EduVQA: Towards Concept-Aware Assessment of Educational AI-Generated Videos

About

Existing AI-generated video quality assessment (AIGVQA) methods mainly focus on global perceptual realism and coarse text-video alignment, while overlooking a critical requirement in educational scenarios: concept correctness. In early mathematics education, subtle errors in numerical quantities, geometric relations, or spatial configurations may fundamentally alter the conveyed knowledge despite visually plausible generation. To address this problem, we introduce EduAVQABench, the first benchmark for concept-aware educational AIGV assessment, containing 1,130 videos generated by ten state-of-the-art T2V models together with over 310,650 fine-grained human annotations spanning perceptual quality and semantic alignment. Built upon this benchmark, we further propose EduVQA, a concept-aware AIGVQA framework equipped with a Structured 2D Mixture-of-Experts (S2D-MoE) architecture. By jointly modeling fine-grained concept assessment and overall quality prediction through shared experts and adaptive two-dimensional routing, EduVQA effectively captures subtle concept-level inconsistencies overlooked by conventional global scoring methods. Extensive experiments demonstrate that EduVQA consistently outperforms existing AIGVQA approaches across both perceptual and semantic evaluation tasks while exhibiting strong generalization capability on unseen benchmarks. Code and dataset will be publicly available at: https://github.com/EduVQA/EduVQA.

Baoliang Chen, Xinlong Bu, Hanwei Zhu, Lingyu Zhu, Jieyu Zhan• 2026

Related benchmarks

TaskDatasetResultRank
Perceptual QualityEduAIGV-1k
SRCC0.869
13
Perceptual Video Quality AssessmentEvalCrafter
SRCC0.408
10
Spatial Video Quality AssessmentLGVQ
SRCC0.536
10
Temporal Video Quality AssessmentLGVQ
SRCC0.511
10
Prompt AlignmentEduAIGV-1k
SRCC75.7
8
Video-Text Prompt AlignmentLGVQ
SRCC0.529
4
Video-Text Prompt AlignmentEvalCrafter
SRCC0.586
4
Showing 7 of 7 rows

Other info

Follow for update