Share your thoughts, 1 month free Claude Pro on usSee more

Single-choice question answering on SCQ

65Accuracy

SFT with Hybrid data

Updated 1mo ago

Evaluation Results

Method	Links
SFT with Hybrid data 2025.12		65
SFT with Human-only data 2025.12		60
GPT-4o-Audio 2025.12		58.3
Gemini-2.5-Flash 2025.12		45
Gemini-2.5-Pro 2025.12		45
SFT with MLLM-only data 2025.12		37.5
GPT-4o-Mini-Audio 2025.12		36.8
Qwen2-Audio-7B 2025.12		32.5
Qwen2.5-Omni-7B 2025.12		20