Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EASL: Multi-Emotion Guided Semantic Disentanglement for Expressive Sign Language Generation

About

Large language models have revolutionized sign language generation by automatically transforming text into high-quality sign language videos, providing accessible communication for the Deaf community. However, existing LLM-based approaches prioritize semantic accuracy while overlooking emotional expressions, resulting in outputs that lack naturalness and expressiveness. We propose EASL (Emotion-Aware Sign Language), a multi-emotion-guided generation architecture for fine-grained emotional integration. We introduce emotion-semantic disentanglement modules with progressive training to separately extract semantic and affective features. During pose decoding, the emotional representations guide semantic interaction to generate sign poses with 7-class emotion confidence scores, enabling emotional expression recognition. Experimental results demonstrate that EASL achieves pose accuracy superior to all compared baselines by integrating multi-emotion information and effectively adapts to diffusion models to generate expressive sign language videos.

Yanchao Zhao, Jihao Zhu, Yu Liu, Weizhuo Chen, Yuling Yang, Kun Peng• 2025

Related benchmarks

TaskDatasetResultRank
Sign language generationPHOENIX14T
BLEU-137.46
5
Sign language generationPrompt2Sign (test)
BLEU-150
5
Showing 2 of 2 rows

Other info

Follow for update