Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generation

About

Recent advances in video world models enable interactive environments with free navigation, making translation between first-person (egocentric) and third-person (exocentric) perspectives increasingly important. However, existing studies focus on unidirectional exocentric-to-egocentric translation, overlooking reference-guided exocentric perspective synthesis. This capability is crucial for gaming and embodied AI applications. Motivated by this, we present WorldWander, an in-context learning framework tailored for translating between egocentric and exocentric worlds in video generation. Building upon advanced video diffusion transformers, WorldWander integrates (i) In-Context Perspective Alignment and (ii) Collaborative Position Encoding to model cross-view synchronization and character consistency. To support our task, we curate EgoExo-8K, a dynamic and scene-rich dataset containing synchronized egocentric-exocentric triplets from both synthetic and real-world scenarios. Experiments demonstrate that WorldWander achieves superior perspective synchronization, character consistency, and generalization, setting a new benchmark for egocentric-exocentric video translation.

Quanjian Song, Yiren Song, Kelly Peng, Yuan Gao, Mike Zheng Shou• 2025

Related benchmarks

TaskDatasetResultRank
Egocentric-to-Exocentric Video TranslationEgoExo Synthetic Scenarios 8K
LPIPS0.555
5
Egocentric-to-Exocentric Video TranslationEgoExo Real-World Scenarios 8K
LPIPS0.5357
5
Exocentric-to-Egocentric Video TranslationEgoExo Synthetic Scenarios 8K
LPIPS0.5811
5
Exocentric-to-Egocentric Video TranslationEgoExo Real-World Scenarios 8K
LPIPS0.6054
5
Showing 4 of 4 rows

Other info

Follow for update