Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CamCloneMaster: Enabling Reference-based Camera Control for Video Generation

About

Camera control is crucial for generating expressive and cinematic videos. Existing methods rely on explicit sequences of camera parameters as control conditions, which can be cumbersome for users to construct, particularly for intricate camera movements. To provide a more intuitive camera control method, we propose CamCloneMaster, a framework that enables users to replicate camera movements from reference videos without requiring camera parameters or test-time fine-tuning. CamCloneMaster seamlessly supports reference-based camera control for both Image-to-Video and Video-to-Video tasks within a unified framework. Furthermore, we present the Camera Clone Dataset, a large-scale synthetic dataset designed for camera clone learning, encompassing diverse scenes, subjects, and camera movements. Extensive experiments and user studies demonstrate that CamCloneMaster outperforms existing methods in terms of both camera controllability and visual quality.

Yawen Luo, Jianhong Bai, Xiaoyu Shi, Menghan Xia, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Tianfan Xue• 2025

Related benchmarks

TaskDatasetResultRank
Video GenerationVBench--
126
Novel View SynthesisiPhone dataset
SSIM0.444
33
Camera controlCamera-control (evaluation)
Rotation Error (RotErr)1.36
7
Video-to-Video Camera Motion ControlUser Study V2V
Artifact Score21.5
7
Video-to-VideoKoala-36M and RealEstate10K
FVD241.4
7
Image-to-VideoKoala-36M and RealEstate10K
FVD312.1
6
Video ReshootingDAVIS and Pexels 110 video-camera pairs (user study)
Source Preservation15.63
6
Video Reshooting110 video-camera pairs evaluation dataset (DAVIS and Pexels)
FID101.4
6
Image-to-Video Camera Motion ControlUser Study I2V
Artifact Score18.5
6
Camera control and 3D consistencyiPhone dataset
Translation Error2.132
6
Showing 10 of 15 rows

Other info

Follow for update