Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation

About

Instruction-based video editing is a natural way to control video content with text, but adapting a video generation model into an editor usually appears data-hungry. At the same time, high-quality video editing data remains scarce. In this paper, we show that a video generation backbone can become a strong video editor without large scale video editing data. We present InsEdit, an instruction-based editing model built on HunyuanVideo-1.5. InsEdit combines a visual editing architecture with a video data pipeline based on Mutual Context Attention (MCA), which creates aligned video pairs where edits can begin in the middle of a clip rather than only from the first frame. With only O(100)K video editing data, InsEdit achieves state-of-the-art results among open-source methods on our video instruction editing benchmarks. In addition, because our training recipe also includes image editing data, the final model supports image editing without any modification.

Zhefan Rao, Bin Zou, Haoxuan Che, Xuanhua He, Chong Hou Choi, Yanheng Li, Rui Liu, Qifeng Chen• 2026

Related benchmarks

TaskDatasetResultRank
Instruction-Guided Video EditingOpenVE-Bench
Overall Score4.43
17
Image Instruction EditingGEdit
G-SC Score6.98
10
Video Instruction EditingInsEdit-Bench
Overall Score4.61
9
Showing 3 of 3 rows

Other info

Follow for update