Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MUSE: Unlocking Timestep as Native Task Steering for One-Step Dense Prediction

About

Monocular dense prediction has recently seen remarkable success by repurposing pre-trained diffusion models. This opens a promising yet challenging avenue for more efficient multi-task learning paradigm. However, existing multi-task diffusion methods often introduce parameter-heavy adapters, experts, or learnable task tokens, leading to computational redundancy. In this paper, we reveal an inherent mechanism within one-step diffusion models: the native, fixed sinusoidal timestep embedding can be repurposed as an endogenous task steering signal. Based on this discovery, we propose Multi-task Unified eStimation via timestep Embedding (MUSE), a parameter-free, single-model multi-tasking approach for dense prediction. We interpret this mechanism via Manifold Decoupling, where discrete, fixed timestep values deterministically steer the generation process towards decoupled, task-specific manifolds in the latent space. Extensive experiments across 10 datasets demonstrate that MUSE achieves highly competitive performance on both monocular depth and normal estimation, and its efficacy generalizes across U-Net and DiT architectures. Our work offers a concise and efficient path toward generalist vision models by simply unlocking the latent potential of existing generation infrastructure.

Shuo Zhou, Zhaoxin Li, Xiujuan Chai• 2026

Related benchmarks

TaskDatasetResultRank
Surface Normal EstimationNYU V2
Mean Angular Error16.6
96
Affine-invariant depth estimationETH3D
AbsRel5.9
71
Affine-invariant depth estimationNYU V2
AbsRel5.1
71
Affine-invariant depth estimationScanNet
AbsRel5.8
69
Surface Normal EstimationiBIMS-1
MAE16.7
67
Video Surface Normal EstimationSintel
Mean Angular Error35.2
32
Affine-invariant depth estimationKITTI
AbsRel9.2
25
Surface Normal EstimationScanNet
Mean Error15.4
20
Affine-invariant depth estimationDIODE
AbsRel23.8
12
Surface Normal EstimationOASIS
Mean Angular Error23.4
12
Showing 10 of 10 rows

Other info

Follow for update