MUSE: Unlocking Timestep as Native Task Steering for One-Step Dense Prediction
About
Monocular dense prediction has recently seen remarkable success by repurposing pre-trained diffusion models. This opens a promising yet challenging avenue for more efficient multi-task learning paradigm. However, existing multi-task diffusion methods often introduce parameter-heavy adapters, experts, or learnable task tokens, leading to computational redundancy. In this paper, we reveal an inherent mechanism within one-step diffusion models: the native, fixed sinusoidal timestep embedding can be repurposed as an endogenous task steering signal. Based on this discovery, we propose Multi-task Unified eStimation via timestep Embedding (MUSE), a parameter-free, single-model multi-tasking approach for dense prediction. We interpret this mechanism via Manifold Decoupling, where discrete, fixed timestep values deterministically steer the generation process towards decoupled, task-specific manifolds in the latent space. Extensive experiments across 10 datasets demonstrate that MUSE achieves highly competitive performance on both monocular depth and normal estimation, and its efficacy generalizes across U-Net and DiT architectures. Our work offers a concise and efficient path toward generalist vision models by simply unlocking the latent potential of existing generation infrastructure.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Surface Normal Estimation | NYU V2 | Mean Angular Error16.6 | 96 | |
| Affine-invariant depth estimation | ETH3D | AbsRel5.9 | 71 | |
| Affine-invariant depth estimation | NYU V2 | AbsRel5.1 | 71 | |
| Affine-invariant depth estimation | ScanNet | AbsRel5.8 | 69 | |
| Surface Normal Estimation | iBIMS-1 | MAE16.7 | 67 | |
| Video Surface Normal Estimation | Sintel | Mean Angular Error35.2 | 32 | |
| Affine-invariant depth estimation | KITTI | AbsRel9.2 | 25 | |
| Surface Normal Estimation | ScanNet | Mean Error15.4 | 20 | |
| Affine-invariant depth estimation | DIODE | AbsRel23.8 | 12 | |
| Surface Normal Estimation | OASIS | Mean Angular Error23.4 | 12 |