Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Test-Time Instance-Specific Parameter Composition: A New Paradigm for Adaptive Generative Modeling

About

Existing generative models, such as diffusion and auto-regressive networks, are inherently static, relying on a fixed set of pretrained parameters to handle all inputs. In contrast, humans flexibly adapt their internal generative representations to each perceptual or imaginative context. Inspired by this capability, we introduce Composer, a new paradigm for adaptive generative modeling based on test-time instance-specific parameter composition. Composer generates input-conditioned parameter adaptations at inference time, which are injected into the pretrained model's weights, enabling per-input specialization without fine-tuning or retraining. Adaptation occurs once prior to multi-step generation, yielding higher-quality, context-aware outputs with minimal computational and memory overhead. Experiments show that Composer substantially improves performance across diverse generative models and use cases, including lightweight/quantized models and test-time scaling. By leveraging input-aware parameter composition, Composer establishes a new paradigm for designing generative models that dynamically adapt to each input, moving beyond static parameterization.

Minh-Tuan Tran, Xuan-May Le, Quan Hung Tran, Mehrtash Harandi, Dinh Phung, Trung Le• 2026

Related benchmarks

TaskDatasetResultRank
Class-conditional Image GenerationImageNet 256x256--
815
Class-conditional Image GenerationImageNet 256x256 (val)
FID1.79
427
Class-conditional Image GenerationImageNet 512x512
FID2.51
111
Text-to-Image GenerationCOCO 2014 (val)
Precision94.15
34
Text-to-Image GenerationMS-COCO 2014
FID (30K)13.07
3
Text-to-Image GenerationImageNet 256x256 (OOD)
FID3.23
2
Showing 6 of 6 rows

Other info

Follow for update