Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

I-Max: Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers with Projected Flow

About

Rectified Flow Transformers (RFTs) offer superior training and inference efficiency, making them likely the most viable direction for scaling up diffusion models. However, progress in generation resolution has been relatively slow due to data quality and training costs. Tuning-free resolution extrapolation presents an alternative, but current methods often reduce generative stability, limiting practical application. In this paper, we review existing resolution extrapolation methods and introduce the I-Max framework to maximize the resolution potential of Text-to-Image RFTs. I-Max features: (i) a novel Projected Flow strategy for stable extrapolation and (ii) an advanced inference toolkit for generalizing model knowledge to higher resolutions. Experiments with Lumina-Next-2K and Flux.1-dev demonstrate I-Max's ability to enhance stability in resolution extrapolation and show that it can bring image detail emergence and artifact correction, confirming the practical value of tuning-free resolution extrapolation.

Ruoyi Du, Dongyang Liu, Le Zhuo, Qin Qi, Hongsheng Li, Zhanyu Ma, Peng Gao• 2024

Related benchmarks

TaskDatasetResultRank
Text-to-Image Generation4K Resolution 4K x 4K (test)
CLIP IQA Score0.4381
16
Video GenerationVLM Evaluation Suite
Aesthetic Appeal8.25
8
Video GenerationVBench 1080P 1920 × 1088
Subject Consistency95.7
8
Video GenerationVBench 4K 3840 × 2176
Subject Consistency94.7
8
Resolution extrapolationFlux Guided resolution extrapolation (test)
FID72
3
Showing 5 of 5 rows

Other info

Follow for update