Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FlowBind: Efficient Any-to-Any Generation with Bidirectional Flows

About

Any-to-any generation seeks to translate between arbitrary subsets of modalities, enabling flexible cross-modal synthesis. Despite recent success, existing flow-based approaches are challenged by their inefficiency, as they require large-scale datasets often with restrictive pairing constraints, incur high computational cost from modeling joint distribution, and rely on complex multi-stage training. We propose FlowBind, an efficient framework for any-to-any generation. Our approach is distinguished by its simplicity: it learns a shared latent space capturing cross-modal information, with modality-specific invertible flows bridging this latent to each modality. Both components are optimized jointly under a single flow-matching objective, and at inference the invertible flows act as encoders and decoders for direct translation across modalities. By factorizing interactions through the shared latent, FlowBind naturally leverages arbitrary subsets of modalities for training, and achieves competitive generation quality while substantially reducing data requirements and computational cost. Experiments on text, image, and audio demonstrate that FlowBind attains comparable quality while requiring up to 6x fewer parameters and training 10x faster than prior methods. The project page with code is available at https://yeonwoo378.github.io/official_flowbind.

Yeonwoo Cha, Semin Kim, Jinhyeon Kwon, Seunghoon Hong• 2025

Related benchmarks

TaskDatasetResultRank
(I+A)→T Cross-modal AlignmentImage-Text-Audio
CLIP Score29.14
16
(T+A)→I Cross-modal AlignmentImage-Text-Audio
CLIP Score28.07
16
(T+I)→A Cross-modal AlignmentImage-Text-Audio
CLAP Score27.13
16
Audio-to-Text GenerationImage-Text-Audio
CIDEr54.41
9
Text-to-Image GenerationImage-Text-Audio
FID20.13
9
Image-to-Text GenerationImage-Text-Audio
CIDEr42.57
9
Text-to-Audio GenerationImage-Text-Audio
FAD4.64
9
Image-to-Audio GenerationImage-Text-Audio
FAD2.12
8
Audio-to-Image GenerationImage-Text-Audio
FID28.47
8
Text-to-Image GenerationOne-to-one evaluation benchmarks Text-to-Image
FID17.39
6
Showing 10 of 28 rows

Other info

Follow for update