Evolvable Conditional Diffusion
About
This paper presents an evolvable conditional diffusion method such that black-box, non-differentiable multi-physics models, as are common in domains like computational fluid dynamics and electromagnetics, can be effectively used for guiding the generative process to facilitate autonomous scientific discovery. We formulate the guidance as an optimization problem where one optimizes for a desired fitness function through updates to the descriptive statistic for the denoising distribution, and derive an evolution-guided approach from first principles through the lens of probabilistic evolution. Interestingly, the final derived update algorithm is analogous to the update as per common gradient-based guided diffusion models, but without ever having to compute any derivatives. We validate our proposed evolvable diffusion algorithm in two AI for Science scenarios: the automated design of fluidic topology and meta-surface. Results demonstrate that this method effectively generates designs that better satisfy specific optimization objectives without reliance on differentiable proxies, providing an effective means of guidance-based diffusion that can capitalize on the wealth of black-box, non-differentiable multi-physics numerical models common across Science.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Attribute Alignment | Gemma animal-attribute prompts | Happy Score0.18 | 9 | |
| Compressibility optimization | Animal prompts 2D image generation | Compressibility26.18 | 5 | |
| Incompressibility optimization | Animal prompts 2D image generation | Incompressibility Score262.1 | 5 | |
| Aesthetic Reward Optimization | Animal prompts 2D image generation | Aesthetic Score6.37 | 5 | |
| HPSv3 Reward Optimization | Animal prompts 2D image generation | HPSv3 Score8.57 | 5 | |
| 3D Aerodynamic optimization | 3D Vehicle models | Aerodynamic Score0.3 | 5 | |
| Text-to-Image Generation | Task #1 Complex Prompts 1.0 (test) | Aesthetic Score5.977 | 3 | |
| Text-to-Image Generation | Text-to-image prompt 'In the ink painting style, a naive giant panda is sitting on the majestic Great Wall, leisure lychewing bamboo' | Aesthetic Score6.337 | 3 | |
| Text-to-Image Generation | Prompt: 'A glowing dragon soaring through floating islands, leaving behind a trail of shimmering stardust' | Aesthetic Score6.291 | 3 | |
| Text-to-Image Generation | Text-to-Image Prompt: 'quick doodle of a guy, medium hair with long bangs, hd detailed detailed' | Aesthetic Score6.091 | 3 |