Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fast-dLLM++: Fr\'{e}chet Profile Decoding for Faster Diffusion LLM Inference

About

Diffusion large language models promise parallel token generation, yet inference remains bottlenecked by deciding which masked tokens can be safely committed together. Fast-dLLM addressed this with KV caching and confidence-guided parallel decoding, but its decoding theory uses a homogeneous high-confidence assumption that effectively reduces each candidate set to its weakest selected token. We argue that this leaves speed on the table because real decoding steps exhibit heterogeneous confidence profiles. We propose \textbf{Fast-dLLM++}, a training-free extension that introduces \emph{Fr\'{e}chet profile decoding}: selecting parallel commit sets from the full sorted confidence profile rather than a single worst-case confidence. The resulting rule is a heterogeneous-confidence generalization of Fast-dLLM's factor selector and it recovers the previous rule exactly in the equal-confidence case and adds a provable \emph{heterogeneity bonus} when the selected tokens have uneven confidences. Fast-dLLM++ leaves the model, diffusion process, and cache implementation entirely unchanged, making it a drop-in replacement for existing Fast-dLLM decoding. Experiments on GSM8K, MATH, HumanEval, and MBPP with the LLaDA-8B model show that the theoretical improvement translates directly into empirical gains: profile-aware selection improves the accuracy--throughput frontier by exploiting safe parallelism that weakest-token rules miss, achieving up to 37\% higher throughput at comparable accuracy. Our code release is at https://github.com/Ringo-Star/FastdLLM_plusplus.

Siva Rajesh Kasa, Yasong Dai, Sumit Negi, Hongdong Li• 2026

Related benchmarks

TaskDatasetResultRank
Code GenerationHumanEval 0-shot
Accuracy41.5
100
Mathematical ReasoningGSM8k 5-shot
Accuracy77.2
82
Code GenerationMBPP 3-shot
Accuracy53.2
57
Mathematical ReasoningMATH 4-shot
NFE (4-shot)3.58e+5
24
Mathematical ReasoningGSM8K 5-shot v1.0 (test)
Accuracy72.7
6
Multimodal Mathematical ReasoningMathVista
Accuracy56.8
4
Multimodal Mathematical ReasoningMathVerse
Accuracy27.9
4
Showing 7 of 7 rows

Other info

Follow for update