Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Large-scale optimal transport map estimation using projection pursuit

About

This paper studies the estimation of large-scale optimal transport maps (OTM), which is a well-known challenging problem owing to the curse of dimensionality. Existing literature approximates the large-scale OTM by a series of one-dimensional OTM problems through iterative random projection. Such methods, however, suffer from slow or none convergence in practice due to the nature of randomly selected projection directions. Instead, we propose an estimation method of large-scale OTM by combining the idea of projection pursuit regression and sufficient dimension reduction. The proposed method, named projection pursuit Monge map (PPMM), adaptively selects the most ``informative'' projection direction in each iteration. We theoretically show the proposed dimension reduction method can consistently estimate the most ``informative'' projection direction in each iteration. Furthermore, the PPMM algorithm weakly convergences to the target large-scale OTM in a reasonable number of steps. Empirically, PPMM is computationally easy and converges fast. We assess its finite sample performance through the applications of Wasserstein distance estimation and generative models.

Cheng Meng, Yuan Ke, Jingyi Zhang, Mengrui Zhang, Wenxuan Zhong, Ping Ma• 2021

Related benchmarks

TaskDatasetResultRank
Generative ModelingMNIST (test)--
35
Wasserstein Distance EstimationSynthetic d=10 1.0 (train)
Mean Convergence Time (s)0.6
6
Wasserstein Distance EstimationSynthetic (d=20) 1.0 (train)
Mean Convergence Time (s)2.1
6
Generative ModelingDoodle face (val)
FID0.59
5
Generative ModelingDoodle cat (val)
FID0.24
5
Generative ModelingDoodle bird (val)
FID0.36
5
Wasserstein Distance EstimationSynthetic (d=50) 1.0 (train)
Mean Convergence Time (s)5.5
4
Showing 7 of 7 rows

Other info

Follow for update