Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Objaverse-XL: A Universe of 10M+ 3D Objects

About

Natural language processing and 2D vision models have attained remarkable proficiency on many tasks primarily by escalating the scale of training data. However, 3D vision tasks have not seen the same progress, in part due to the challenges of acquiring high-quality 3D data. In this work, we present Objaverse-XL, a dataset of over 10 million 3D objects. Our dataset comprises deduplicated 3D objects from a diverse set of sources, including manually designed objects, photogrammetry scans of landmarks and everyday items, and professional scans of historic and antique artifacts. Representing the largest scale and diversity in the realm of 3D datasets, Objaverse-XL enables significant new possibilities for 3D vision. Our experiments demonstrate the improvements enabled with the scale provided by Objaverse-XL. We show that by training Zero123 on novel view synthesis, utilizing over 100 million multi-view rendered images, we achieve strong zero-shot generalization abilities. We hope that releasing Objaverse-XL will enable further innovations in the field of 3D vision at scale.

Matt Deitke, Ruoshi Liu, Matthew Wallingford, Huong Ngo, Oscar Michel, Aditya Kusupati, Alan Fan, Christian Laforte, Vikram Voleti, Samir Yitzhak Gadre, Eli VanderBilt, Aniruddha Kembhavi, Carl Vondrick, Georgia Gkioxari, Kiana Ehsani, Ludwig Schmidt, Ali Farhadi• 2023

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisGoogle Scanned Objects
PSNR18.93
15
Multi-view GenerationGSO
PSNR19.6839
9
Multi-view Generation3D-FUTURE
PSNR18.4702
9
Novel View SynthesisGSO static orbit
PSNR19.058
7
Novel View SynthesisObjaverse static orbit
PSNR19.881
7
Novel View SynthesisOmniObject3D static orbit
PSNR16.163
7
Image-to-3DGSO 13 (entire set)
F-Score91.6
6
Novel View SynthesisLIDC-IDRI-DRR Simple views (test)
SSIM0.5092
6
Novel View SynthesisLIDC-IDRI-DRR Hemisphere views (test)
SSIM0.2146
6
Multi-view GenerationGSO 1.0 (complete)
PSNR20.11
5
Showing 10 of 14 rows

Other info

Follow for update