Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenization

About

Meshes are the de facto 3D representation in the industry but are labor-intensive to produce. Recently, a line of research has focused on autoregressively generating meshes. This approach processes meshes into a sequence composed of vertices and then generates them vertex by vertex, similar to how a language model generates text. These methods have achieved some success but still struggle to generate complex meshes. One primary reason for this limitation is their inefficient tokenization methods. To address this issue, we introduce MeshAnything V2, an advanced mesh generation model designed to create Artist-Created Meshes that align precisely with specified shapes. A key innovation behind MeshAnything V2 is our novel Adjacent Mesh Tokenization (AMT) method. Unlike traditional approaches that represent each face using three vertices, AMT optimizes this by employing a single vertex wherever feasible, effectively reducing the token sequence length by about half on average. This not only streamlines the tokenization process but also results in more compact and well-structured sequences, enhancing the efficiency of mesh generation. With these improvements, MeshAnything V2 effectively doubles the face limit compared to previous models, delivering superior performance without increasing computational costs. We will make our code and models publicly available. Project Page: https://buaacyw.github.io/meshanything-v2/

Yiwen Chen, Yikai Wang, Yihao Luo, Zhengyi Wang, Zilong Chen, Jun Zhu, Chi Zhang, Guosheng Lin• 2024

Related benchmarks

TaskDatasetResultRank
3D Mesh GenerationObjaverse
Chamfer Distance0.016
18
Mesh ReconstructionToys4k
Chamfer Distance0.09
16
Mesh Tokenization3D Mesh Representation
Compression Ratio0.46
12
3D Object GenerationShapeNet
Chamfer Distance (CD)0.009
10
3D Mesh ReconstructionArtistic meshes
Chamfer Distance (L2)0.066
10
Mesh GenerationHunyuan3D Dense Meshes 2.5
Chamfer Distance (CD)0.148
7
Mesh GenerationToys4k (Artist Meshes)
Chamfer Distance (CD)0.084
7
Mesh ReconstructionHunyuan3D Dense Meshes 2.5 (test)
CD0.148
7
Mesh ReconstructionToys4k Artist Meshes (test)
Chamfer Distance (CD)0.084
7
Mesh TokenizationMesh Sequences
Compression Ratio0.46
7
Showing 10 of 23 rows

Other info

Follow for update