arXiv Computer Vision

MeshFlow: Mesh Generation with Equivariant Flow Matching

arXiv Computer Vision
Oct 8

MeshCarve: Artisan Mesh Generation with Flow Matching in Compact Latent Spaces

MeshCarve introduces a flow‑matching approach that generates artisan meshes entirely within compact latent spaces, separating vertex positions and edge connections to avoid joint encoding issues. It employs a hierarchical sparse transformer backbone with VertexVAE and EdgeVAE, which anchor on discrete vertices to drastically shorten token sequences and use spatial‑aware compression without sacrificing reconstruction quality. The method outperforms state‑of‑the‑art autoregressive and flow‑matching techniques on Objaverse and generalizes to Toys4K, representing one of the first fully compressed latent artisan mesh generators.

By Xiyu Wang, Ruocheng Wu, Yufei Wang, Zhihao Li, Lanqing Guo, Bihan Wen
arXiv Computer Vision
Sep 2

TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fields

TriFlow introduces a generative method for creating compact 3D meshes with artist‑like triangle topology directly from input geometry such as signed distance fields. It represents mesh topology as a nearest‑vertex vector field (NVF) over the surface, trains a latent flow‑matching model to synthesize this field, and then clusters surface regions to guide a constrained quadric error metric simplification. The resulting meshes closely match the input geometry while exhibiting structured, artist‑like connectivity, achieving 90% lower Chamfer Distance and an 8× speedup over state‑of‑the‑art learning‑based approaches.

By Haoxuan Li, Ziya Erko\c{c}, Daniele Sirigatti, Vladislav Rosov, Lei Li, Angela Dai, Matthias Nie{\ss}ner
arXiv Computer Vision
Sep 4

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers

The paper introduces a novel compression framework for image-to-shape Diffusion Transformers (DiTs) that significantly reduces model size while preserving geometric fidelity. By exploiting the non-uniform importance of 3D DiT layers, the authors combine structured pruning, adaptive quantization, and targeted fine‑tuning into a vitality‑guided approach. The method achieves up to a 66% reduction in model size across state‑of‑the‑art image‑to‑3D models without compromising synthesis quality, offering a plug‑and‑play solution for efficient 3D shape generation.

By Jaeah Lee, Hyunjin Kim, Jaewoong Cho, Gihyun Kwon
arXiv Computer Vision
Sep 4

PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models

PoseDreamer is a new pipeline that uses diffusion models to generate large‑scale synthetic datasets for 3D human mesh estimation, providing 3D mesh annotations that remain aligned with the generated images. The system incorporates controllable image generation, Direct Preference Optimization for control alignment, curriculum‑based hard sample mining, and multi‑stage quality filtering to produce over 500,000 high‑quality samples with a 76% improvement in image‑quality metrics over traditional rendering‑based datasets. Models trained on PoseDreamer match or surpass those trained on real‑world or conventional synthetic data, and combining PoseDreamer with synthetic datasets yields better performance than mixing real and synthetic data alone.

By Lorenza Prospero, Orest Kupyn, Ostap Viniavskyi, Jo\~ao F. Henriques, Christian Rupprecht