arXiv Machine Learning

DeepJEB++: Foundation Model-Driven Large-Scale 3D Engineering Dataset via 2D Latent Space Augmentation

arXiv:2606. 12994v2 Announce Type: replace Abstract: Data-driven engineering design is constrained by the lack of large-scale 3D datasets that pair geometry with physics-based performance labels.

arXiv Computer Vision
Sep 4

PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models

PoseDreamer is a new pipeline that uses diffusion models to generate large‑scale synthetic datasets for 3D human mesh estimation, providing 3D mesh annotations that remain aligned with the generated images. The system incorporates controllable image generation, Direct Preference Optimization for control alignment, curriculum‑based hard sample mining, and multi‑stage quality filtering to produce over 500,000 high‑quality samples with a 76% improvement in image‑quality metrics over traditional rendering‑based datasets. Models trained on PoseDreamer match or surpass those trained on real‑world or conventional synthetic data, and combining PoseDreamer with synthetic datasets yields better performance than mixing real and synthetic data alone.

By Lorenza Prospero, Orest Kupyn, Ostap Viniavskyi, Jo\~ao F. Henriques, Christian Rupprecht
arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv AI
Aug 19

ChannelFlow-Tools: A Configuration-Driven Pipeline for Generating Machine-Learning-Ready Datasets of 3D Obstructed Channel Flows

ChannelFlow-Tools is an open‑source, configuration‑driven pipeline that generates machine‑learning‑ready datasets for three‑dimensional obstructed channel flows. It combines procedural obstacle geometry generation across six shape families, signed‑distance‑field voxelisation, lattice‑Boltzmann simulation, and packaging into ML‑ready tensors, all driven by reproducible configuration files. The pipeline is validated through mesh‑integrity audits, SDF representation checks, solver benchmarks, and data‑integrity audits, and it has been used to train surrogate models (3D U‑Net, FNO, U‑FNO) that learn geometry‑to‑flow mappings and exhibit physically interpretable behaviour on out‑of‑distribution splits.

By Shubham Kavane, Lukas Schr\"oder, Kajol Kulkarni, Fernando Gonzalez, Harald Koestler
arXiv AI
Sep 16

KaiNinja: Extending Native 3D Generators to the Part Level

KaiNinja extends the native 3D generator TRELLIS.2 to produce part-level meshes by introducing a dual‑volume representation that overcomes the single‑sheet limitation of the O‑Voxel grid. It maintains TRELLIS.2’s speed and quality while eliminating the need for external segmentation, and is trained on diverse data including CAD models and assets created by an LLM‑driven agent. The method improves whole‑object fidelity and outperforms other part‑generation pipelines, reducing Chamfer distance by 40% and increasing strict part F‑score by 16%.

By Ruihan Yu, Lian Fu, Muyao Niu, Zheng-hui Huang, Yu-Ju Tsai, Sho Kuno, Fengbo Lan, Yonghao Yu, Erwin Wu, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang