NeurIPS 2026

Seeing Both the Forest and the Trees:Reusing Holistic 3D Priors for Part-Decomposed Generation

Yiqun Zhao1,2Binbin Huang1,2Haobin Duan1,2Zibo Zhao3Shenghua Gao1,2,4,*
1 The University of Hong Kong2 Transengram3 Tencent4 Shenzhen Loop Area Institute

* Corresponding author: Shenghua Gao. This work was partially done during YZ, BH, and HD's internships at Transengram.

Paper arXivCode GitHub

One holistic prior. A world of detailed, individually editable parts.

THE WHOLE SHAPE. EVERY PART.

Detail within parts.
Coherence across the whole.

Generating 3D assets with explicit parts requires both geometric detail inside each part and structural coherence across the whole object. StructParts inherits these properties from a pretrained holistic 3D model through dual-frame coordinate interleaving.

Each shape latent is interpreted in both a part-local and an object-global reference frame. Guided by a segmented mesh scaffold, a global-local interleaved transformer reuses the prior at both scales. Lightweight finetuning enables part-decomposed generation, part-mesh refinement, and part-level editing.

01 / METHOD

From a holistic prior to explicit parts

StructParts pipeline: image to segmented mesh scaffold, part-local and object-global voxel coordinates, and interleaved diffusion for detailed part meshes
A segmented mesh scaffold anchors the shape tokens. Part-local and object-global coordinate frames guide the same pretrained diffusion model at complementary scales. Dataset-provided ground-truth meshes and segmentations illustrate the part-wise data flow in this diagram.
02 / GENERATION

One image, many coherent parts

Image-conditioned generation examples with input images and the resulting part-decomposed 3D objects
Image-conditioned part generation and detail comparisons from the paper. Colors distinguish generated parts.
Qualitative comparisons of part-decomposed generation against baseline methods
Qualitative part-decomposed generation comparisons from the paper.
03 / APPLICATIONS

Parts you can refine and edit

Part-mesh refinement

Part-mesh refinement results, showing geometry detail restored from a coarse scaffold
Refine individual part geometry while retaining the scaffold's overall structure.

Part-level editing

Part-level editing examples including modifications of segmented 3D objects
Explicit parts provide an interface for local editing.
CITATION
@inproceedings{zhao2026structparts,
  title = {Seeing Both the Forest and the Trees:
           Reusing Holistic 3D Priors for Part-Decomposed Generation},
  author = {Zhao, Yiqun and Huang, Binbin and Duan, Haobin
            and Zhao, Zibo and Gao, Shenghua},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2026},
  url = {https://zhao-yiqun.github.io/structparts/}
}

Publication details will be updated when the paper is available.