PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 24, 2026IEEE Transactions on Visualization and Computer Graphics0 citations

DuetGS: Two-Stage Controllable 3D Human Reconstruction from Dual Images

View Full Paper
YCYanxin ChenBWBo WanYSYifei Shi

Key Points

  • The aim is to create realistic 3D human models from only two images by overcoming challenges related to spatial consistency and color information.
  • Developed a two-stage pipeline for geometry and color reconstruction
  • Utilized a data-driven neural network for full-body mesh recovery from front and back images
  • Applied Gaussian Splatting and an unsupervised color propagation method for color details
  • DuetGS significantly improves reconstruction accuracy compared to existing methods
  • Demonstrated enhanced visual quality of 3D models
  • Successfully validated on multiple datasets including THUman and PeopleSnapshot

Abstract

Creating realistic and fully detailed 3D human models using a minimal number of views has long been a challenging goal in 3D human reconstruction. Reconstructing a realistic human model from only two images (front and back) is particularly difficult due to the limited 3D information available, leading to two major challenges: (1) it is difficult to establish spatial consistency for reconstruction due to the lack of sufficient images for reliable matching, and (2) incomplete field of view results in missing color information. To address these challenges, we propose DuetGS, a novel pipeline that divides the reconstruction process into two stages: geometry reconstruction and color reconstruction. For geometry reconstruction, we employ a data-driven neural network to recover a full-body mesh from the front and back images, providing the spatial positioning for Gaussians. For color reconstruction, we adapt Gaussian Splatting and integrate our proposed unsupervised color propagation method to establish the color details of the Gaussians. Furthermore, our Gaussians are directly mapped to the mesh, allowing us to control their rotation and translation through mesh manipulation. This mapping ensures compatibility with various animation techniques. Extensive experiments on the THUman, CustomHumans, and PeopleSnapshot datasets demonstrate that our approach outperforms existing methods in terms of reconstruction accuracy and visual quality.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Chen et al. (2026) studied this question.

synapsesocial.com/papers/69eb08ef553a5433e34b3983https://doi.org/10.1109/tvcg.2026.3685443
Ask AI
Helpful
Bookmark
Share
View Full Paper