Scanning 3D Full Human Bodies Using Kinects
Top Cited Papers
- 9 March 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 18 (4), 643-650
- https://doi.org/10.1109/tvcg.2012.56
Abstract
Depth camera such as Microsoft Kinect, is much cheaper than conventional 3D scanning devices, and thus it can be acquired for everyday users easily. However, the depth data captured by Kinect over a certain distance is of extreme low quality. In this paper, we present a novel scanning system for capturing 3D full human body models by using multiple Kinects. To avoid the interference phenomena, we use two Kinects to capture the upper part and lower part of a human body respectively without overlapping region. A third Kinect is used to capture the middle part of the human body from the opposite direction. We propose a practical approach for registering the various body parts of different views under non-rigid deformation. First, a rough mesh template is constructed and used to deform successive frames pairwisely. Second, global alignment is performed to distribute errors in the deformation space, which can solve the loop closure problem efficiently. Misalignment caused by complex occlusion can also be handled reasonably by our global alignment algorithm. The experimental results have shown the efficiency and applicability of our system. Our system obtains impressive results in a few minutes with low price devices, thus is practically useful for generating personalized avatars for everyday users. Our system has been used for 3D human animation and virtual try on, and can further facilitate a range of home-oriented virtual reality (VR) applications.Keywords
This publication has 22 references indexed in Scilit:
- KinectFusion: Real-time dense surface mapping and trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Realtime performance-based facial animationPublished by Association for Computing Machinery (ACM) ,2011
- Automatic reconstruction of personalized avatars from 3D face scansComputer Animation and Virtual Worlds, 2011
- Robust single-view geometry and motion reconstructionPublished by Association for Computing Machinery (ACM) ,2009
- Modeling deformable objects from a single depth cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Multi-view image and ToF sensor fusion for dense 3D reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Embedded deformation for shape manipulationPublished by Association for Computing Machinery (ACM) ,2007
- Multiview registration of 3D scenes by minimizing error between coordinate framesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Globally Consistent Range Scan Alignment for Environment MappingAutonomous Robots, 1997
- Registration and integration of multiple range images for 3-D model constructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996