Abstract
We present a framework and algorithms for robust geometry and motion reconstruction of complex deforming shapes. Our method makes use of a smooth template that provides a crude approximation of the scanned object and serves as a geometric and topological prior for reconstruction. Large-scale motion of the acquired object is recovered using a novel space-time adaptive, non-rigid registration method. Fine-scale details such as wrinkles and folds are synthesized with an efficient linear mesh deformation algorithm. Subsequent spatial and temporal filtering of detail coefficients allows transfer of persistent geometric detail to regions not observed by the scanner. We show how this two-scale process allows faithful recovery of small-scale shape and motion features leading to a high-quality reconstruction. We illustrate the robustness and generality of our algorithm on a variety of examples composed of different materials and exhibiting a large range of dynamic deformations.
References
35
Referenced
226
- Ahmed , N. , Theobalt , C. , Dobrev , P. , Seidel , H.-P. , and Thrun , S . 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008 ), 1--8. Ahmed, N., Theobalt, C., Dobrev, P., Seidel, H.-P., and Thrun, S. 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), 1--8. / IEEE Conference on Computer Vision and Pattern Recognition (CVPR by Ahmed N. (2008)
10.1145/882262.882311
- Amberg , B. , Romdhani , S. , and Vetter , T . 2007. Optimal step nonrigid icp algorithms for surface registration . In Proceedings of IEEE CVPR. Amberg, B., Romdhani, S., and Vetter, T. 2007. Optimal step nonrigid icp algorithms for surface registration. In Proceedings of IEEE CVPR. / Proceedings of IEEE CVPR. by Amberg B.
- Anguelov , D. , Srinivasan , P. , Pang , H.-C. , Koller , D. , Thrun , S. , and Davis , J . 2004. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Inf . Proc. Systems 17 . Anguelov, D., Srinivasan, P., Pang, H.-C., Koller, D., Thrun, S., and Davis, J. 2004. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Inf. Proc. Systems 17. / Proc. Systems 17 by Anguelov D.
- Aurich , V. , and Weule , J. 1995 . Non-linear gaussian filters performing edge preserving diffusion . In Mustererkennung 1995 , 17 . DAGM-Symposium, Springer-Verlag, 538--545. Aurich, V., and Weule, J. 1995. Non-linear gaussian filters performing edge preserving diffusion. In Mustererkennung 1995, 17. DAGM-Symposium, Springer-Verlag, 538--545. / Mustererkennung / Non-linear gaussian filters performing edge preserving diffusion by Aurich V. (1995)
10.1145/311535.311556
10.1109/TVCG.2007.1054
10.1145/1360612.1360698
-
Bronstein A. M. Bronstein M. M. and Kimmel R. 2006. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proc. National Academy of Sciences (PNAS) 103. Bronstein A. M. Bronstein M. M. and Kimmel R. 2006. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proc. National Academy of Sciences (PNAS) 103 .
(
10.1073/pnas.0508601103
) 10.5555/1018408.1018699
10.1145/1276377.1276404
10.5555/1731309.1731331
-
Chang W. and Zwicker M. 2009. Range scan registration using reduced deformable models. Computer Graphics Forum (Proceedings of Eurographics 2009) to appear. Chang W. and Zwicker M. 2009. Range scan registration using reduced deformable models. Computer Graphics Forum (Proceedings of Eurographics 2009) to appear .
(
10.1111/j.1467-8659.2009.01384.x
) 10.1145/1360612.1360697
10.1145/1276377.1276406
- Huang , Q. , Adams , B. , Wicke , M. , and Guibas , L. J. 2008 . Non-rigid registration under isometric deformations . Computer Graphics Forum (Proc. of SGP) 27 , 5, 1459 -- 1468 . Huang, Q., Adams, B., Wicke, M., and Guibas, L. J. 2008. Non-rigid registration under isometric deformations. Computer Graphics Forum (Proc. of SGP) 27, 5, 1459--1468. / Computer Graphics Forum (Proc. of SGP) / Non-rigid registration under isometric deformations by Huang Q. (2008)
- Ikemoto , L. , Gelfand , N. , and Levoy , M . 2003. A hierarchical method for aligning warped meshes . In Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441 . Ikemoto, L., Gelfand, N., and Levoy, M. 2003. A hierarchical method for aligning warped meshes. In Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441. / Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441 by Ikemoto L.
-
Kimmel R. and Sethian J. A. 1998. Computing geodesic paths on manifolds. In Proc. Natl. Acad. Sci. USA 8431--8435. Kimmel R. and Sethian J. A. 1998. Computing geodesic paths on manifolds. In Proc. Natl. Acad. Sci. USA 8431--8435.
(
10.1073/pnas.95.15.8431
) 10.5555/1731309.1731326
- Mitra , N. J. , Flory , S. , Ovsjanikov , M. , Gelfand , N. , Guibas , L. , and Pottmann , H . 2007. Dynamic geometry registration . In Symposium on Geometry Processing, 173--182 . Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Symposium on Geometry Processing, 173--182. / Symposium on Geometry Processing, 173--182 by Mitra N. J.
10.1145/1141911.1141970
10.1145/1360612.1360695
- Pauly , M. , Mitra , N. J. , Giesen , J. , Gross , M. , and Guibas , L. J . 2005. Example-based 3d scan completion . In Symposium on Geometry Processing. Pauly, M., Mitra, N. J., Giesen, J., Gross, M., and Guibas, L. J. 2005. Example-based 3d scan completion. In Symposium on Geometry Processing. / Symposium on Geometry Processing. by Pauly M.
10.5555/1889712.1889738
10.1080/00401706.1959.10489860
10.1145/566654.566600
10.1145/1409060.1409063
10.1145/1276377.1276478
- Süssmuth , J. , Winter , M. , and Greiner , G . 2008. Reconstructing animated meshes from time-varying point clouds . Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1469--1476. Süssmuth, J., Winter, M., and Greiner, G. 2008. Reconstructing animated meshes from time-varying point clouds. Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1469--1476. / Computer Graphics Forum (Proceedings of SGP 2008) by Süssmuth J.
10.1145/1360612.1360696
- Wand , M. , Jenke , P. , Huang , Q. , Bokeloh , M. , Guibas , L. , and Schilling , A . 2007. Reconstruction of deforming geometry from time-varying point clouds . In Symposium on Geometry processing, 49--58 . Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Symposium on Geometry processing, 49--58. / Symposium on Geometry processing, 49--58 by Wand M.
10.1145/1516522.1516526
- Weise , T. , Leibe , B. , and Gool , L. V . 2007. Fast 3d scanning with automatic motion compensation . In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. Weise, T., Leibe, B., and Gool, L. V. 2007. Fast 3d scanning with automatic motion compensation. In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. / IEEE Conference on Computer Vision and Pattern Recognition, 1--8. by Weise T.
- Zhang , L. , and Seitz , S. M . 2000. Image-based multiresolution shape recovery by surface deformation. SPIE, S. F. El-Hakim and A. Gruen , Eds. , vol. 4309 , 51--61. Zhang, L., and Seitz, S. M. 2000. Image-based multiresolution shape recovery by surface deformation. SPIE, S. F. El-Hakim and A. Gruen, Eds., vol. 4309, 51--61. / Eds. by Zhang L.
10.1145/1015706.1015759
Dates
Type | When |
---|---|
Created | 15 years, 8 months ago (Dec. 8, 2009, 3:53 p.m.) |
Deposited | 2 months, 1 week ago (June 18, 2025, 8:23 a.m.) |
Indexed | 1 month ago (July 22, 2025, 6:51 a.m.) |
Issued | 15 years, 8 months ago (Dec. 1, 2009) |
Published | 15 years, 8 months ago (Dec. 1, 2009) |
Published Online | 15 years, 8 months ago (Dec. 1, 2009) |
Published Print | 15 years, 8 months ago (Dec. 1, 2009) |
Funders
3
National Science Foundation
10.13039/100000001
Region: Americas
gov (National government)
Labels
4
- U.S. National Science Foundation
- NSF
- US NSF
- USA NSF
Awards
1
- ITR 0205671FRG 0354543FODAVA 808515
National Institutes of Health
10.13039/100000002
Region: Americas
gov (National government)
Labels
3
- Institutos Nacionales de la Salud
- US National Institutes of Health
- NIH
Awards
1
- GM-072970
Stavros Niarchos Foundation
10.13039/501100004343
Region: Europe
pri (Trusts, charities, foundations (both public and private))
Labels
1
- SNF
Awards
1
- 200021-112122
@article{Li_2009, title={Robust single-view geometry and motion reconstruction}, volume={28}, ISSN={1557-7368}, url={http://dx.doi.org/10.1145/1618452.1618521}, DOI={10.1145/1618452.1618521}, number={5}, journal={ACM Transactions on Graphics}, publisher={Association for Computing Machinery (ACM)}, author={Li, Hao and Adams, Bart and Guibas, Leonidas J. and Pauly, Mark}, year={2009}, month=dec, pages={1–10} }