Crossref journal-article
Association for Computing Machinery (ACM)
ACM Transactions on Graphics (320)
Abstract

We present a framework and algorithms for robust geometry and motion reconstruction of complex deforming shapes. Our method makes use of a smooth template that provides a crude approximation of the scanned object and serves as a geometric and topological prior for reconstruction. Large-scale motion of the acquired object is recovered using a novel space-time adaptive, non-rigid registration method. Fine-scale details such as wrinkles and folds are synthesized with an efficient linear mesh deformation algorithm. Subsequent spatial and temporal filtering of detail coefficients allows transfer of persistent geometric detail to regions not observed by the scanner. We show how this two-scale process allows faithful recovery of small-scale shape and motion features leading to a high-quality reconstruction. We illustrate the robustness and generality of our algorithm on a variety of examples composed of different materials and exhibiting a large range of dynamic deformations.

Bibliography

Li, H., Adams, B., Guibas, L. J., & Pauly, M. (2009). Robust single-view geometry and motion reconstruction. ACM Transactions on Graphics, 28(5), 1–10.

Authors 4
  1. Hao Li (first)
  2. Bart Adams (additional)
  3. Leonidas J. Guibas (additional)
  4. Mark Pauly (additional)
References 35 Referenced 226
  1. Ahmed , N. , Theobalt , C. , Dobrev , P. , Seidel , H.-P. , and Thrun , S . 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008 ), 1--8. Ahmed, N., Theobalt, C., Dobrev, P., Seidel, H.-P., and Thrun, S. 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), 1--8. / IEEE Conference on Computer Vision and Pattern Recognition (CVPR by Ahmed N. (2008)
  2. 10.1145/882262.882311
  3. Amberg , B. , Romdhani , S. , and Vetter , T . 2007. Optimal step nonrigid icp algorithms for surface registration . In Proceedings of IEEE CVPR. Amberg, B., Romdhani, S., and Vetter, T. 2007. Optimal step nonrigid icp algorithms for surface registration. In Proceedings of IEEE CVPR. / Proceedings of IEEE CVPR. by Amberg B.
  4. Anguelov , D. , Srinivasan , P. , Pang , H.-C. , Koller , D. , Thrun , S. , and Davis , J . 2004. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Inf . Proc. Systems 17 . Anguelov, D., Srinivasan, P., Pang, H.-C., Koller, D., Thrun, S., and Davis, J. 2004. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Inf. Proc. Systems 17. / Proc. Systems 17 by Anguelov D.
  5. Aurich , V. , and Weule , J. 1995 . Non-linear gaussian filters performing edge preserving diffusion . In Mustererkennung 1995 , 17 . DAGM-Symposium, Springer-Verlag, 538--545. Aurich, V., and Weule, J. 1995. Non-linear gaussian filters performing edge preserving diffusion. In Mustererkennung 1995, 17. DAGM-Symposium, Springer-Verlag, 538--545. / Mustererkennung / Non-linear gaussian filters performing edge preserving diffusion by Aurich V. (1995)
  6. 10.1145/311535.311556
  7. 10.1109/TVCG.2007.1054
  8. 10.1145/1360612.1360698
  9. Bronstein A. M. Bronstein M. M. and Kimmel R. 2006. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proc. National Academy of Sciences (PNAS) 103. Bronstein A. M. Bronstein M. M. and Kimmel R. 2006. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proc. National Academy of Sciences (PNAS) 103 . (10.1073/pnas.0508601103)
  10. 10.5555/1018408.1018699
  11. 10.1145/1276377.1276404
  12. 10.5555/1731309.1731331
  13. Chang W. and Zwicker M. 2009. Range scan registration using reduced deformable models. Computer Graphics Forum (Proceedings of Eurographics 2009) to appear. Chang W. and Zwicker M. 2009. Range scan registration using reduced deformable models. Computer Graphics Forum (Proceedings of Eurographics 2009) to appear . (10.1111/j.1467-8659.2009.01384.x)
  14. 10.1145/1360612.1360697
  15. 10.1145/1276377.1276406
  16. Huang , Q. , Adams , B. , Wicke , M. , and Guibas , L. J. 2008 . Non-rigid registration under isometric deformations . Computer Graphics Forum (Proc. of SGP) 27 , 5, 1459 -- 1468 . Huang, Q., Adams, B., Wicke, M., and Guibas, L. J. 2008. Non-rigid registration under isometric deformations. Computer Graphics Forum (Proc. of SGP) 27, 5, 1459--1468. / Computer Graphics Forum (Proc. of SGP) / Non-rigid registration under isometric deformations by Huang Q. (2008)
  17. Ikemoto , L. , Gelfand , N. , and Levoy , M . 2003. A hierarchical method for aligning warped meshes . In Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441 . Ikemoto, L., Gelfand, N., and Levoy, M. 2003. A hierarchical method for aligning warped meshes. In Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441. / Proceedings of 4th Int. Conference on 3D Digital Imaging and Modeling, 434--441 by Ikemoto L.
  18. Kimmel R. and Sethian J. A. 1998. Computing geodesic paths on manifolds. In Proc. Natl. Acad. Sci. USA 8431--8435. Kimmel R. and Sethian J. A. 1998. Computing geodesic paths on manifolds. In Proc. Natl. Acad. Sci. USA 8431--8435. (10.1073/pnas.95.15.8431)
  19. 10.5555/1731309.1731326
  20. Mitra , N. J. , Flory , S. , Ovsjanikov , M. , Gelfand , N. , Guibas , L. , and Pottmann , H . 2007. Dynamic geometry registration . In Symposium on Geometry Processing, 173--182 . Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Symposium on Geometry Processing, 173--182. / Symposium on Geometry Processing, 173--182 by Mitra N. J.
  21. 10.1145/1141911.1141970
  22. 10.1145/1360612.1360695
  23. Pauly , M. , Mitra , N. J. , Giesen , J. , Gross , M. , and Guibas , L. J . 2005. Example-based 3d scan completion . In Symposium on Geometry Processing. Pauly, M., Mitra, N. J., Giesen, J., Gross, M., and Guibas, L. J. 2005. Example-based 3d scan completion. In Symposium on Geometry Processing. / Symposium on Geometry Processing. by Pauly M.
  24. 10.5555/1889712.1889738
  25. 10.1080/00401706.1959.10489860
  26. 10.1145/566654.566600
  27. 10.1145/1409060.1409063
  28. 10.1145/1276377.1276478
  29. Süssmuth , J. , Winter , M. , and Greiner , G . 2008. Reconstructing animated meshes from time-varying point clouds . Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1469--1476. Süssmuth, J., Winter, M., and Greiner, G. 2008. Reconstructing animated meshes from time-varying point clouds. Computer Graphics Forum (Proceedings of SGP 2008) 27, 5, 1469--1476. / Computer Graphics Forum (Proceedings of SGP 2008) by Süssmuth J.
  30. 10.1145/1360612.1360696
  31. Wand , M. , Jenke , P. , Huang , Q. , Bokeloh , M. , Guibas , L. , and Schilling , A . 2007. Reconstruction of deforming geometry from time-varying point clouds . In Symposium on Geometry processing, 49--58 . Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Symposium on Geometry processing, 49--58. / Symposium on Geometry processing, 49--58 by Wand M.
  32. 10.1145/1516522.1516526
  33. Weise , T. , Leibe , B. , and Gool , L. V . 2007. Fast 3d scanning with automatic motion compensation . In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. Weise, T., Leibe, B., and Gool, L. V. 2007. Fast 3d scanning with automatic motion compensation. In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. / IEEE Conference on Computer Vision and Pattern Recognition, 1--8. by Weise T.
  34. Zhang , L. , and Seitz , S. M . 2000. Image-based multiresolution shape recovery by surface deformation. SPIE, S. F. El-Hakim and A. Gruen , Eds. , vol. 4309 , 51--61. Zhang, L., and Seitz, S. M. 2000. Image-based multiresolution shape recovery by surface deformation. SPIE, S. F. El-Hakim and A. Gruen, Eds., vol. 4309, 51--61. / Eds. by Zhang L.
  35. 10.1145/1015706.1015759
Dates
Type When
Created 15 years, 8 months ago (Dec. 8, 2009, 3:53 p.m.)
Deposited 2 months, 1 week ago (June 18, 2025, 8:23 a.m.)
Indexed 1 month ago (July 22, 2025, 6:51 a.m.)
Issued 15 years, 8 months ago (Dec. 1, 2009)
Published 15 years, 8 months ago (Dec. 1, 2009)
Published Online 15 years, 8 months ago (Dec. 1, 2009)
Published Print 15 years, 8 months ago (Dec. 1, 2009)
Funders 3
  1. National Science Foundation 10.13039/100000001

    Region: Americas

    gov (National government)

    Labels4
    1. U.S. National Science Foundation
    2. NSF
    3. US NSF
    4. USA NSF
    Awards1
    1. ITR 0205671FRG 0354543FODAVA 808515
  2. National Institutes of Health 10.13039/100000002

    Region: Americas

    gov (National government)

    Labels3
    1. Institutos Nacionales de la Salud
    2. US National Institutes of Health
    3. NIH
    Awards1
    1. GM-072970
  3. Stavros Niarchos Foundation 10.13039/501100004343

    Region: Europe

    pri (Trusts, charities, foundations (both public and private))

    Labels1
    1. SNF
    Awards1
    1. 200021-112122

@article{Li_2009, title={Robust single-view geometry and motion reconstruction}, volume={28}, ISSN={1557-7368}, url={http://dx.doi.org/10.1145/1618452.1618521}, DOI={10.1145/1618452.1618521}, number={5}, journal={ACM Transactions on Graphics}, publisher={Association for Computing Machinery (ACM)}, author={Li, Hao and Adams, Bart and Guibas, Leonidas J. and Pauly, Mark}, year={2009}, month=dec, pages={1–10} }