DOI: 10.1145/1360612.1360698. Markerless garment capture

10.1145/1360612.1360698

Crossref journal-article

Association for Computing Machinery (ACM)

ACM Transactions on Graphics (320)

Abstract

A lot of research has recently focused on the problem of capturing the geometry and motion of garments. Such work usually relies on special markers printed on the fabric to establish temporally coherent correspondences between points on the garment's surface at different times. Unfortunately, this approach is tedious and prevents the capture of off-the-shelf clothing made from interesting fabrics. In this paper, we describe a marker-free approach to capturing garment motion that avoids these downsides. We establish temporally coherent parameterizations between incomplete geometries that we extract at each timestep with a multiview stereo algorithm. We then fill holes in the geometry using a template. This approach, for the first time, allows us to capture the geometry and motion of unpatterned, off-the-shelf garments made from a range of different fabrics.

Bibliography

Bradley, D., Popa, T., Sheffer, A., Heidrich, W., & Boubekeur, T. (2008). Markerless garment capture. ACM Transactions on Graphics, 27(3), 1â9.

Authors 5

Derek Bradley (first)
Tiberiu Popa (additional)
Alla Sheffer (additional)
Wolfgang Heidrich (additional)
Tamy Boubekeur (additional)

References 33 Referenced 120

10.1145/882262.882311
10.1145/1073204.1073207
Bhat , K. , Twigg , C. , Hodgins , J. , Khosla , P. , Popovic , Z. , and Seitz ., S. 2003 . Estimating cloth simulation parameters from video . In Proc. SCA, 37--51 . Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popovic, Z., and Seitz., S. 2003. Estimating cloth simulation parameters from video. In Proc. SCA, 37--51. / Proc. SCA, 37--51 by Bhat K. (2003)
10.1145/1276377.1276419
10.1109/SMI.2005.49
Bradley , D. , Boubekeur , T. , and Heidrich , W . 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing . In Proc. CVPR. Bradley, D., Boubekeur, T., and Heidrich, W. 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In Proc. CVPR. / Proc. CVPR. by Bradley D.
10.1007/s11263-005-6879-4
de Aguiar , E. , Theobalt , C. , Stoll , C. , and Seidel , H . -P . 2007 . Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR , 1--8. de Aguiar, E., Theobalt, C., Stoll, C., and Seidel, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR, 1--8. / -P by de Aguiar E. (2007)
Fiala , M. , and Shu , C . 2005 . Fully automatic camera calibration using self-identifying calibration targets. Tech. Rep. NRC-48306 ERB-1130 , National Research Council of Canada . Fiala, M., and Shu, C. 2005. Fully automatic camera calibration using self-identifying calibration targets. Tech. Rep. NRC-48306 ERB-1130, National Research Council of Canada. / Tech. Rep. NRC-48306 ERB-1130 by Fiala M. (2005)
10.1145/358669.358692
10.1016/S0167-8396(02)00002-5
10.1145/1276377.1276438
Guskov , I. , Klibanov , S. , and Bryant , B . 2003. Trackable surfaces . In Proc. SCA, 251--257 . Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In Proc. SCA, 251--257. / Proc. SCA, 251--257 by Guskov I.
Hasler , N. , Asbach , M. , Rosenhahn , B. , Ohm , J.-R. , and Seidel , H . -P. 2006. Physically based tracking of cloth . In Proc. Workshop on Vision, Modeling, and Visualization, 49--56 . Hasler, N., Asbach, M., Rosenhahn, B., Ohm, J.-R., and Seidel, H.-P. 2006. Physically based tracking of cloth. In Proc. Workshop on Vision, Modeling, and Visualization, 49--56. / Proc. Workshop on Vision, Modeling, and Visualization, 49--56 by Hasler N.
Hernandez , C. , Vogiatzis , G. , Brostow , G. J. , Stenger , B. , and Cipolla , R . 2007. Non-rigid photometric stereo with colored lights . In Proc. ICCV. Hernandez, C., Vogiatzis, G., Brostow, G. J., Stenger, B., and Cipolla, R. 2007. Non-rigid photometric stereo with colored lights. In Proc. ICCV. / Proc. ICCV. by Hernandez C.
10.1145/1015706.1015811
Kraevoy , V. , and Sheffer , A . 2005. Template-based mesh completion . In Proc. SGP, 13 . Kraevoy, V., and Sheffer, A. 2005. Template-based mesh completion. In Proc. SGP, 13. / Proc. SGP, 13 by Kraevoy V.
Mitra , N. , Flöry , S. , Ovsjanikov , M. , Gelfand , N. , Guibas , L. , and Pottmann , H . 2007. Dynamic geometry registration . In Proc. SGP, 173--182 . Mitra, N., Flöry, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Proc. SGP, 173--182. / Proc. SGP, 173--182 by Mitra N.
10.1145/1276377.1276433
MVIEW. http://vision.middlebury.edu/mview/. MVIEW. http://vision.middlebury.edu/mview/.
10.1145/383259.383277
10.1145/965400.965580
10.1007/s00138-006-0046-y
Scholz , V. , and Magnor , M. A. 2004 . Cloth motion from optical flow . In Proc. Vision, Modeling and Visualization 2004 , 117 -- 124 . Scholz, V., and Magnor, M. A. 2004. Cloth motion from optical flow. In Proc. Vision, Modeling and Visualization 2004, 117--124. / Proc. Vision, Modeling and Visualization / Cloth motion from optical flow by Scholz V. (2004)
10.1145/1187112.1187157
10.1145/1015706.1015812
10.1109/CVPR.2006.19
10.1109/3DPVT.2004.99
Shewchuk , J. 1996 . Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering , M. C. Lin and D. Manocha, Eds., vol. 1148 of Lecture Notes in Computer Science . Springer-Verlag , 203--222. Shewchuk, J. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. Lin and D. Manocha, Eds., vol. 1148 of Lecture Notes in Computer Science. Springer-Verlag, 203--222. / Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering / Lecture Notes in Computer Science by Shewchuk J. (1996)
Tomasi , C. , and Manduchi , R . 1998. Bilateral filtering for gray and color images . In Proc. ICCV, 839 . Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. ICCV, 839. / Proc. ICCV, 839 by Tomasi C.
Wand , M. , Jenke , P. , Huang , Q. , Bokeloh , M. , Guibas , L. , and Schilling , A . 2007. Reconstruction of deforming geometry from time-varying point clouds . In Proc. SGP, 49--58 . Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. SGP, 49--58. / Proc. SGP, 49--58 by Wand M.
10.1145/1276377.1276420
10.1145/1015706.1015759

Dates

Type	When
Created	17 years, 1 month ago (Aug. 5, 2008, 9:35 a.m.)
Deposited	2 months, 2 weeks ago (June 18, 2025, 9:58 a.m.)
Indexed	4 weeks, 1 day ago (Aug. 7, 2025, 4:58 p.m.)
Issued	17 years, 1 month ago (Aug. 1, 2008)
Published	17 years, 1 month ago (Aug. 1, 2008)
Published Online	17 years, 1 month ago (Aug. 1, 2008)
Published Print	17 years, 1 month ago (Aug. 1, 2008)

Funders 0

None

BibTeX

@article{Bradley_2008, title={Markerless garment capture}, volume={27}, ISSN={1557-7368}, url={http://dx.doi.org/10.1145/1360612.1360698}, DOI={10.1145/1360612.1360698}, number={3}, journal={ACM Transactions on Graphics}, publisher={Association for Computing Machinery (ACM)}, author={Bradley, Derek and Popa, Tiberiu and Sheffer, Alla and Heidrich, Wolfgang and Boubekeur, Tamy}, year={2008}, month=aug, pages={1–9} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2025,
        8,
        7
      ]
    ],
    "date-time": "2025-08-07T20:58:54Z",
    "timestamp": 1754600334147,
    "version": "3.41.0"
  },
  "reference-count": 33,
  "publisher": "Association for Computing Machinery (ACM)",
  "issue": "3",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            2008,
            8,
            1
          ]
        ],
        "date-time": "2008-08-01T00:00:00Z",
        "timestamp": 1217548800000
      },
      "content-version": "vor",
      "delay-in-days": 0,
      "URL": "https://www.acm.org/publications/policies/copyright_policy#Background"
    }
  ],
  "content-domain": {
    "domain": [
      "dl.acm.org"
    ],
    "crossmark-restriction": true
  },
  "published-print": {
    "date-parts": [
      [
        2008,
        8
      ]
    ]
  },
  "abstract": "<jats:p>A lot of research has recently focused on the problem of capturing the geometry and motion of garments. Such work usually relies on special markers printed on the fabric to establish temporally coherent correspondences between points on the garment's surface at different times. Unfortunately, this approach is tedious and prevents the capture of off-the-shelf clothing made from interesting fabrics.</jats:p>\n          <jats:p>In this paper, we describe a marker-free approach to capturing garment motion that avoids these downsides. We establish temporally coherent parameterizations between incomplete geometries that we extract at each timestep with a multiview stereo algorithm. We then fill holes in the geometry using a template. This approach, for the first time, allows us to capture the geometry and motion of unpatterned, off-the-shelf garments made from a range of different fabrics.</jats:p>",
  "DOI": "10.1145/1360612.1360698",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2008,
        8,
        5
      ]
    ],
    "date-time": "2008-08-05T13:35:10Z",
    "timestamp": 1217943310000
  },
  "page": "1-9",
  "update-policy": "https://doi.org/10.1145/crossmark-policy",
  "source": "Crossref",
  "is-referenced-by-count": 120,
  "title": "Markerless garment capture",
  "prefix": "10.1145",
  "volume": "27",
  "author": [
    {
      "given": "Derek",
      "family": "Bradley",
      "sequence": "first",
      "affiliation": [
        {
          "name": "University of British Columbia"
        }
      ]
    },
    {
      "given": "Tiberiu",
      "family": "Popa",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "University of British Columbia"
        }
      ]
    },
    {
      "given": "Alla",
      "family": "Sheffer",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "University of British Columbia"
        }
      ]
    },
    {
      "given": "Wolfgang",
      "family": "Heidrich",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "University of British Columbia"
        }
      ]
    },
    {
      "given": "Tamy",
      "family": "Boubekeur",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "TU Berlin"
        }
      ]
    }
  ],
  "member": "320",
  "published-online": {
    "date-parts": [
      [
        2008,
        8
      ]
    ]
  },
  "reference": [
    {
      "key": "e_1_2_2_1_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/882262.882311"
    },
    {
      "key": "e_1_2_2_2_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1073204.1073207"
    },
    {
      "key": "e_1_2_2_3_1",
      "volume-title": "Proc. SCA, 37--51",
      "author": "Bhat K.",
      "year": "2003",
      "unstructured": "Bhat , K. , Twigg , C. , Hodgins , J. , Khosla , P. , Popovic , Z. , and Seitz ., S. 2003 . Estimating cloth simulation parameters from video . In Proc. SCA, 37--51 . Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popovic, Z., and Seitz., S. 2003. Estimating cloth simulation parameters from video. In Proc. SCA, 37--51."
    },
    {
      "key": "e_1_2_2_4_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1276377.1276419"
    },
    {
      "key": "e_1_2_2_5_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/SMI.2005.49"
    },
    {
      "volume-title": "Proc. CVPR.",
      "author": "Bradley D.",
      "key": "e_1_2_2_6_1",
      "unstructured": "Bradley , D. , Boubekeur , T. , and Heidrich , W . 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing . In Proc. CVPR. Bradley, D., Boubekeur, T., and Heidrich, W. 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In Proc. CVPR."
    },
    {
      "key": "e_1_2_2_7_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/s11263-005-6879-4"
    },
    {
      "key": "e_1_2_2_8_1",
      "volume-title": "-P",
      "author": "de Aguiar E.",
      "year": "2007",
      "unstructured": "de Aguiar , E. , Theobalt , C. , Stoll , C. , and Seidel , H . -P . 2007 . Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR , 1--8. de Aguiar, E., Theobalt, C., Stoll, C., and Seidel, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR, 1--8."
    },
    {
      "key": "e_1_2_2_9_1",
      "volume-title": "Tech. Rep. NRC-48306 ERB-1130",
      "author": "Fiala M.",
      "year": "2005",
      "unstructured": "Fiala , M. , and Shu , C . 2005 . Fully automatic camera calibration using self-identifying calibration targets. Tech. Rep. NRC-48306 ERB-1130 , National Research Council of Canada . Fiala, M., and Shu, C. 2005. Fully automatic camera calibration using self-identifying calibration targets. Tech. Rep. NRC-48306 ERB-1130, National Research Council of Canada."
    },
    {
      "key": "e_1_2_2_10_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/358669.358692"
    },
    {
      "key": "e_1_2_2_11_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/S0167-8396(02)00002-5"
    },
    {
      "key": "e_1_2_2_12_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1276377.1276438"
    },
    {
      "volume-title": "Proc. SCA, 251--257",
      "author": "Guskov I.",
      "key": "e_1_2_2_13_1",
      "unstructured": "Guskov , I. , Klibanov , S. , and Bryant , B . 2003. Trackable surfaces . In Proc. SCA, 251--257 . Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In Proc. SCA, 251--257."
    },
    {
      "volume-title": "Proc. Workshop on Vision, Modeling, and Visualization, 49--56",
      "author": "Hasler N.",
      "key": "e_1_2_2_14_1",
      "unstructured": "Hasler , N. , Asbach , M. , Rosenhahn , B. , Ohm , J.-R. , and Seidel , H . -P. 2006. Physically based tracking of cloth . In Proc. Workshop on Vision, Modeling, and Visualization, 49--56 . Hasler, N., Asbach, M., Rosenhahn, B., Ohm, J.-R., and Seidel, H.-P. 2006. Physically based tracking of cloth. In Proc. Workshop on Vision, Modeling, and Visualization, 49--56."
    },
    {
      "volume-title": "Proc. ICCV.",
      "author": "Hernandez C.",
      "key": "e_1_2_2_15_1",
      "unstructured": "Hernandez , C. , Vogiatzis , G. , Brostow , G. J. , Stenger , B. , and Cipolla , R . 2007. Non-rigid photometric stereo with colored lights . In Proc. ICCV. Hernandez, C., Vogiatzis, G., Brostow, G. J., Stenger, B., and Cipolla, R. 2007. Non-rigid photometric stereo with colored lights. In Proc. ICCV."
    },
    {
      "key": "e_1_2_2_16_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1015706.1015811"
    },
    {
      "volume-title": "Proc. SGP, 13",
      "author": "Kraevoy V.",
      "key": "e_1_2_2_17_1",
      "unstructured": "Kraevoy , V. , and Sheffer , A . 2005. Template-based mesh completion . In Proc. SGP, 13 . Kraevoy, V., and Sheffer, A. 2005. Template-based mesh completion. In Proc. SGP, 13."
    },
    {
      "volume-title": "Proc. SGP, 173--182",
      "author": "Mitra N.",
      "key": "e_1_2_2_18_1",
      "unstructured": "Mitra , N. , Fl\u00f6ry , S. , Ovsjanikov , M. , Gelfand , N. , Guibas , L. , and Pottmann , H . 2007. Dynamic geometry registration . In Proc. SGP, 173--182 . Mitra, N., Fl\u00f6ry, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Proc. SGP, 173--182."
    },
    {
      "key": "e_1_2_2_19_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1276377.1276433"
    },
    {
      "key": "e_1_2_2_20_1",
      "unstructured": "MVIEW. http://vision.middlebury.edu/mview/.  MVIEW. http://vision.middlebury.edu/mview/."
    },
    {
      "key": "e_1_2_2_21_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/383259.383277"
    },
    {
      "key": "e_1_2_2_22_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/965400.965580"
    },
    {
      "key": "e_1_2_2_23_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/s00138-006-0046-y"
    },
    {
      "key": "e_1_2_2_24_1",
      "first-page": "117",
      "article-title": "Cloth motion from optical flow",
      "volume": "2004",
      "author": "Scholz V.",
      "year": "2004",
      "unstructured": "Scholz , V. , and Magnor , M. A. 2004 . Cloth motion from optical flow . In Proc. Vision, Modeling and Visualization 2004 , 117 -- 124 . Scholz, V., and Magnor, M. A. 2004. Cloth motion from optical flow. In Proc. Vision, Modeling and Visualization 2004, 117--124.",
      "journal-title": "Proc. Vision, Modeling and Visualization"
    },
    {
      "key": "e_1_2_2_25_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1187112.1187157"
    },
    {
      "key": "e_1_2_2_26_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1015706.1015812"
    },
    {
      "key": "e_1_2_2_27_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/CVPR.2006.19"
    },
    {
      "key": "e_1_2_2_28_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/3DPVT.2004.99"
    },
    {
      "key": "e_1_2_2_29_1",
      "series-title": "Lecture Notes in Computer Science",
      "volume-title": "Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering",
      "author": "Shewchuk J.",
      "year": "1996",
      "unstructured": "Shewchuk , J. 1996 . Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering , M. C. Lin and D. Manocha, Eds., vol. 1148 of Lecture Notes in Computer Science . Springer-Verlag , 203--222. Shewchuk, J. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. Lin and D. Manocha, Eds., vol. 1148 of Lecture Notes in Computer Science. Springer-Verlag, 203--222."
    },
    {
      "volume-title": "Proc. ICCV, 839",
      "author": "Tomasi C.",
      "key": "e_1_2_2_30_1",
      "unstructured": "Tomasi , C. , and Manduchi , R . 1998. Bilateral filtering for gray and color images . In Proc. ICCV, 839 . Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. ICCV, 839."
    },
    {
      "volume-title": "Proc. SGP, 49--58",
      "author": "Wand M.",
      "key": "e_1_2_2_31_1",
      "unstructured": "Wand , M. , Jenke , P. , Huang , Q. , Bokeloh , M. , Guibas , L. , and Schilling , A . 2007. Reconstruction of deforming geometry from time-varying point clouds . In Proc. SGP, 49--58 . Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. SGP, 49--58."
    },
    {
      "key": "e_1_2_2_32_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1276377.1276420"
    },
    {
      "key": "e_1_2_2_33_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1015706.1015759"
    }
  ],
  "container-title": "ACM Transactions on Graphics",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://dl.acm.org/doi/10.1145/1360612.1360698",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://dl.acm.org/doi/pdf/10.1145/1360612.1360698",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "similarity-checking"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2025,
        6,
        18
      ]
    ],
    "date-time": "2025-06-18T13:58:02Z",
    "timestamp": 1750255082000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://dl.acm.org/doi/10.1145/1360612.1360698"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        2008,
        8
      ]
    ]
  },
  "references-count": 33,
  "journal-issue": {
    "issue": "3",
    "published-print": {
      "date-parts": [
        [
          2008,
          8
        ]
      ]
    }
  },
  "alternative-id": [
    "10.1145/1360612.1360698"
  ],
  "URL": "http://dx.doi.org/10.1145/1360612.1360698",
  "relation": {},
  "ISSN": [
    "0730-0301",
    "1557-7368"
  ],
  "subject": [],
  "container-title-short": "ACM Trans. Graph.",
  "published": {
    "date-parts": [
      [
        2008,
        8
      ]
    ]
  },
  "assertion": [
    {
      "value": "2008-08-01",
      "order": 2,
      "name": "published",
      "label": "Published",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    }
  ]
}