DOI: 10.1145/1073204.1073234. Video object cut and paste

10.1145/1073204.1073234

Crossref journal-article

Association for Computing Machinery (ACM)

ACM Transactions on Graphics (320)

Abstract

In this paper, we present a system for cutting a moving object out from a video clip. The cutout object sequence can be pasted onto another video or a background image. To achieve this, we first apply a new 3D graph cut based segmentation approach on the spatial-temporal video volume. Our algorithm partitions watershed presegmentation regions into foreground and background while preserving temporal coherence. Then, the initial segmentation result is refined locally. Given two frames in the video sequence, we specify two respective windows of interest which are then tracked using a bi-directional feature tracking algorithm. For each frame in between these two given frames, the segmentation in each tracked window is refined using a 2D graph cut that utilizes a local color model. Moreover, we provide brush tools for the user to control the object boundary precisely wherever needed. Based on the accurate binary segmentation result, we apply coherent matting to extract the alpha mattes and foreground colors of the object.

Bibliography

Li, Y., Sun, J., & Shum, H.-Y. (2005). Video object cut and paste. ACM Transactions on Graphics, 24(3), 595â600.

Authors 3

Yin Li (first)
Jian Sun (additional)
Heung-Yeung Shum (additional)

References 19 Referenced 166

10.1145/1186562.1015764
{'volume-title': 'Proceedings of CVPR', 'year': '2004', 'author': 'Apostoloff N. E.', 'key': 'e_1_2_2_2_1'} / Proceedings of CVPR by Apostoloff N. E. (2004)
Bellman R. E. 1957. Dynamic Programming. Princeton University Press. Princeton. NJ. Bellman R. E. 1957. Dynamic Programming. Princeton University Press. Princeton. NJ.
10.1006/cviu.1996.0006
Blake A. and Isard. M. 1998. Active contours. In Springer Verlag London. Blake A. and Isard. M. 1998. Active contours. In Springer Verlag London. (10.1007/978-1-4471-1555-7)
{'key': 'e_1_2_2_6_1', 'first-page': '428', 'article-title': 'Interactive image segmentation using an adaptive gmmrf model', 'author': 'Blake A.', 'year': '2004', 'journal-title': 'Proceedings of ECCV.'} / Proceedings of ECCV. / Interactive image segmentation using an adaptive gmmrf model by Blake A. (2004)
{'volume-title': 'Proceedings of ICCV', 'year': '2001', 'author': 'Boykov Y.', 'key': 'e_1_2_2_7_1'} / Proceedings of ICCV by Boykov Y. (2001)
{'volume-title': 'Proceedings of CVPR', 'year': '2001', 'author': 'Chuang Y.-Y.', 'key': 'e_1_2_2_8_1'} / Proceedings of CVPR by Chuang Y.-Y. (2001)
10.1145/566570.566572
10.1145/1186415.1186483
10.1007/BF00133570
10.1145/1201775.882264
10.1145/1186562.1015719
10.1145/218380.218450
{'volume-title': 'Proceedings of CVPR', 'year': '1999', 'author': 'Mortensen E. N.', 'key': 'e_1_2_2_15_1'} / Proceedings of CVPR by Mortensen E. N. (1999)
10.1145/1186562.1015720
10.1145/990002.990005
10.1145/237170.237263
10.1109/34.87344

Dates

Type	When
Created	19 years, 9 months ago (Nov. 7, 2005, 11 a.m.)
Deposited	2 months, 2 weeks ago (June 18, 2025, 12:07 p.m.)
Indexed	2 months, 2 weeks ago (June 19, 2025, 12:41 a.m.)
Issued	20 years, 2 months ago (July 1, 2005)
Published	20 years, 2 months ago (July 1, 2005)
Published Online	20 years, 2 months ago (July 1, 2005)
Published Print	20 years, 2 months ago (July 1, 2005)

Funders 0

None

BibTeX

@article{Li_2005, title={Video object cut and paste}, volume={24}, ISSN={1557-7368}, url={http://dx.doi.org/10.1145/1073204.1073234}, DOI={10.1145/1073204.1073234}, number={3}, journal={ACM Transactions on Graphics}, publisher={Association for Computing Machinery (ACM)}, author={Li, Yin and Sun, Jian and Shum, Heung-Yeung}, year={2005}, month=jul, pages={595–600} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2025,
        6,
        19
      ]
    ],
    "date-time": "2025-06-19T04:41:23Z",
    "timestamp": 1750308083236,
    "version": "3.41.0"
  },
  "reference-count": 19,
  "publisher": "Association for Computing Machinery (ACM)",
  "issue": "3",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            2005,
            7,
            1
          ]
        ],
        "date-time": "2005-07-01T00:00:00Z",
        "timestamp": 1120176000000
      },
      "content-version": "vor",
      "delay-in-days": 0,
      "URL": "https://www.acm.org/publications/policies/copyright_policy#Background"
    }
  ],
  "content-domain": {
    "domain": [
      "dl.acm.org"
    ],
    "crossmark-restriction": true
  },
  "published-print": {
    "date-parts": [
      [
        2005,
        7
      ]
    ]
  },
  "abstract": "<jats:p>In this paper, we present a system for cutting a moving object out from a video clip. The cutout object sequence can be pasted onto another video or a background image. To achieve this, we first apply a new 3D graph cut based segmentation approach on the spatial-temporal video volume. Our algorithm partitions watershed presegmentation regions into foreground and background while preserving temporal coherence. Then, the initial segmentation result is refined locally. Given two frames in the video sequence, we specify two respective windows of interest which are then tracked using a bi-directional feature tracking algorithm. For each frame in between these two given frames, the segmentation in each tracked window is refined using a 2D graph cut that utilizes a local color model. Moreover, we provide brush tools for the user to control the object boundary precisely wherever needed. Based on the accurate binary segmentation result, we apply coherent matting to extract the alpha mattes and foreground colors of the object.</jats:p>",
  "DOI": "10.1145/1073204.1073234",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2005,
        11,
        7
      ]
    ],
    "date-time": "2005-11-07T16:00:45Z",
    "timestamp": 1131379245000
  },
  "page": "595-600",
  "update-policy": "https://doi.org/10.1145/crossmark-policy",
  "source": "Crossref",
  "is-referenced-by-count": 166,
  "title": "Video object cut and paste",
  "prefix": "10.1145",
  "volume": "24",
  "author": [
    {
      "given": "Yin",
      "family": "Li",
      "sequence": "first",
      "affiliation": [
        {
          "name": "Microsoft Research Asia"
        }
      ]
    },
    {
      "given": "Jian",
      "family": "Sun",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "Microsoft Research Asia"
        }
      ]
    },
    {
      "given": "Heung-Yeung",
      "family": "Shum",
      "sequence": "additional",
      "affiliation": [
        {
          "name": "Microsoft Research Asia"
        }
      ]
    }
  ],
  "member": "320",
  "published-online": {
    "date-parts": [
      [
        2005,
        7
      ]
    ]
  },
  "reference": [
    {
      "key": "e_1_2_2_1_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1186562.1015764"
    },
    {
      "volume-title": "Proceedings of CVPR",
      "year": "2004",
      "author": "Apostoloff N. E.",
      "key": "e_1_2_2_2_1"
    },
    {
      "key": "e_1_2_2_3_1",
      "unstructured": "Bellman R. E. 1957. Dynamic Programming. Princeton University Press. Princeton. NJ.   Bellman R. E. 1957. Dynamic Programming. Princeton University Press. Princeton. NJ."
    },
    {
      "key": "e_1_2_2_4_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1006/cviu.1996.0006"
    },
    {
      "key": "e_1_2_2_5_1",
      "doi-asserted-by": "crossref",
      "unstructured": "Blake A. and Isard. M. 1998. Active contours. In Springer Verlag London.  Blake A. and Isard. M. 1998. Active contours. In Springer Verlag London.",
      "DOI": "10.1007/978-1-4471-1555-7"
    },
    {
      "key": "e_1_2_2_6_1",
      "first-page": "428",
      "article-title": "Interactive image segmentation using an adaptive gmmrf model",
      "author": "Blake A.",
      "year": "2004",
      "journal-title": "Proceedings of ECCV."
    },
    {
      "volume-title": "Proceedings of ICCV",
      "year": "2001",
      "author": "Boykov Y.",
      "key": "e_1_2_2_7_1"
    },
    {
      "volume-title": "Proceedings of CVPR",
      "year": "2001",
      "author": "Chuang Y.-Y.",
      "key": "e_1_2_2_8_1"
    },
    {
      "key": "e_1_2_2_9_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/566570.566572"
    },
    {
      "key": "e_1_2_2_10_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1186415.1186483"
    },
    {
      "key": "e_1_2_2_11_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/BF00133570"
    },
    {
      "key": "e_1_2_2_12_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1201775.882264"
    },
    {
      "key": "e_1_2_2_13_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1186562.1015719"
    },
    {
      "key": "e_1_2_2_14_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/218380.218450"
    },
    {
      "volume-title": "Proceedings of CVPR",
      "year": "1999",
      "author": "Mortensen E. N.",
      "key": "e_1_2_2_15_1"
    },
    {
      "key": "e_1_2_2_16_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/1186562.1015720"
    },
    {
      "key": "e_1_2_2_17_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/990002.990005"
    },
    {
      "key": "e_1_2_2_18_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/237170.237263"
    },
    {
      "key": "e_1_2_2_19_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/34.87344"
    }
  ],
  "container-title": "ACM Transactions on Graphics",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://dl.acm.org/doi/10.1145/1073204.1073234",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://dl.acm.org/doi/pdf/10.1145/1073204.1073234",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "similarity-checking"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2025,
        6,
        18
      ]
    ],
    "date-time": "2025-06-18T16:07:45Z",
    "timestamp": 1750262865000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://dl.acm.org/doi/10.1145/1073204.1073234"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        2005,
        7
      ]
    ]
  },
  "references-count": 19,
  "journal-issue": {
    "issue": "3",
    "published-print": {
      "date-parts": [
        [
          2005,
          7
        ]
      ]
    }
  },
  "alternative-id": [
    "10.1145/1073204.1073234"
  ],
  "URL": "http://dx.doi.org/10.1145/1073204.1073234",
  "relation": {},
  "ISSN": [
    "0730-0301",
    "1557-7368"
  ],
  "subject": [],
  "container-title-short": "ACM Trans. Graph.",
  "published": {
    "date-parts": [
      [
        2005,
        7
      ]
    ]
  },
  "assertion": [
    {
      "value": "2005-07-01",
      "order": 2,
      "name": "published",
      "label": "Published",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    }
  ]
}