DOI: 10.1111/1467-8659.00669. On Visual Similarity Based 3D Model Retrieval

On Visual Similarity Based 3D Model Retrieval

10.1111/1467-8659.00669

Crossref journal-article

Wiley

Computer Graphics Forum (311)

Abstract

AbstractA large number of 3D models are created and available on the Web, since more and more 3D modelling anddigitizing tools are developed for ever increasing applications. The techniques for content‐based 3D model retrievalthen become necessary. In this paper, a visual similarity‐based 3D model retrieval system is proposed.This approach measures the similarity among 3D models by visual similarity, and the main idea is that if two 3Dmodels are similar, they also look similar from all viewing angles. Therefore, one hundred orthogonal projectionsof an object, excluding symmetry, are encoded both by Zernike moments and Fourier descriptors as features forlater retrieval. The visual similarity‐based approach is robust against similarity transformation, noise, model degeneracyetc., and provides 42%, 94% and 25% better performance (precision‐recall evaluation diagram) thanthree other competing approaches: (1) the spherical harmonics approach developed by Funkhouser et al., (2) theMPEG‐7 Shape 3D descriptors, and (3) the MPEG‐7 Multiple View Descriptor. The proposed system is on the Webfor practical trial use (http://3d.csie.ntu.edu.tw), and the database contains more than 10,000 publicly available3D models collected from WWW pages. Furthermore, a user friendly interface is provided to retrieve 3D modelsby drawing 2D shapes. The retrieval is fast enough on a server with Pentium IV 2.4 GHz CPU, and it takes about2 seconds and 0.1 seconds for querying directly by a 3D model and by hand drawn 2D shapes, respectively.Categories and Subject Descriptors (according to ACM CCS): H.3.1 [Information Storage and Retrieval]: Indexing Methods

Bibliography

Chen, D., Tian, X., Shen, Y., & Ouhyoung, M. (2003). On Visual Similarity Based 3D Model Retrieval. Computer Graphics Forum, 22(3), 223â232. Portico.

Authors 4

Ding‐Yun Chen (first)
Xiao‐Pei Tian (additional)
Yu‐Te Shen (additional)
Ming Ouhyoung (additional)

References 35 Referenced 1,024

10.1145/588272.588279
10.1145/571647.571648
{'key': 'e_1_2_7_4_2', 'first-page': '203', 'article-title': '“Topology Matching for Fully Automatic Similarity Estimation of 3D Shapes”', 'author': 'Hilaga M.', 'year': '2001', 'journal-title': 'Proc. of ACM SIGGRAPH'} / Proc. of ACM SIGGRAPH / “Topology Matching for Fully Automatic Similarity Estimation of 3D Shapes” by Hilaga M. (2001)
10.1016/S0923-5965(00)00020-5
10.1109/PCCGA.2002.1167870 / Proc. of 10th Pacific Graphics / “Shape‐Similarity Search of Three‐Dimensional Models Using Parameterized Statistics” by Ohbuchi R. (2002)
10.1109/ICME.2002.1035747
{'key': 'e_1_2_7_8_2', 'first-page': '133', 'article-title': '“Fast Content‐Based Search of VRML Models based on Shape Descriptions”', 'author': 'Kolonias I.', 'year': '2001', 'journal-title': 'Proc. of International Conference on Image Processing (ICIP)'} / Proc. of International Conference on Image Processing (ICIP) / “Fast Content‐Based Search of VRML Models based on Shape Descriptions” by Kolonias I. (2001)
10.1109/PROC.1984.13073
10.1007/3-540-48482-5_14
{'key': 'e_1_2_7_11_2', 'article-title': '“A 3D Object Retrieval System Based on Multi‐Resolution Reeb Graph”', 'volume': '16', 'author': 'Chen D.‐Y.', 'year': '2002', 'journal-title': 'Proc. of Computer Graphics Workshop'} / Proc. of Computer Graphics Workshop / “A 3D Object Retrieval System Based on Multi‐Resolution Reeb Graph” by Chen D.‐Y. (2002)
{'journal-title': 'MPEG-7 Visual part of eXperimentation Model Version 7.0, ISO/IEC JTC1/SC29/WG11/N3521', 'year': '2000', 'author': 'Jeannin S.', 'key': 'e_1_2_7_12_2'} / MPEG-7 Visual part of eXperimentation Model Version 7.0, ISO/IEC JTC1/SC29/WG11/N3521 by Jeannin S. (2000)
{'key': 'e_1_2_7_13_2', 'first-page': '97', 'article-title': '“Content Based Retrieval of VRML Objects ‐ An Iterative and Interactive Approach”', 'author': 'Elad M.', 'year': '2001', 'journal-title': 'Proc. of 6th Eurographics Workshop on Multimedia'} / Proc. of 6th Eurographics Workshop on Multimedia / “Content Based Retrieval of VRML Objects ‐ An Iterative and Interactive Approach” by Elad M. (2001)
10.1109/TMM.2002.1017738
10.1145/353981.353995
10.1145/127719.122749
10.1109/TC.1977.5009272
10.1016/S0146-664X(80)80035-9
{'key': 'e_1_2_7_19_2', 'first-page': '254', 'article-title': '“3D Object Recognition Using Shape Similarity‐Based Aspect Graph”', 'author': 'Cyr C.M.', 'year': '2001', 'journal-title': 'Proc. of International Conference on Computer Vision (ICCV)'} / Proc. of International Conference on Computer Vision (ICCV) / “3D Object Recognition Using Shape Similarity‐Based Aspect Graph” by Cyr C.M. (2001)
{'key': 'e_1_2_7_20_2', 'first-page': '277', 'article-title': '“Fast Multiresolution Image Querying”', 'author': 'Jacobs C.E.', 'year': '1995', 'journal-title': 'Proc. of ACM SIGGRAPH'} / Proc. of ACM SIGGRAPH / “Fast Multiresolution Image Querying” by Jacobs C.E. (1995)
D.S.ZhangandG.Lu.“A comparative Study of Fourier Descriptors for Shape Representation and Retrieval”.Proc. of 5th Asian Conference on Computer Vision (ACCV) 652–657 Melbourne Australia Jan. 2002.
D.S.ZhangandG.Lu.“An Integrated Approach to Shape Based Image Retrieval”.Proc. of 5th Asian Conference on Computer Vision (ACCV) 652–657 Melbourne Australia Jan. 2002.
D.HeeschandS.Ruger “Combining Features for Content‐Based Sketch Retrieval ‐ A Comparative Evaluation of Retrieval Performance” Proc. of 24th BCS‐IRSG European Colloquium on IR Research Glasgow (LNCS 2291) UK Mar. 2002
10.1002/sapm193918151
L.McMillanandG.Bishop “Plenoptic Modeling: An Image‐Based Rendering System” Proc. of ACM SIGGRAPH 39–46 Los Angeles USA Aug. 1995. (10.1145/218380.218398)
M.LevoyandP.Hanrahan “Light Field Rendering” Proc. of ACM SIGGRAPH 31–42 New Orleans USA Aug. 1996. (10.1145/237170.237199)
T.Igarashi S.MatsuokaandH.Tanaka “Teddy: A Sketching Interface for 3D Freeform Design” Proc. of ACM SIGGRAPH 409–416 Los Angeles USA Aug. 1999. (10.1145/311535.311602)
F.HuberandM.Hebert “Fully Automatic Registration of Multiple 3D Data Sets” Proc. of IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS) Kauai Hawaii USA Dec. 2001.
10.1109/34.765655
10.1109/TPAMI.2002.1023806
{'volume-title': 'Visual Information Retrieval', 'year': '1999', 'author': 'Bimbo A.E.', 'key': 'e_1_2_7_31_2'} / Visual Information Retrieval by Bimbo A.E. (1999)
10.1007/978-3-642-93208-3
{'volume-title': 'Computer and Robot Vision', 'year': '1992', 'author': 'Haralick R.M.', 'key': 'e_1_2_7_33_2'} / Computer and Robot Vision by Haralick R.M. (1992)
{'volume-title': 'Principal Component Analysis', 'year': '2002', 'author': 'Jolliffe I.T.', 'key': 'e_1_2_7_34_2'} / Principal Component Analysis by Jolliffe I.T. (2002)
3DCAFE http://www.3dcafe.com
SpharmonicKit 2.5: Fast spherical transforms.http://www.cs.dartmouth.edu/~geelong/sphere/

Dates

Type	When
Created	21 years, 10 months ago (Nov. 4, 2003, 1:30 p.m.)
Deposited	8 months, 3 weeks ago (Dec. 14, 2024, 3:02 a.m.)
Indexed	1 week, 2 days ago (Aug. 29, 2025, 6:46 a.m.)
Issued	22 years ago (Sept. 1, 2003)
Published	22 years ago (Sept. 1, 2003)
Published Online	21 years, 10 months ago (Nov. 4, 2003)
Published Print	22 years ago (Sept. 1, 2003)

Funders 0

None

BibTeX

@article{Chen_2003, title={On Visual Similarity Based 3D Model Retrieval}, volume={22}, ISSN={1467-8659}, url={http://dx.doi.org/10.1111/1467-8659.00669}, DOI={10.1111/1467-8659.00669}, number={3}, journal={Computer Graphics Forum}, publisher={Wiley}, author={Chen, Ding‐Yun and Tian, Xiao‐Pei and Shen, Yu‐Te and Ouhyoung, Ming}, year={2003}, month=sep, pages={223–232} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2025,
        8,
        29
      ]
    ],
    "date-time": "2025-08-29T10:46:34Z",
    "timestamp": 1756464394357,
    "version": "3.30.2"
  },
  "reference-count": 35,
  "publisher": "Wiley",
  "issue": "3",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            2003,
            11,
            4
          ]
        ],
        "date-time": "2003-11-04T00:00:00Z",
        "timestamp": 1067904000000
      },
      "content-version": "vor",
      "delay-in-days": 64,
      "URL": "http://onlinelibrary.wiley.com/termsAndConditions#vor"
    }
  ],
  "content-domain": {
    "domain": [
      "onlinelibrary.wiley.com"
    ],
    "crossmark-restriction": true
  },
  "published-print": {
    "date-parts": [
      [
        2003,
        9
      ]
    ]
  },
  "abstract": "<jats:title>Abstract</jats:title><jats:p><jats:italic>A large number of 3D models are created and available on the Web, since more and more 3D modelling anddigitizing tools are developed for ever increasing applications. The techniques for content\u2010based 3D model retrievalthen become necessary. In this paper, a visual similarity\u2010based 3D model retrieval system is proposed.This approach measures the similarity among 3D models by visual similarity, and the main idea is that if two 3Dmodels are similar, they also look similar from all viewing angles. Therefore, one hundred orthogonal projectionsof an object, excluding symmetry, are encoded both by Zernike moments and Fourier descriptors as features forlater retrieval. The visual similarity\u2010based approach is robust against similarity transformation, noise, model degeneracyetc., and provides 42%, 94% and 25% better performance (precision\u2010recall evaluation diagram) thanthree other competing approaches: (1) the spherical harmonics approach developed by Funkhouser et al., (2) theMPEG\u20107 Shape 3D descriptors, and (3) the MPEG\u20107 Multiple View Descriptor. The proposed system is on the Webfor practical trial use (</jats:italic><jats:ext-link xmlns:xlink=\"http://www.w3.org/1999/xlink\" xlink:href=\"http://3d.csie.ntu.edu.tw\">http://3d.csie.ntu.edu.tw</jats:ext-link><jats:italic>), and the database contains more than 10,000 publicly available3D models collected from WWW pages. Furthermore, a user friendly interface is provided to retrieve 3D modelsby drawing 2D shapes. The retrieval is fast enough on a server with Pentium IV 2.4 GHz CPU, and it takes about2 seconds and 0.1 seconds for querying directly by a 3D model and by hand drawn 2D shapes, respectively.</jats:italic></jats:p><jats:p>Categories and Subject Descriptors (according to ACM CCS): H.3.1 [Information Storage and Retrieval]: Indexing Methods</jats:p>",
  "DOI": "10.1111/1467-8659.00669",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2003,
        11,
        4
      ]
    ],
    "date-time": "2003-11-04T18:30:59Z",
    "timestamp": 1067970659000
  },
  "page": "223-232",
  "update-policy": "https://doi.org/10.1002/crossmark_policy",
  "source": "Crossref",
  "is-referenced-by-count": 1024,
  "title": "On Visual Similarity Based 3D Model Retrieval",
  "prefix": "10.1111",
  "volume": "22",
  "author": [
    {
      "given": "Ding\u2010Yun",
      "family": "Chen",
      "sequence": "first",
      "affiliation": []
    },
    {
      "given": "Xiao\u2010Pei",
      "family": "Tian",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "Yu\u2010Te",
      "family": "Shen",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "Ming",
      "family": "Ouhyoung",
      "sequence": "additional",
      "affiliation": []
    }
  ],
  "member": "311",
  "published-online": {
    "date-parts": [
      [
        2003,
        11,
        4
      ]
    ]
  },
  "reference": [
    {
      "key": "e_1_2_7_2_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/588272.588279"
    },
    {
      "key": "e_1_2_7_3_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/571647.571648"
    },
    {
      "key": "e_1_2_7_4_2",
      "first-page": "203",
      "article-title": "\u201cTopology Matching for Fully Automatic Similarity Estimation of 3D Shapes\u201d",
      "author": "Hilaga M.",
      "year": "2001",
      "journal-title": "Proc. of ACM SIGGRAPH"
    },
    {
      "key": "e_1_2_7_5_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/S0923-5965(00)00020-5"
    },
    {
      "key": "e_1_2_7_6_2",
      "doi-asserted-by": "crossref",
      "first-page": "265",
      "DOI": "10.1109/PCCGA.2002.1167870",
      "article-title": "\u201cShape\u2010Similarity Search of Three\u2010Dimensional Models Using Parameterized Statistics\u201d",
      "author": "Ohbuchi R.",
      "year": "2002",
      "journal-title": "Proc. of 10th Pacific Graphics"
    },
    {
      "key": "e_1_2_7_7_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/ICME.2002.1035747"
    },
    {
      "key": "e_1_2_7_8_2",
      "first-page": "133",
      "article-title": "\u201cFast Content\u2010Based Search of VRML Models based on Shape Descriptions\u201d",
      "author": "Kolonias I.",
      "year": "2001",
      "journal-title": "Proc. of International Conference on Image Processing (ICIP)"
    },
    {
      "key": "e_1_2_7_9_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/PROC.1984.13073"
    },
    {
      "key": "e_1_2_7_10_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/3-540-48482-5_14"
    },
    {
      "key": "e_1_2_7_11_2",
      "article-title": "\u201cA 3D Object Retrieval System Based on Multi\u2010Resolution Reeb Graph\u201d",
      "volume": "16",
      "author": "Chen D.\u2010Y.",
      "year": "2002",
      "journal-title": "Proc. of Computer Graphics Workshop"
    },
    {
      "journal-title": "MPEG-7 Visual part of eXperimentation Model Version 7.0, ISO/IEC JTC1/SC29/WG11/N3521",
      "year": "2000",
      "author": "Jeannin S.",
      "key": "e_1_2_7_12_2"
    },
    {
      "key": "e_1_2_7_13_2",
      "first-page": "97",
      "article-title": "\u201cContent Based Retrieval of VRML Objects \u2010 An Iterative and Interactive Approach\u201d",
      "author": "Elad M.",
      "year": "2001",
      "journal-title": "Proc. of 6th Eurographics Workshop on Multimedia"
    },
    {
      "key": "e_1_2_7_14_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/TMM.2002.1017738"
    },
    {
      "key": "e_1_2_7_15_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/353981.353995"
    },
    {
      "key": "e_1_2_7_16_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1145/127719.122749"
    },
    {
      "key": "e_1_2_7_17_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/TC.1977.5009272"
    },
    {
      "key": "e_1_2_7_18_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/S0146-664X(80)80035-9"
    },
    {
      "key": "e_1_2_7_19_2",
      "first-page": "254",
      "article-title": "\u201c3D Object Recognition Using Shape Similarity\u2010Based Aspect Graph\u201d",
      "author": "Cyr C.M.",
      "year": "2001",
      "journal-title": "Proc. of International Conference on Computer Vision (ICCV)"
    },
    {
      "key": "e_1_2_7_20_2",
      "first-page": "277",
      "article-title": "\u201cFast Multiresolution Image Querying\u201d",
      "author": "Jacobs C.E.",
      "year": "1995",
      "journal-title": "Proc. of ACM SIGGRAPH"
    },
    {
      "key": "e_1_2_7_21_2",
      "unstructured": "D.S.ZhangandG.Lu.\u201cA comparative Study of Fourier Descriptors for Shape Representation and Retrieval\u201d.Proc. of 5th Asian Conference on Computer Vision (ACCV) 652\u2013657 Melbourne Australia Jan. 2002."
    },
    {
      "key": "e_1_2_7_22_2",
      "unstructured": "D.S.ZhangandG.Lu.\u201cAn Integrated Approach to Shape Based Image Retrieval\u201d.Proc. of 5th Asian Conference on Computer Vision (ACCV) 652\u2013657 Melbourne Australia Jan. 2002."
    },
    {
      "key": "e_1_2_7_23_2",
      "unstructured": "D.HeeschandS.Ruger \u201cCombining Features for Content\u2010Based Sketch Retrieval \u2010 A Comparative Evaluation of Retrieval Performance\u201d Proc. of 24th BCS\u2010IRSG European Colloquium on IR Research Glasgow (LNCS 2291) UK Mar. 2002"
    },
    {
      "key": "e_1_2_7_24_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/sapm193918151"
    },
    {
      "key": "e_1_2_7_25_2",
      "doi-asserted-by": "crossref",
      "unstructured": "L.McMillanandG.Bishop \u201cPlenoptic Modeling: An Image\u2010Based Rendering System\u201d Proc. of ACM SIGGRAPH 39\u201346 Los Angeles USA Aug. 1995.",
      "DOI": "10.1145/218380.218398"
    },
    {
      "key": "e_1_2_7_26_2",
      "doi-asserted-by": "crossref",
      "unstructured": "M.LevoyandP.Hanrahan \u201cLight Field Rendering\u201d Proc. of ACM SIGGRAPH 31\u201342 New Orleans USA Aug. 1996.",
      "DOI": "10.1145/237170.237199"
    },
    {
      "key": "e_1_2_7_27_2",
      "doi-asserted-by": "crossref",
      "unstructured": "T.Igarashi S.MatsuokaandH.Tanaka \u201cTeddy: A Sketching Interface for 3D Freeform Design\u201d Proc. of ACM SIGGRAPH 409\u2013416 Los Angeles USA Aug. 1999.",
      "DOI": "10.1145/311535.311602"
    },
    {
      "key": "e_1_2_7_28_2",
      "unstructured": "F.HuberandM.Hebert \u201cFully Automatic Registration of Multiple 3D Data Sets\u201d Proc. of IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS) Kauai Hawaii USA Dec. 2001."
    },
    {
      "key": "e_1_2_7_29_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/34.765655"
    },
    {
      "key": "e_1_2_7_30_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/TPAMI.2002.1023806"
    },
    {
      "volume-title": "Visual Information Retrieval",
      "year": "1999",
      "author": "Bimbo A.E.",
      "key": "e_1_2_7_31_2"
    },
    {
      "key": "e_1_2_7_32_2",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/978-3-642-93208-3"
    },
    {
      "volume-title": "Computer and Robot Vision",
      "year": "1992",
      "author": "Haralick R.M.",
      "key": "e_1_2_7_33_2"
    },
    {
      "volume-title": "Principal Component Analysis",
      "year": "2002",
      "author": "Jolliffe I.T.",
      "key": "e_1_2_7_34_2"
    },
    {
      "key": "e_1_2_7_35_2",
      "unstructured": "3DCAFE http://www.3dcafe.com"
    },
    {
      "key": "e_1_2_7_36_2",
      "unstructured": "SpharmonicKit 2.5: Fast spherical transforms.http://www.cs.dartmouth.edu/~geelong/sphere/"
    }
  ],
  "container-title": "Computer Graphics Forum",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://api.wiley.com/onlinelibrary/tdm/v1/articles/10.1111%2F1467-8659.00669",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://onlinelibrary.wiley.com/doi/pdf/10.1111/1467-8659.00669",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "similarity-checking"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2024,
        12,
        14
      ]
    ],
    "date-time": "2024-12-14T08:02:14Z",
    "timestamp": 1734163334000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://onlinelibrary.wiley.com/doi/10.1111/1467-8659.00669"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        2003,
        9
      ]
    ]
  },
  "references-count": 35,
  "journal-issue": {
    "issue": "3",
    "published-print": {
      "date-parts": [
        [
          2003,
          9
        ]
      ]
    }
  },
  "alternative-id": [
    "10.1111/1467-8659.00669"
  ],
  "URL": "http://dx.doi.org/10.1111/1467-8659.00669",
  "relation": {},
  "ISSN": [
    "0167-7055",
    "1467-8659"
  ],
  "subject": [],
  "container-title-short": "Computer Graphics Forum",
  "published": {
    "date-parts": [
      [
        2003,
        9
      ]
    ]
  },
  "assertion": [
    {
      "value": "2003-11-04",
      "order": 2,
      "name": "published",
      "label": "Published",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    }
  ]
}