Object Perception as Bayesian Inference
10.1146/annurev.psych.55.090902.142005
Crossref journal-article
Annual Reviews
Annual Review of Psychology (22)
Abstract

We perceive the shapes and material properties of objects quickly and reliably despite the complexity and objective ambiguities of natural images. Typical images are highly complex because they consist of many objects embedded in background clutter. Moreover, the image features of an object are extremely variable and ambiguous owing to the effects of projection, occlusion, background clutter, and illumination. The very success of everyday vision implies neural mechanisms, yet to be understood, that discount irrelevant information and organize ambiguous or noisy local image features into objects and surfaces. Recent work in Bayesian theories of visual perception has shown how complexity may be managed and ambiguity resolved through the task-dependent, probabilistic integration of prior object knowledge with image features.

Bibliography

Kersten, D., Mamassian, P., & Yuille, A. (2004). Object Perception as Bayesian Inference. Annual Review of Psychology, 55(1), 271–304.

Authors 3
  1. Daniel Kersten (first)
  2. Pascal Mamassian (additional)
  3. Alan Yuille (additional)
References 148 Referenced 914
  1. 10.1068/p3050
  2. 10.1146/annurev.neuro.25.112701.142900
  3. 10.1162/neco.1996.8.6.1321
  4. 10.1113/jphysiol.1962.sp006838
  5. 10.1007/978-1-4757-4286-2
  6. 10.1068/p3197
  7. 10.1163/156856800741063
  8. 10.1038/343165a0
  9. 10.1038/47245
  10. 10.1167/3.6.2
  11. 10.1364/JOSAA.14.001393
  12. 10.1068/p230869
  13. 10.1016/S0165-0173(01)00085-6
  14. 10.1364/JOSAA.5.001749
  15. {'key': 'B15', 'first-page': '283', 'volume': '2', 'author': 'Bülthoff HH', 'year': '1991', 'journal-title': 'Comments Theor. Biol.'} / Comments Theor. Biol. by Bülthoff HH (1991)
  16. 10.1162/089976600300015169
  17. 10.1007/978-1-4757-2076-1
  18. 10.1145/300776.300778
  19. 10.1162/neco.1995.7.5.889
  20. Debevec PE. 1998.Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. Presented atSIGGRAPH (10.1145/280814.280864)
  21. Dror RO, Leung TK, Adelson EH, Willsky AS. 2001.Statistics of real-world illumination. Presented atProc. CVPR, Hawaii
  22. 10.3758/BF03212096
  23. 10.1167/2.4.5
  24. 10.1038/415429a
  25. 10.1023/A:1018946025316
  26. 10.3758/BF03194532
  27. 10.1364/JOSAA.4.002379
  28. 10.1364/JOSAA.20.001283
  29. 10.1167/3.5.3
  30. 10.1038/368542a0
  31. 10.1023/A:1026501619075
  32. {'key': 'B32', 'first-page': '771', 'volume': '14', 'author': 'Freund Y', 'year': '1999', 'journal-title': 'J. Jpn. Soc. Artif. Intell.'} / J. Jpn. Soc. Artif. Intell. by Freund Y (1999)
  33. 10.1016/0042-6989(95)00029-Y
  34. 10.1038/nn0602-508
  35. 10.1016/S0042-6989(00)00277-7
  36. 10.1016/S0960-9822(03)00133-7
  37. 10.1016/S1364-6613(00)01567-9
  38. {'volume-title': 'Signal Detection Theory and Psychophysics', 'year': '1974', 'author': 'Green DM', 'key': 'B38'} / Signal Detection Theory and Psychophysics by Green DM (1974)
  39. 10.56021/9780801851872 / Elements of Pattern Theory by Grenander U (1996)
  40. 10.1016/S0959-4388(03)00060-6
  41. 10.1016/S0042-6989(01)00073-6
  42. 10.1007/978-0-387-21606-5
  43. Helmholtz H. 1867.Handbuch der Physiologischen Optik.Leipzig: Voss. (English tranl. 1924 JPC Southall asTreatise on Physiological Optics)
  44. 10.1068/p220887
  45. 10.1126/science.1075396
  46. 10.1098/rstb.1997.0101
  47. 10.1073/pnas.162474299
  48. 10.1016/S0960-9822(06)00058-3
  49. 10.1023/A:1008078328650
  50. 10.1016/S1364-6613(02)01948-4
  51. Jensen HW, Marschner SR, Levoy M, Hanrahan P. 2001.A practical model for subsurface light transport. Presented at Computer Graphics(SIGGRAPH) (10.1145/383259.383319)
  52. {'volume-title': 'Vision and Artifact', 'year': '1976', 'author': 'Kanizsa G', 'key': 'B52'} / Vision and Artifact by Kanizsa G (1976)
  53. {'key': 'B53', 'first-page': '353', 'volume-title': 'The New Cognitive Neurosciences', 'author': 'Kersten D', 'year': '1999', 'edition': '2'} / The New Cognitive Neurosciences by Kersten D (1999)
  54. 10.1068/p260171
  55. 10.1002/0470013427.ch7
  56. 10.1016/S0959-4388(03)00042-4
  57. 10.1016/S0042-6989(97)00325-8
  58. 10.1364/JOSAA.7.001113
  59. 10.1038/351228a0
  60. 10.1017/CBO9780511984037.002
  61. 10.1017/CBO9780511984037
  62. 10.1007/s004220050502
  63. 10.1068/p3030
  64. {'key': 'B64', 'first-page': '37', 'volume': '1', 'author': 'Konishi SM', 'year': '2003', 'journal-title': 'Pattern Anal. Mach. Intell.'} / Pattern Anal. Mach. Intell. by Konishi SM (2003)
  65. 10.1016/S0166-2236(00)01657-X
  66. 10.1364/JOSA.61.000001
  67. 10.1364/JOSAA.18.002307
  68. 10.1016/0042-6989(94)00176-M
  69. 10.1068/p3178
  70. 10.1364/JOSAA.20.001434
  71. 10.1038/nn0602-860
  72. 10.1016/S0042-6989(02)00131-1
  73. 10.1016/S0960-9822(03)00135-0
  74. 10.1038/82947
  75. 10.1093/cercor/11.4.287
  76. 10.1016/S0042-6989(98)00063-7
  77. 10.1364/JOSAA.20.001331
  78. 10.1016/S0042-6989(98)00167-9
  79. 10.1016/0042-6989(94)00150-K
  80. 10.1016/0042-6989(92)90137-8
  81. 10.1515/9781400882618-012
  82. 10.1002/0470013427.ch6
  83. 10.1016/S0010-0277(01)00116-0
  84. 10.1016/S1364-6613(98)01204-2
  85. 10.1016/S0042-6989(97)00438-0
  86. 10.1016/S0042-6989(01)00147-X
  87. Mamassian P, Landy MS, Maloney LT. 2002. Bayesian modelling of visual perception. SeeRao et al. 2002, pp.13–36 (10.7551/mitpress/5583.003.0005)
  88. 10.1364/AO.39.002592
  89. 10.1068/p3219
  90. 10.1007/BF00198477
  91. 10.1073/pnas.192579399
  92. 10.1126/science.1529336
  93. 10.1006/cogp.1999.0728
  94. 10.1023/A:1011139631724
  95. 10.1511/2000.3.238
  96. 10.1016/S0166-2236(97)01216-2
  97. 10.1016/0042-6989(91)90060-I
  98. 10.1016/S0960-9822(99)00262-6
  99. {'volume-title': 'Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.', 'year': '1988', 'author': 'Pearl J', 'key': 'B99'} / Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. by Pearl J (1988)
  100. 10.1038/nature01516
  101. 10.1016/0042-6989(94)90123-6
  102. 10.1016/S0042-6989(01)00173-0
  103. 10.1038/22268
  104. 10.1038/343263a0
  105. 10.1126/science.247.4945.978
  106. 10.1023/A:1026553619983
  107. 10.1038/35039062
  108. 10.1068/p140097
  109. 10.1038/4580
  110. 10.7551/mitpress/5583.001.0001
  111. 10.1007/s004220100280
  112. 10.1016/S0959-4388(02)00304-5
  113. {'volume-title': 'The Logic of Perception.', 'year': '1983', 'author': 'Rock I', 'key': 'B113'} / The Logic of Perception. by Rock I (1983)
  114. 10.1152/jn.1996.76.4.2790
  115. 10.1016/S0042-6989(01)00187-0
  116. {'volume-title': 'Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond.', 'year': '2002', 'author': 'Schölkopf B', 'key': 'B116'} / Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. by Schölkopf B (2002)
  117. 10.1023/A:1026557704054
  118. Schrater PR, Kersten D. 2002. Vision, psychophysics, and Bayes. See Rao et al. 2002b, pp.39–64 (10.7551/mitpress/5583.003.0006)
  119. 10.1038/71134
  120. 10.1146/annurev.neuro.24.1.1193
  121. Sinha P, Adelson E. 1993.Recovering reflectance and illumination in a world of painted polyhedra.Presented atProc. Int. Conf. Comput. Vis., 4th, Berlin
  122. 10.1038/630
  123. 10.1037/0096-1523.21.6.1494
  124. {'key': 'B124', 'first-page': '59', 'volume-title': 'Advances in Neural Information Processing Systems', 'volume': '12', 'author': 'Tenenbaum JB', 'year': '2000'} / Advances in Neural Information Processing Systems by Tenenbaum JB (2000)
  125. 10.1017/S0140525X01000061
  126. Tenenbaum JB, Xu F. 2000. Word learning as Bayesian inference.Proc. Ann. Conf. Cogn. Sci. Soc., 22nd, ed. Gleitman LR, Joshi AK. Mahwah, NJ: Lawerence Erlbaum Assoc.
  127. 10.1016/0042-6989(95)00070-G
  128. 10.1068/p2901
  129. Tu Z, Chen A, Yuille AL, Zhu SC. 2003. Image parsing.Proc. Int. Conf. Comput. Vis., Cannes, France
  130. 10.1109/34.1000239
  131. 10.7551/mitpress/3496.001.0001
  132. 10.1109/34.99234
  133. 10.1068/p3029
  134. {'volume-title': 'Statistical Learning Theory.', 'year': '1998', 'author': 'Vapnik VN', 'key': 'B134'} / Statistical Learning Theory. by Vapnik VN (1998)
  135. 10.1364/JOSAA.14.002152
  136. Viola P, Jones MJ. 2001. Robust real-time object detection.Proc. IEEE Workshop Stat. Comput. Theor. Vis., Vancouver, Can.
  137. Weber M, Welling M, Perona P. 2000.Unsupervised Learning of Models for Recognition.Presented atProc. Eur. Conf. Comp. Vis., 6th, Dublin, Ireland (10.1007/3-540-45054-8_2)
  138. 10.1038/nn0602-858
  139. {'key': 'B139', 'first-page': '96', 'volume-title': 'Encyclopedia of Cognitive Science', 'author': 'Yonas A', 'year': '2003'} / Encyclopedia of Cognitive Science by Yonas A (2003)
  140. 10.1016/S0893-6080(02)00058-8
  141. Yuille AL, Bülthoff HH. 1996. Bayesian decision theory and psychophysics. SeeKnill & Richards 1996, pp.123–61 (10.1017/CBO9780511984037.006)
  142. Yuille AL, Coughlan JM, Konishi S. 2001.The KGBR viewpoint-lighting ambiguity and its resolution by generic constraints.Presented atProc. Int. Conf. Comput. Vis.,Vancouver, Canada
  143. 10.1364/JOSAA.20.000024
  144. 10.1038/333071a0
  145. 10.1109/34.809110
  146. 10.1109/34.632983
  147. 10.1162/neco.1997.9.8.1627
  148. 10.1523/JNEUROSCI.16-22-07376.1996
Dates
Type When
Created 21 years, 7 months ago (Jan. 27, 2004, 8:24 a.m.)
Deposited 8 months, 3 weeks ago (Dec. 14, 2024, 8:17 p.m.)
Indexed 4 days, 3 hours ago (Sept. 3, 2025, 5:53 a.m.)
Issued 21 years, 7 months ago (Feb. 1, 2004)
Published 21 years, 7 months ago (Feb. 1, 2004)
Published Print 21 years, 7 months ago (Feb. 1, 2004)
Funders 0

None

@article{Kersten_2004, title={Object Perception as Bayesian Inference}, volume={55}, ISSN={1545-2085}, url={http://dx.doi.org/10.1146/annurev.psych.55.090902.142005}, DOI={10.1146/annurev.psych.55.090902.142005}, number={1}, journal={Annual Review of Psychology}, publisher={Annual Reviews}, author={Kersten, Daniel and Mamassian, Pascal and Yuille, Alan}, year={2004}, month=feb, pages={271–304} }