Crossref journal-article
American Association for the Advancement of Science (AAAS)
Science (221)
Abstract

The question of how the human brain represents conceptual knowledge has been debated in many scientific fields. Brain imaging studies have shown that different spatial patterns of neural activation are associated with thinking about different semantic categories of pictures and words (for example, tools, buildings, and animals). We present a computational model that predicts the functional magnetic resonance imaging (fMRI) neural activation associated with words for which fMRI data are not yet available. This model is trained with a combination of data from a trillion-word text corpus and observed fMRI data associated with viewing several dozen concrete nouns. Once trained, the model predicts fMRI activation for thousands of other concrete nouns in the text corpus, with highly significant accuracies over the 60 nouns for which we currently have fMRI data.

Bibliography

Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008). Predicting Human Brain Activity Associated with the Meanings of Nouns. Science, 320(5880), 1191–1195.

Authors 7
  1. Tom M. Mitchell (first)
  2. Svetlana V. Shinkareva (additional)
  3. Andrew Carlson (additional)
  4. Kai-Min Chang (additional)
  5. Vicente L. Malave (additional)
  6. Robert A. Mason (additional)
  7. Marcel Adam Just (additional)
References 40 Referenced 851
  1. 10.1126/science.1063736
  2. 10.1073/pnas.96.16.9379
  3. 10.1523/JNEUROSCI.17-11-04302.1997
  4. T. A. Carlson, P. Schrater, S. He, J. Cogn. Neurosci.15, 704 (2003). (10.1162/jocn.2003.15.5.704) / J. Cogn. Neurosci. (2003)
  5. D. D. Cox, R. L. Savoy, Neuroimage19, 261 (2003). (10.1016/S1053-8119(03)00049-1) / Neuroimage (2003)
  6. T. Mitchellet al., Mach. Learn.57, 145 (2004). (10.1023/B:MACH.0000035475.85309.1b) / Mach. Learn. (2004)
  7. S. J. Hanson, T. Matsuka, J. V. Haxby, Neuroimage23, 156 (2004). (10.1016/j.neuroimage.2004.05.020) / Neuroimage (2004)
  8. 10.1126/science.1117645
  9. A. J. O'Toole, F. Jiang, H. Abdi, J. V. Haxby, J. Cogn. Neurosci.17, 580 (2005). (10.1162/0898929053467550) / J. Cogn. Neurosci. (2005)
  10. K. Kipper A. Korhonen N. Ryant M. Palmer Proceedings of the 5th International Conference on Language Resources and Evaluation Genoa Italy 24 to 26May2006.
  11. G. Miller, R. Beckwith, C. Fellbaum, D. Gross, K. J. Miller, Int. J. Lexicography3, 235 (1990). (10.1093/ijl/3.4.235) / Int. J. Lexicography (1990)
  12. C. Fellbaum Ed. WordNet: An Electronic Lexical Database (Massachusetts Institute of Technology Press Cambridge MA 1998). (10.7551/mitpress/7287.001.0001)
  13. K. W. Church, P. Hanks, Comput. Linguist.16, 22 (1990). / Comput. Linguist. (1990)
  14. T. K. Landauer, S. T. Dumais, Psychol. Rev.104, 211 (1997). (10.1037/0033-295X.104.2.211) / Psychol. Rev. (1997)
  15. D. Lin, S. Zhao, L. Qin, M. Zhou, Proceedings of the 18th International Joint Conference on Artificial Intelligence, Acapulco, Mexico, August 2003 (Morgan Kaufmann, San Francisco, 2003), pp. 1492–1493. / Proceedings of the 18th International Joint Conference on Artificial Intelligence (2003)
  16. D. M. Blei, A. Y. Ng, M. I. Jordan, J. Mach. Learn. Res.3, 993 (2003). / J. Mach. Learn. Res. (2003)
  17. R. Snow D. Jurafsky A. Ng Proceedings of the 44th Annual Meeting of the Association for Computational Linguistics Sydney Australia 17 to 21July2006.
  18. G. S. Cree, K. McRae, J. Exp. Psychol. Gen.132, 163 (2003). (10.1037/0096-3445.132.2.163) / J. Exp. Psychol. Gen. (2003)
  19. A. Caramazza, J. R. Shelton, J. Cogn. Neurosci.10, 1 (1998). (10.1162/089892998563752) / J. Cogn. Neurosci. (1998)
  20. S. J. Crutch, E. K. Warrington, Brain126, 1821 (2003). (10.1093/brain/awg187) / Brain (2003)
  21. D. Samson, A. Pillon, Brain Lang.91, 252 (2004). (10.1016/j.bandl.2004.03.001) / Brain Lang. (2004)
  22. A. Martin, L. L. Chao, Curr. Opin. Neurobiol.11, 194 (2001). (10.1016/S0959-4388(00)00196-3) / Curr. Opin. Neurobiol. (2001)
  23. R. F. Goldberg, C. A. Perfetti, W. Schneider, J. Neurosci.26, 4917 (2006). (10.1523/JNEUROSCI.5389-05.2006) / J. Neurosci. (2006)
  24. B. Z. Mahon A. Caramazza in The Encyclopedia of Language and Linguistics K. Brown Ed. (Elsevier Science Amsterdam ed. 2 2005).
  25. T. Brants A. Franz www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2006T13 (Linguistic Data Consortium Philadelphia PA 2006).
  26. See Supporting Online Material.
  27. K. J. Fristonet al., Hum. Brain Mapp.2, 189 (1995). / Hum. Brain Mapp. (1995)
  28. N. Tzourio-Mazoyeret al., Neuroimage15, 273 (2002). (10.1006/nimg.2001.0978) / Neuroimage (2002)
  29. A. Martin, L. G. Ungerleider, J. V. Haxby, in The New Cognitive Neurosciences, M. S. Gazzainga, Ed. (Massachusetts Institute of Technology Press, Cambridge, MA, ed. 2, 2000), pp. 1023–1036. / The New Cognitive Neurosciences (2000)
  30. B. Cerf, D. LeBihan, P. F. Van de Moortele, P. Mac Leod, A. Faurion, Ann. N.Y. Acad. Sci.855, 575 (1998). (10.1111/j.1749-6632.1998.tb10627.x) / Ann. N.Y. Acad. Sci. (1998)
  31. K. A. Pelphrey, J. P. Morris, C. R. Michelich, T. Allison, G. McCarthy, Cereb. Cortex15, 1866 (2005). (10.1093/cercor/bhi064) / Cereb. Cortex (2005)
  32. L. M. Vaina, J. Solomon, S. Chowdhury, P. Sinha, J. Belliveau, Proc. Natl. Acad. Sci. U.S.A.98, 11656 (2001). (10.1073/pnas.191374198) / Proc. Natl. Acad. Sci. U.S.A. (2001)
  33. K. Sakaiet al., Magn. Reson. Med.33, 736 (1995). (10.1002/mrm.1910330521) / Magn. Reson. Med. (1995)
  34. S. V. Shinkarevaet al., PLoS One3, e1394 (2008). (10.1371/journal.pone.0001394) / PLoS One (2008)
  35. D. R. Hardoon, J. Mourao-Miranda, M. Brammer, J. Shawe-Taylor, Neuroimage37, 1250 (2007). (10.1016/j.neuroimage.2007.06.017) / Neuroimage (2007)
  36. K. N. Kay, T. Naselaris, R. J. Prenger, J. L. Gallant, Nature452, 352 (2008). (10.1038/nature06713) / Nature (2008)
  37. S. Edelman, K. Grill-Spector, T. Kushnir, R. Malach, Psychobiology26, 309 (1998). (10.3758/BF03330618) / Psychobiology (1998)
  38. J. D. Haynes, G. Rees, Nat. Rev. Neurosci.7, 523 (2006). (10.1038/nrn1931) / Nat. Rev. Neurosci. (2006)
  39. K. A. Norman, S. M. Polyn, G. J. Detre, J. V. Haxby, Trends Cogn. Sci.10, 424 (2006). (10.1016/j.tics.2006.07.005) / Trends Cogn. Sci. (2006)
  40. This research was funded by grants from the W. M. Keck Foundation NSF and by a Yahoo! Fellowship to A.C. We acknowledge Google for making available its data from the trillion-token text corpus. We thank W. Cohen for helpful suggestions regarding statistical significance tests.
Dates
Type When
Created 17 years, 2 months ago (May 29, 2008, 4:53 p.m.)
Deposited 1 year, 7 months ago (Jan. 10, 2024, 3:36 a.m.)
Indexed 2 days, 10 hours ago (Aug. 23, 2025, 9:51 p.m.)
Issued 17 years, 2 months ago (May 30, 2008)
Published 17 years, 2 months ago (May 30, 2008)
Published Print 17 years, 2 months ago (May 30, 2008)
Funders 0

None

@article{Mitchell_2008, title={Predicting Human Brain Activity Associated with the Meanings of Nouns}, volume={320}, ISSN={1095-9203}, url={http://dx.doi.org/10.1126/science.1152876}, DOI={10.1126/science.1152876}, number={5880}, journal={Science}, publisher={American Association for the Advancement of Science (AAAS)}, author={Mitchell, Tom M. and Shinkareva, Svetlana V. and Carlson, Andrew and Chang, Kai-Min and Malave, Vicente L. and Mason, Robert A. and Just, Marcel Adam}, year={2008}, month=may, pages={1191–1195} }