Abstract
The organization of movement in the changing retinal image provides a valuable source of information for analysing the environment in terms of objects, their motion in space, and their three-dimensional structure. A description of this movement is not provided to our visual system directly, however; it must be inferred from the pattern of changing intensity that reaches the eye. This paper examines the problem of motion measurement, which we formulate as the computation of an instantaneous two-dimensional velocity field from the changing image. Initial measurements of motion take place at the location of significant intensity changes. These measurements provide only one component of local velocity, and must be integrated to compute the two-dimensional velocity field. A fundamental problem for this integration stage is that the velocity field is not determined uniquely from information available in the changing image. We formulate an additional constraint of smoothness of the velocity field, based on the physical assumption that surfaces are generally smooth, which allows the computation of a unique velocity field. A theoretical analysis of the conditions under which this computation yields the correct velocity field suggests that the solution is physically plausible. Empirical studies show the predictions of this computation to be consistent with human motion perception.
References
68
Referenced
99
10.1038/300523a0
10.1016/0042-6989(70)90092-1
10.1098/rstb.1980.0088
10.1016/0042-6989(75)90236-9
10.3758/BF03214143
{'key': 'p_6', 'first-page': '477', 'article-title': "The mechanism of directional selectivity in the rabbit's retina. J. Physiol", 'volume': '173', 'author': 'Barlow H. B.', 'year': '1965', 'journal-title': 'Lond.'}
/ Lond. / The mechanism of directional selectivity in the rabbit's retina. J. Physiol by Barlow H. B. (1965)10.3758/BF03198616
10.1016/0042-6989(74)90041-8
10.1098/rstb.1980.0087
- Braddick O. J. 1983 Characteristics of the short range motion process in human vision. Paper presented at the Marr Conference Cold Spring Harbor N.Y. April 1983.
10.1016/S0734-189X(83)80026-7
10.1068/p090253
- Corbin H. H. 1942 The perception of grouping and apparent motion in visual space. Arch. Psychol. 273.
-
Davis L. Wu Z. & Sun H. 1982 Contour-based motion estimation. In image understanding workshop ( Applications.
(
10.21236/ADA124812
) - Palo Alto Calfornia) pp. 124-131. Arlington Virginia: Science
10.1016/0146-664X(79)90097-2
- Graham C. H. 1965 Perception of movement. In Vision and visual perception (ed. C. H. Graham). New York: John Wiley & Sons.
-
Grimson W. E. L. 1981 From images to surfaces. A computational study of the human early visual system. Cambridge Massachusetts: M.I.T. Press.
(
10.7551/mitpress/3132.001.0001
) -
Hassenstein B. & Reichardt W. 1956 Systemtheoretische analyse der zeit- reihenfolgen- und vorzeichenauswertung bei der bewgungs-perzeption der russelkafers. Chlorophanus. Naturf. lib 513-524.
(
10.1515/znb-1956-9-1004
) - Hildreth E. C. 1983 The measurement of visual motion. Ph.D. Thesis Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. To appear as a book in the A.C.M. distinguished dissertation series Cambridge Massachusetts: M.I.T. Press.
- Holland H. C. 1965 The spiral after-effect. Oxford: Pergamon Press.
10.1037/h0056652
10.1016/0004-3702(81)90024-2
- Julesz B. 1971 Foundations of cyclopean perception. Chicago: The University of Chicago Press.
10.3758/BF03210195
- Kolers P. A. 1972 Aspects of motion perception. New York: Pergamon Press.
{'key': 'p_27', 'first-page': '193', 'article-title': 'Kinematosk opische untersuchungen', 'volume': '72', 'author': 'Korte A.', 'year': '1915', 'journal-title': 'Zeitschrift fiir Psychol.'}
/ Zeitschrift fiir Psychol. / Kinematosk opische untersuchungen by Korte A. (1915)10.1016/0042-6989(76)90093-6
10.1016/0734-189X(83)90098-1
10.1016/0031-3203(70)90018-X
-
Lillestrand R. L. 1972 Techniques for change detection. I.E.E.E. Trans. Computers c-21 654-659.
(
10.1109/T-C.1972.223570
) 10.1038/293133a0
10.1098/rspb.1980.0057
- Luenberger D. G. 1973 Introduction to linear and nonlinear programming. Reading Massachusetts: Addison-Wesley.
- Marr D. 1982 Vision. San Francisco: W. H. Freeman.
10.1098/rspb.1980.0020
10.1098/rspb.1979.0029
10.1098/rspb.1981.0001
10.1016/0167-8655(82)90052-6
-
Neff W. 1936 A critical investigation of the visual apprehension of movement. Am. J. Psychol.
(
10.2307/1415551
) {'key': 'p_41', 'first-page': '315', 'article-title': 'Experimentelle untersuschung der scheinbewegung. Arch. ges', 'volume': '75', 'author': 'Neuhaus W.', 'year': '1930', 'journal-title': 'Psychol.'}
/ Psychol. / Experimentelle untersuschung der scheinbewegung. Arch. ges by Neuhaus W. (1930)10.1126/science.941023
10.1068/p090271
10.1068/p070371
- Poggio T. 1983 Visual algorithms. In Physical and biological processing of images (ed. O. J. Braddick & A. C. Sleigh). Berlin: Springer-Verlag.
-
Potter J. L. 1975 Velocity as a cue to segmentation. I.E.E.E. Trans. Systems Man Cybernetics SMC-5 390-394.
(
10.1109/TSMC.1975.5408421
) 10.1016/S0146-664X(77)80016-6
10.1007/BF00361077
10.1038/225092a0
- Reichardt W. 1961 Autocorrelation a principle for the evaluation of sensory information by the central nervous system. In Sensory communication (ed. W. A. Rosenblith). Cambridge Massachusetts: M.I.T. Press.
- Rudin W. 1973 Functional analysis. New York: McGraw-Hill.
-
Smith E. A. & Phillips D. R. 1972 Automated cloud tracking using precisely aligned digital ATS pictures. I.E.E.E. Trans. Computers c-21 715-729.
(
10.1109/T-C.1972.223574
) 10.1007/BF02424350
-
Thompson W. B. & Barnard S. T. 1981 Lower-level estimation and interpretation of visual motion. I.E.E.E. Computer August 20-28.
(
10.1109/C-M.1981.220559
) -
Ullman S. 1979a The interpretation of visual motion. Cambridge Massachusetts: M.I.T. Press.
(
10.7551/mitpress/3877.001.0001
) 10.1016/0146-664X(79)90045-5
10.1098/rspb.1979.0006
-
Ullman S. 1981 Analysis of visual motion by biological and computer systems. I.E.E.E. Computer August 57-69.
(
10.1109/C-M.1981.220564
) -
Ullman S. 1983a Computational studies in the interpretation of structure and motion: summary and extension. M.I.T. Artif. Intell.Lab. Memo 706.
(
10.1016/B978-0-12-084320-6.50021-9
) - Ullman S. 19836 Maximizing rigidity: the incremental recovery of 3-D structure from rigid and rubbery motion. M.I.T. Artif. Intell.Lab. Memo 721.
- Ullman S. & Hildreth E. C. 1983 The measurement of visual motion. In Physical and biological processing of images (ed. O. J. Braddick & A. C. Sleigh). Berlin: Springer-Verlag.
- Wallach H. 1976 On perceived identity: 1. the direction of motion of straight lines. In On perception (ed. H. Wallach). New York: Quadrangle.
{'key': 'p_63', 'first-page': '205', 'article-title': 'The kinetic depth effect. J. exp', 'volume': '45', 'author': 'Wallach H.', 'year': '1953', 'journal-title': 'Psychol.'}
/ Psychol. / The kinetic depth effect. J. exp by Wallach H. (1953)10.2307/1418114
{'key': 'p_65', 'first-page': '161', 'article-title': 'Experimentelle studien uber das sehen von bewegung', 'volume': '61', 'author': 'Wertheimer M.', 'year': '1912', 'journal-title': 'Z. Psychol.'}
/ Z. Psychol. / Experimentelle studien uber das sehen von bewegung by Wertheimer M. (1912){'key': 'p_66', 'first-page': '1', 'article-title': 'Special problems in interactive image processing for traffic analysis. Proc. second int. joint Conf', 'author': 'Wolferts K.', 'year': '1974', 'journal-title': 'Patt. Recogn'}
/ Patt. Recogn / Special problems in interactive image processing for traffic analysis. Proc. second int. joint Conf by Wolferts K. (1974)- Yuille A. L. 1983 The smoothest velocity field and token matching schemes. M.I.T. Artif. Intell. Lab. Memo 724.
10.1016/0001-6918(53)90010-9
Dates
Type | When |
---|---|
Created | 18 years, 8 months ago (Dec. 18, 2006, 6:11 p.m.) |
Deposited | 4 years, 6 months ago (Feb. 14, 2021, 7:22 p.m.) |
Indexed | 11 months, 2 weeks ago (Sept. 7, 2024, 7:23 a.m.) |
Issued | 41 years, 3 months ago (April 24, 1984) |
Published | 41 years, 3 months ago (April 24, 1984) |
Published Online | 28 years, 7 months ago (Jan. 1, 1997) |
Published Print | 41 years, 3 months ago (April 24, 1984) |