DOI: 10.1046/j.1365-2818.2001.00950.x. Super‐resolution microscopy using normal flow decoding and geometric constraints

Super‐resolution microscopy using normal flow decoding and geometric constraints

10.1046/j.1365-2818.2001.00950.x

Crossref journal-article

Wiley

Journal of Microscopy (311)

Abstract

Prior knowledge about the observed scene provides the key to restoration of frequencies beyond the bandpass of an imaging system (super‐resolution). In conjunction with microscopy two super‐resolution mechanisms have been mainly reported: analytic continuation of the frequency spectrum, and constrained image deconvolution. This paper describes an alternative approach to super‐resolution. Prior knowledge is imposed through geometric and dynamic models of the scene. We illustrate our concept based on the stereo reconstruction of a micropipette moving in close proximity to a stationary target object. Information about the shape and the movement of the pipette is incorporated into the reconstruction algorithm. The algorithm was tested in a microrobot environment, where the pipette tip was tracked at sub‐Rayleigh distances to the target. Based on the tracking results, a machine vision module controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono‐crystals. In the theoretical part of this paper we prove that knowledge of the form ‘the pipette has moved between two consecutive frames of the movie’ must result in a twofold increase in resolution. We used the normal flow of an image sequence to decode positional measures from motion evidence. In practice, super‐resolution factors between 3 and 5 were obtained. The additional gain originates from the geometric constraints that were imposed upon the stereo reconstruction of the pipette axis.

Bibliography

Danuser, G. (2001). Superâresolution microscopy using normal flow decoding and geometric constraints. Journal of Microscopy, 204(2), 136â149. Portico.

Authors 1

G. Danuser (first)

References 32 Referenced 10

10.1038/366044a0
10.1364/JOSA.53.000274
10.1364/JOSA.52.000276
10.1007/BF01420984
10.1126/science.7770772
10.1016/0262-8856(95)93154-K
10.1364/JOSAA.3.001152
Danuser G. (1997)Quantitative stereo vision for the stereo light microscope: an attempt to provide control feedback for a nanorobot system.PhD Thesis ETH Zurich.
10.1046/j.1365-2818.1999.00425.x
10.1364/JOSAA.14.000547
10.1126/science.2321027
10.1073/pnas.130181797
{'key': 'e_1_2_7_14_1', 'first-page': '147', 'article-title': 'Sevenfold improvement of axial resolution in 3D widefield microscopy using two objective lenses', 'volume': '2412', 'author': 'Gustafsson M.G.L.', 'year': '1995', 'journal-title': 'Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE'} / Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE / Sevenfold improvement of axial resolution in 3D widefield microscopy using two objective lenses by Gustafsson M.G.L. (1995)
10.1046/j.1365-2818.2000.00710.x
10.1016/S0959-440X(99)00016-0
{'key': 'e_1_2_7_17_1', 'first-page': '185', 'article-title': 'Laterally modulated excitation microscopy: improvement of resolution using a diffraction grating', 'volume': '3568', 'author': 'Heintzmann R.', 'year': '1998', 'journal-title': 'Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE'} / Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE / Laterally modulated excitation microscopy: improvement of resolution using a diffraction grating by Heintzmann R. (1998)
10.1364/JOSAA.9.002159
10.1016/0004-3702(81)90024-2
10.1073/pnas.97.15.8206
10.1109/ICCV.1995.466846
10.1364/JOSA.56.001463
10.1364/JOSA.57.001190
10.1364/JOSA.39.000553
10.1364/JOSA.39.000558
10.1364/JOSA.66.000068
10.1364/AO.39.002948
10.1002/(SICI)1097-0029(19990915)46:6<398::AID-JEMT8>3.0.CO;2-H
10.1007/BF01246637
10.1364/JOSA.45.000497
10.1046/j.1365-2818.1999.00421.x
{'key': 'e_1_2_7_32_1', 'first-page': '892', 'volume-title': 'Image Understanding Workshop', 'author': 'Voorhees H.', 'year': '1987'} / Image Understanding Workshop by Voorhees H. (1987)
10.1364/JOSA.40.000222

Dates

Type	When
Created	22 years, 5 months ago (March 12, 2003, 1:33 a.m.)
Deposited	1 year, 10 months ago (Oct. 18, 2023, 5:05 p.m.)
Indexed	1 year, 7 months ago (Jan. 9, 2024, 5:03 p.m.)
Issued	23 years, 9 months ago (Nov. 1, 2001)
Published	23 years, 9 months ago (Nov. 1, 2001)
Published Online	23 years, 7 months ago (Jan. 12, 2002)
Published Print	23 years, 9 months ago (Nov. 1, 2001)

Funders 0

None

BibTeX

@article{Danuser_2001, title={Super‐resolution microscopy using normal flow decoding and geometric constraints}, volume={204}, ISSN={1365-2818}, url={http://dx.doi.org/10.1046/j.1365-2818.2001.00950.x}, DOI={10.1046/j.1365-2818.2001.00950.x}, number={2}, journal={Journal of Microscopy}, publisher={Wiley}, author={Danuser, G.}, year={2001}, month=nov, pages={136–149} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2024,
        1,
        9
      ]
    ],
    "date-time": "2024-01-09T22:03:55Z",
    "timestamp": 1704837835691
  },
  "reference-count": 32,
  "publisher": "Wiley",
  "issue": "2",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            2002,
            1,
            12
          ]
        ],
        "date-time": "2002-01-12T00:00:00Z",
        "timestamp": 1010793600000
      },
      "content-version": "vor",
      "delay-in-days": 72,
      "URL": "http://onlinelibrary.wiley.com/termsAndConditions#vor"
    }
  ],
  "content-domain": {
    "domain": [
      "onlinelibrary.wiley.com"
    ],
    "crossmark-restriction": true
  },
  "published-print": {
    "date-parts": [
      [
        2001,
        11
      ]
    ]
  },
  "abstract": "<jats:p>Prior knowledge about the observed scene provides the key to restoration of frequencies beyond the bandpass of an imaging system (super\u2010resolution). In conjunction with microscopy two super\u2010resolution mechanisms have been mainly reported: analytic continuation of the frequency spectrum, and constrained image deconvolution. This paper describes an alternative approach to super\u2010resolution. Prior knowledge is imposed through geometric and dynamic models of the scene. We illustrate our concept based on the stereo reconstruction of a micropipette moving in close proximity to a stationary target object. Information about the shape and the movement of the pipette is incorporated into the reconstruction algorithm. The\u00a0algorithm was tested in a microrobot environment, where the pipette tip was tracked at sub\u2010Rayleigh distances to the target. Based on the tracking results, a machine vision module controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono\u2010crystals. In the theoretical part of this paper we prove that knowledge of the form \u2018the pipette has moved between two consecutive frames of the movie\u2019 must result in a twofold increase in resolution. We used the normal flow of an image sequence to decode positional measures from motion evidence. In practice, super\u2010resolution factors between 3 and 5 were obtained. The additional gain originates from the geometric constraints that were imposed upon the stereo reconstruction of the pipette axis.</jats:p>",
  "DOI": "10.1046/j.1365-2818.2001.00950.x",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2003,
        3,
        12
      ]
    ],
    "date-time": "2003-03-12T06:33:39Z",
    "timestamp": 1047450819000
  },
  "page": "136-149",
  "update-policy": "http://dx.doi.org/10.1002/crossmark_policy",
  "source": "Crossref",
  "is-referenced-by-count": 10,
  "title": "Super\u2010resolution microscopy using normal flow decoding and geometric constraints",
  "prefix": "10.1111",
  "volume": "204",
  "author": [
    {
      "given": "G.",
      "family": "Danuser",
      "sequence": "first",
      "affiliation": []
    }
  ],
  "member": "311",
  "published-online": {
    "date-parts": [
      [
        2002,
        1,
        12
      ]
    ]
  },
  "reference": [
    {
      "key": "e_1_2_7_2_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1038/366044a0"
    },
    {
      "key": "e_1_2_7_3_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.53.000274"
    },
    {
      "key": "e_1_2_7_4_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.52.000276"
    },
    {
      "key": "e_1_2_7_5_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/BF01420984"
    },
    {
      "key": "e_1_2_7_6_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1126/science.7770772"
    },
    {
      "key": "e_1_2_7_7_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/0262-8856(95)93154-K"
    },
    {
      "key": "e_1_2_7_8_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSAA.3.001152"
    },
    {
      "key": "e_1_2_7_9_1",
      "unstructured": "Danuser G. (1997)Quantitative stereo vision for the stereo light microscope: an attempt to provide control feedback for a nanorobot system.PhD Thesis ETH Zurich."
    },
    {
      "key": "e_1_2_7_10_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1046/j.1365-2818.1999.00425.x"
    },
    {
      "key": "e_1_2_7_11_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSAA.14.000547"
    },
    {
      "key": "e_1_2_7_12_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1126/science.2321027"
    },
    {
      "key": "e_1_2_7_13_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1073/pnas.130181797"
    },
    {
      "key": "e_1_2_7_14_1",
      "first-page": "147",
      "article-title": "Sevenfold improvement of axial resolution in 3D widefield microscopy using two objective lenses",
      "volume": "2412",
      "author": "Gustafsson M.G.L.",
      "year": "1995",
      "journal-title": "Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE"
    },
    {
      "key": "e_1_2_7_15_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1046/j.1365-2818.2000.00710.x"
    },
    {
      "key": "e_1_2_7_16_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/S0959-440X(99)00016-0"
    },
    {
      "key": "e_1_2_7_17_1",
      "first-page": "185",
      "article-title": "Laterally modulated excitation microscopy: improvement of resolution using a diffraction grating",
      "volume": "3568",
      "author": "Heintzmann R.",
      "year": "1998",
      "journal-title": "Three-Dimensional Microscopy: Image Acquisition and Processing. SPIE"
    },
    {
      "key": "e_1_2_7_18_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSAA.9.002159"
    },
    {
      "key": "e_1_2_7_19_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1016/0004-3702(81)90024-2"
    },
    {
      "key": "e_1_2_7_20_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1073/pnas.97.15.8206"
    },
    {
      "key": "e_1_2_7_21_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1109/ICCV.1995.466846"
    },
    {
      "key": "e_1_2_7_22_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.56.001463"
    },
    {
      "key": "e_1_2_7_23_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.57.001190"
    },
    {
      "key": "e_1_2_7_24_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.39.000553"
    },
    {
      "key": "e_1_2_7_25_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.39.000558"
    },
    {
      "key": "e_1_2_7_26_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.66.000068"
    },
    {
      "key": "e_1_2_7_27_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/AO.39.002948"
    },
    {
      "key": "e_1_2_7_28_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/(SICI)1097-0029(19990915)46:6<398::AID-JEMT8>3.0.CO;2-H"
    },
    {
      "key": "e_1_2_7_29_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/BF01246637"
    },
    {
      "key": "e_1_2_7_30_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.45.000497"
    },
    {
      "key": "e_1_2_7_31_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1046/j.1365-2818.1999.00421.x"
    },
    {
      "key": "e_1_2_7_32_1",
      "first-page": "892",
      "volume-title": "Image Understanding Workshop",
      "author": "Voorhees H.",
      "year": "1987"
    },
    {
      "key": "e_1_2_7_33_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1364/JOSA.40.000222"
    }
  ],
  "container-title": "Journal of Microscopy",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://api.wiley.com/onlinelibrary/tdm/v1/articles/10.1046%2Fj.1365-2818.2001.00950.x",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://onlinelibrary.wiley.com/doi/pdf/10.1046/j.1365-2818.2001.00950.x",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "similarity-checking"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2023,
        10,
        18
      ]
    ],
    "date-time": "2023-10-18T21:05:18Z",
    "timestamp": 1697663118000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://onlinelibrary.wiley.com/doi/10.1046/j.1365-2818.2001.00950.x"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        2001,
        11
      ]
    ]
  },
  "references-count": 32,
  "journal-issue": {
    "issue": "2",
    "published-print": {
      "date-parts": [
        [
          2001,
          11
        ]
      ]
    }
  },
  "alternative-id": [
    "10.1046/j.1365-2818.2001.00950.x"
  ],
  "URL": "http://dx.doi.org/10.1046/j.1365-2818.2001.00950.x",
  "relation": {},
  "ISSN": [
    "0022-2720",
    "1365-2818"
  ],
  "subject": [],
  "container-title-short": "Journal of Microscopy",
  "published": {
    "date-parts": [
      [
        2001,
        11
      ]
    ]
  },
  "assertion": [
    {
      "value": "2002-01-12",
      "order": 2,
      "name": "published",
      "label": "Published",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    }
  ]
}