Computer vision for nanoscale imaging

Machine Vision and Applications

Volumn 17, Issue 3, 2006, Pages 147-162

  Ribeiro, Eraldo ^a   Shah, Mubarak ^b  

^a Florida Institute of Technology   (United States)

^b University of Central Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER VISION; IMAGE PROCESSING; OPTICAL RESOLVING POWER; SIGNAL TO NOISE RATIO; THREE DIMENSIONAL COMPUTER GRAPHICS;

EXCITING FIELD; IMAGING TOOLS; NANOSCALE IMAGES; THREE DIMENSIONAL GEOMETRY;

NANOTECHNOLOGY;

EID: 33746053445     PISSN: 09328092     EISSN: 14321769     Source Type: Journal    
DOI: 10.1007/s00138-006-0021-7     Document Type: Article

References (96)

1. Aguet, F., Van De Ville, D., Unser, M.: Sub-resolution axial localization of nanoparticles in fluorescence microscopy. In: Wilson, T., (ed.) Proceedings of the SPIE European conference on biomedical optics: confocal, multiphoton, and nonlinear microscopic imaging II (ECBO'05), vol. 5860, pp. 103-106. Munich, Germany, June 12-16 (2005)
2. Aurenhammer, F.: Voronoi diagrams - a survey of a fundamental geometric data structure. ACM Comput Surv. 23(3), 345-405 (1991)
3. Azuma, R.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355-385 (1997)
4. Banks, J, Rothnagel, R., Hankamer, B.: Automated particle picking of biological molecules images by electron microscopy. In: Image and vision computing New Zealand, pp. 269-274, November (2003)
5. Belge, M., Kilmer, M., Miller, E.: Wavelet domain image restoration with adaptive edge-preserving regularization. Integr. Psychiatry 9(4), 597-608 (2000)
6. Bera, D., Kuiry, S.C., McCutchen, M., Kruize, A., Heinrich, H., Seal, S., Meyyappan, M.: In-situ synthesis of palladium nanoparticles-filled carbon nanotubes using arc discharge in solution. Chem. Phys. Lett. 386,(4-6), 364-368 (2004)
7. Berglund, A.J., Mabuchi, H.: Tracking-fcs: fluorescence correlation spectroscopy of individual particles. Opt. Express 13, 8069-8082 (2005)
8. Black, M.J., Sapiro, G., Marimont, D., Heeger, D.: Robust anisotropic diffusion. IEEE Trans Image Process. 7(3), 421-432 (1998)
9. Bonneau, S., Dahan, M., Cohen, L.D.: Single quantum dot tracking based on perceptual grouping using minimal paths in a spatiotemporal volume. IEEE Trans. Image Progress. 14(9), 1384-1395 (2005)
10. Bovik, A.C., Gibson, J.D., Bovik, A. (eds.): Handbook of Image and Video Processing. Academic, Orlando (2000)
11. Bracewell, R.: The Fourier Transform and Its Applications 3rd edn. McGraw-Hill, New York (1999)
12. Brandt, S., Heikkonen, J., Engelhardt, P.: Automatic alignment of transmission electron microscope tilt series without fiducial markers. J. Struct. Biol. 136, 201-213 (2001)
13. Brandt, S., Heikkonen, J., Engelhardt, P.: Multiphase method for automatic alignment of transmission electron microscope images using markers. J. Struct. Biol. 133(1), 10-22(13) (2001)
14. Brown, L.G.: A survey of image registration techniques. ACM Comput. Surv. 24(4), 325-376 (1992)
15. Chen, Y.K., Chu, A., Cook, J., Green, M.L.H., Harris, P.J.F., Heesom, R., Humphries, M., Sloan, J., Tsang, S.C., Turner, J.F.C.: Synthesis of carbon nanotubes containing metal oxides and metals of the d-block and f-block transition metals and related studies. J. Mater. Chem. 7(3), 545-549 (1997)
16. Chen, Y., Wang, H., Fang, T., Tyan, J.: Mutual information regularized bayesian framework for multiple image restoration. In: IEEE International conference on computer vision (ICCV) (2005)
17. Comaniciu, V., Meer, P.: Kernel-based object tracking. IEEE Trans. on Pattern Anal. Mach. Intell. 25(5), 564-575 (2003)
18. Cornille, N., Garcia, D., Sutton, M., McNeil, S., Orteu, J.: Automated 3-D reconstruction using a scanning electron microscope. In: SEM annual conf. & exp. on experimental and applied mechanics (2003)
19. Dempster, A., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39(1), 1-38 (1977)
20. Drummond, T., Cipolla, R.: Real-time tracking of complex structures with on-line camera calibration. Image Vision Comput. 20(5-6), 427-433 (2002)
21. Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. Commun. of ACM. 15(1), 11-15 (1972)
22. Falvo, M.R., Clary, G., Helser, A.,Paulson, S.,Taylor, R.M.II, Chi, F.P., Brooks, V., Jr, Washburn, S., Superfine, R.: Nanomanipulation experiments exploring frictional and mechanical properties of carbon nanotubes. Micros. Microanal. 4, 504-512 (1998)
23. Falvo, M.R., Taylor, R.M., II, Helser, A., Chi, V., Brooks, F.F., Jr, Washburn, S., Superfin, R.: Nanometre-scale rolling and sliding of carbon nanotubes. Nature 397, 236-238 (1999)
24. Fang, S., Dai, Y., Myers, F., Tuceryan, M., Dunn, K.: Three-dimensional microscopy data exploration by interactive volume visualization. Scanning 22, 218-226 (2000)
25. Farabee, M.: On-line biology book. (http://www.emc.maricopa.edu/faculty/ farabee/BIOBK/BioBookTOC.html (2001)
26. Faugeras, O.: Three-dimensional Computer Vision: a Geometric Viewpoint. MIT Press (1993)
27. Fernandez, J., Lawrence, A., Roca, J., Garcia, I., Ellisman, M., Carazo, J.: High-performance electron tomography of complex biological specimens. J. Struct. Biol. 138, 6-20 (2002)
28. Fernandez, J.-J., Carazo, J.-M., Garcia, I.: Three-dimensional reconstruction of cellular structures by electron microscope tomography and parallel computing. J. Parallel Distrib. Comput. 64(2), 285-300 (2004)
29. Flegler, S.L., Heckman, J.W., Klomparens, K.L.: Scanning and Transmission Electron Microscopy: An Introduction. Oxford Press, Oxford (1995)
30. Gallop, J.: SQUIDs: some limits to measurement. Superconduct. Sci. Technol. 16, 1575-1582 (2003)
31. Garini, Y., Vermolen, B.J., Young, I.T.: From micro to nano: recent advances in high-resolution microscopy. Curr. Opin. Biotechnol. 16(3), 3-12 (2005)
32. Goldstein, J.I., Newbury, D.E., Echlin, P., Joy, D.C., Fiori, C., Lifshin, E.: Scanning Electron Microscopy and X-Ray Microanalysis: A Text for Biologists, Materials Scientists, and Geologists. Plenum Publishing Corporation, New York (1981)
33. Grenander, U., Srivastava, A.: Probability models for clutter in natural images. IEEE Trans. Pattern Anal Mach. Intell. 23(4), 424-429 (2001)
34. Grimellec, C.L., Lesniewska, E., Giocondi, M.-C., Finot, E., Vie, V., Goudonnet, J.-P.: Imaging of the surface of living cells by low-force contact-mode atomic force microscopy. Biophys. J. 75, 695-703 (1998)
35. Guthold, M., Liu, W., Stephens, B., Lord, S.T., Hantgan, R.R., Erie, D.A., Taylor, R.M. II, Superfine, R.: Visualization and mechanical manipulations of individual fibrin fibers. Biophys. J. 87(6), 4226-4236 (2004)
36. Haralick, R.M., Shapiro, L.G.: Computer and Robot Vision. Addison-Wesley Longman Publishing, Boston, (1992)
37. Harauz, G., Fong-Lochovsky, A.: Automatic selection of macromolecules from electron micrographs by component labelling and symbolic processing. Ultramicroscopy 31(4), 333-44 (1989)
38. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, (2000)
39. Heiler, M., Schnörr, C.: Natural image statistics for natural image segmentation. Int. J. Comput. Vision, 63(1), 5-19 (2005)
40. Hell, S.W.: Towards fluorescence nanoscopy. Nat Biotechnol. 21(11), 1347-1355 (2003)
41. Horn, B.: Robot Vision. MIT Press, Cambridge, (1986)
42. Huang, Z., Dikin, D.A., Ding, W., Qiao, Y., Chen, X., Fridman, Y., Ruoff, R.S.: Three-dimensional representation of curved nanowires. J. Micros. 216(3), 206-214 (2004)
43. Ludtke, S.J., Baldwin, P., Chiu, W.: Eman: semiautomated software for high-resolution single-particle reconstructions. J. Struct. Biol. 128, 82-97 (1999)
44. Jacob, M., Blu, T., Unser, M.: 3-D reconstruction of DNA filaments from stereo cryo-electron micrographs. In: Proceedings of the first 2002 IEEE international symposium on biomedical imaging: macro to nano (ISBI'02), vol. II, pp. 597-600. Washington, DC, USA, July 7-10 (2002)
45. Jiang, G., Quan, L., Tsui, H.-T: Circular motion geometry using minimal data. IEEE Trans. Pattern Anal. Mach. Intell. 26(6), 721-731 (2004)
46. Kammerud, C., Abidi, B., Abidi, M.: Computer vision algorithms for 3D reconstruction of microscopic data- a review. Microsc Microanaly. 11, 636-637 (2005)
47. Kim, D.-H., Kim, T., Kim, B.: Motion planning of an afm-based nanomanipulator in a sensor-based nanorobotic manipulation system. In: Proceedings of 2002 international workshop on microfactory, pp. 137-140 (2002)
48. Kubota, T., Talekar, P., Ma, X., Sudarshan, T.S.: A non-destructive automated defect-detection system for silicon carbide wafers. Mach. Vis. Appl. 16(3), 170-176 (2005)
49. Kumar, S., Hebert, M.: Discriminative fields for modeling spatial dependencies in natural images. In:Proceedings of advances in neural information processing systems (NIPS), December (2003)
50. Kumar, S., Chaudhury, K., Sen, P., Guha, S.K.: Atomic force microscopy: a powerful tool for high-resolution imaging of spermatozoa. J. Nanobiotechnol. 3(9), (2005)
51. Lacroute, P., Levoy, M.: Fast volume rendering using a shear-warp factorization of the viewing transformation. In: SIGGRAPH '94: proceedings of the 21st annual conference on computer graphics and interactive techniques, pp. 451-458. ACM press, New York, (1994)
52. Lambert, J.H.: Photometria sive de mensure de gratibus luminis, colorum umbrae. Eberhard Klett, Augsburg (1760)
53. Lee, A.B., Pedersen, K.S., Mumford, D.: The nonlinear statistics of high-contrast patches in natural images. Int. J. Comput. Vis. 54(1-3), 83-103 (2003)
54. Levine, Z.H., Kalukin, A.R., Kuhn, M., Retchi, C.C., Frigo, P., McNulty, I., Wang, Y., Lucatorto, T.B., Ravel, B.D., Tarrio, C.: Tomography of integrated circuit interconnect with an electromigration void. J. Appl.Phys. 87(9), 4483-4488 (2000)
55. Li, S.Z.: Markov random field modeling in computer vision. Springer, London, (1995)
56. Li, G., Xi, N., Yu, M., Fung, W.-K: Development of augmented reality system for afm-based nanomanipulation. IEEE/ASME Trans. Mech. 9(2), 358-365 (2004)
57. Lucic, V., Forster, F., Baumeister, W.: Structural studies by electron tomography: from cells to molecules. Annu. Rev. Biochem. 74, 833-865 (2005)
58. Mallick, S.P., Xu, Y., Kriegman, D.J.: Detecting particles in cryo-em micrographs using learned features. J. Struct. Biol. 145(1-2), 52-62 (2004)
59. Mantooth, B.A., Donhauser, Z.J., Kelly, K.F., Weiss, P.S.: Cross-correlation image tracking for drift correction and adsorbate analysis. Rev. Sci. Instrum. 73, 313-317 (2002)
60. Marco, S., Boudier, T., Messaoudi, C., Rigaud, J.-L.: Electron tomography of biological samples. Biochemistry (Moscow) 69(11), 1219-1225 (2004)
61. McLachlan, G.J., Peel, D.: Robust cluster analysis via mixtures of multivariate t-distributions. InSSPR/SPR, pp. 658-666 (1998)
62. Nicholson, W.V., Glaeser, R.M.: Review: automatic particle detection in electron microscopy. J. Struc. Biol. 133, 90-101 (2001)
63. Nicholson, W.V., Malladi, R.: Correlation-based methods of automatic particle detection in electron microscopy images with smoothing by anisotropic diffusion. J. Micros. 213, 119-128 (2004)
64. NSRG-Chappel Hill: Nanoscale-Science Research Group. http://www.cs.unc. edu/Research/nano/ (2005)
65. Ogura, T., Sato, C.: An automatic particle pickup method using a neural network applicable to low-contrast electron micrographs. J. Struct. Biol. 136(3), 227-238 (2001)
66. Ong, E.W., Razdan, A., Garcia, A.A., Pizziconi, V.B., Ramakrishna, B.L., Glaunsinger, W.S.: Interactive nano-visualization of materials over the internet. J. Chem. Educa. 77(9), 1114-1115 (2000)
67. Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12(7), 629-639 (1990)
68. Pohl, D.W.: Scanning near-field optical microscopy. Advances in Optical and Electron Microscopy. In.: Sheppard, C.J.R., Mulvey, T., (eds.) Vol. 12. Academic, London (1990)
69. Ronneberger, O., Schultz, E., Burkhardt, H.: Automated pollen recognition using 3D volume images from fluorescence microscopy. Aerobiologia 18(2), 107-115 (2002)
70. Rosenfeld, A., Pfaltz, J.: Distance functions on digital pictures. Pattern Recogn 1(1), 33-61 July (1968)
71. Rugar, D., Budakian, R., Mamin, H.J., Chui, B.W.: Single spin detection by magnetic resonance force microscopy. Nature, 430, 329-332, July (2004)
72. Russ, J.C.: The Image Processing Handbook. IEEE Press, New York (1998)
73. Ryu, J., Horn, B.K.P., Mermelstein, M.S., Hong, S., Freedam, D.M.: Application of structured illumination in nanoscale vision. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop: Computer Vision for the Nano Scale, pp. 17-24, June (2003)
74. Sandberg, K., Mastronarde, D.N., Beylkina, G.: A fast reconstruction algorithm for electron microscope tomography. J. Struct. Biol. 144, 61-72 (2003)
75. Scharr, H., Black, M., Haussecker, H.: Image statistics and anisotropic diffusion. In: ICCV03, pp. 840-847 (2003)
76. Scharr, H., Felsberg, M., Forssén, P.-E.: Noise adaptive channel smoothing of low-dose images. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshop: computer vision for the nano scale, June (2003)
77. Scharr, H., Uttenweiler, D.: 3D anisotropic diffusion filtering for enhancing noisy actin filament fluorescence images. In: Proceedings of the 23rd DAGM-symposium on pattern recognition, pp. 69-75. Springer, London, (2001)
78. Sharma, G., Mavroidis, C., Ferreira, A.: Virtual reality and haptics in nano and bionanotechnology, vol. X of Handbook of Theoretical and Computational Nanotechnology, chap. 40. American Scientific Publishers, Stevenson Ranch (2005)
79. Singh, V., Marinescu, D.C., Baker, T.S.: Image segmentation for automatic particle identification in electron micrographs based on hidden markov random field models and expectation maximization. J. Struct. Biol. 145(1-2), 123-141 (2004)
80. Stoscherk, A., Hegerl, R.: Automated detection of macromolecules from electron micrographs using advanced filter techniques. J. Micros. 185, 76-84 (1997)
81. Subramaniam, S.,d Milne, J.L.: Three-dimensional electron microscopy at molecular resolution. Annu. Revi. Biophys. Biomol. Struct. 33, 141-155 (2004)
82. Tan, H.Z., Walker, L., Reifenberger, R., Mahadoo, S., Chiu, G., Raman, A., Helser, A., Colilla, P.: A haptic interface for human-in-the-loop manipulation at the nanoscale. In: Proceedings of the 2005 world haptics conference (WHC05): the first joint euro haptics conference and the symposium on haptic interfaces for virtual environment and teleoperator systems, pp. 271-276 (2005)
83. Tsai, R. Y: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. RA-3(4), 323-344 (1987)
84. Valinetti, A., Fusiello, A., Murino, V.: Model tracking for video-based virtual reality. In: ICIAP, pp. 372-377 (2001)
85. van Heel, M., Gowen, B., Matadeen, R., Orlova, E.V., Finn, R., Pape, T., Cohen, D.: Stark, H., Schmidt, R., Schatz, M., Patwardhan, A.: Single-particle electron cryo-microscopy: towards atomic resolution. Q.Revi. Biophysi. 33(4), 307-369 (2000)
86. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137-154 (2004)
87. Watt, I.M.: The Principles and Practice of Electron Microscopy. Cambridge Press, Cambridge (1997)
88. Weickert, J.: Anisotropic Diffusion in Image Processing. Teubner Verlag, Stuttgart (1997)
89. Xiao, J., Shah, M.: Tri-view morphing. Comput. Vis, Image Understand. 96(3), 345-366 (2004)
90. Yilmaz, A., Shafique, K., Shah, M.: Target tracking in airborne forward looking infrared imagery. Image Vis. Comput. 21(7), 623-635 (2003)
91. Yu, Z., Bajaj, C.: A gravitation-based clustering method and its applications in 3D electron microscopy imaging. In:5th International conference on advances in pattern recognition(ICAPR'03), pp. 137-140 (2003)
92. Yu, Z., Bajaj, C.: Detecting circular and rectangular particles based on geometric feature detection in electron micrographs. J. Struct. Biol. 145, 168-180 (2004)
93. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330-1334 (2000)
94. Zhu, Y., Carragher, B., Kriegman, D., Milligan, R.A., Potter, C.S.: Automated identification of filaments in cryoelectron microscopy images. J. Struct. Biol. 135, 302-321 (2001)
95. Zhu, Y., Carragher, B., Mouche, F., Potter, C.S.: Automatic particle detection through efficient Hough transforms. IEEE Trans Med Imag. 22(9), 1053-1062 (2003)
96. Zhu, Y., Carragher, B., Glaeser, R.M., Fellmann, D., Bajaj, C., Bern, M., Mouche, F., de Haas, F., Hall, R. J., Kriegman, D.J., Ludtke, S.C., Mallick, S. P., Penczek, P.A., Roseman, A.M., Sigworth, F.J., Volkmann, N., Potter, C.S.: Automatic particle selection: Results of a comparative study. J. Struct. Biolo. 145, 3-14 (2004)