Towards fully automatic reliable 3D acquisition: From designing imaging network to a complete and accurate point cloud

Robotics and Autonomous Systems

Volumn 62, Issue 8, 2014, Pages 1197-1207

  Ali Hosseininaveh, A ^a   Sargeant, Ben ^a   Erfani, Tohid ^a   Robson, Stuart ^a   Shortis, Mark ^a   Hess, Mona ^a   Boehm, Jan ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Automatic 3D acquisition; Inverse kinematics; Kinect fusion; Multi view stereo; Particle Swarm Optimization; Stereo imaging network

Indexed keywords

FACE RECOGNITION; IMAGE MATCHING; INVERSE KINEMATICS; PARTICLE SWARM OPTIMIZATION (PSO); STEREO IMAGE PROCESSING; ALGORITHMS; COMPLEX NETWORKS; DEGREES OF FREEDOM (MECHANICS); KINEMATICS;

3-D ACQUISITIONS; 3D RECONSTRUCTION; APPROXIMATE MODEL; INCIDENCE ANGLES; MATCHING ALGORITHM; MULTI-VIEW STEREO; SIX DEGREE-OF-FREEDOM; STEREO IMAGING;

COMPLEX NETWORKS; STEREO IMAGE PROCESSING;

EID: 84902214982     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2014.04.001     Document Type: Article

References (70)

1. F. Remondino, and S. El-Hakim Image-based 3D modelling: a review Photogramm. Rec. 21 2006 269 291
2. G. Sansoni, M. Trebeschi, and F. Docchio State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation Sensors 9 2009 568 601 10.3390/s90100568
3. F. Remondino Heritage recording and 3D modeling with photogrammetry and 3D scanning Remote Sens. 3 2011 1104 1138 10.3390/rs3061104
4. Y. Chang, I. Detchev, A. Habib, A photogrammetric system for 3D reconstruction of a Scoliotic Torso (No. 20274), A Master Thesis, Department of Geomatics Engineering, University of Calgary, Canada, 2008.
5. N. D'Apuzzo, A. Gruen, Recent advances in 3D full body scanning with applications to fashion and apparel, in: 9th Conference of Optical 3-D Measurement Techniques. Vienna, Austria, 2009, p. 10.
6. P. Beardsley, P. Torr, A. Zisserman, 3D model acquisition from extended image sequences, in: Comput. Vis. ECCV, 1996, pp. 683-695.
7. M. Pollefeys, R. Koch, and L.V. Gool Self-calibration and metric reconstruction inspite of varying and unknown intrinsic camera parameters Int. J. Comput. Vis. 32 1999 7 25
8. X. Hao, H. Mayer, Orientation and auto-calibration of image triplets and sequences, in: Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. 34, 2003, pp. 73-78.
9. A.R. Dick, P.H.S. Torr, and R. Cipolla Modelling and interpretation of architecture from several images Int. J. Comput. Vis. 60 2004 111 134
10. D. Nister, Automatic passive recovery of 3D from images and video, in: International Symposium on 3D Data Processing, Visualization and Transmission, 3DPVT, Thessaloniki, Greece, 2004, pp. 438-445. http://dx.doi.org/10.1109/TDPVT. 2004.1335271.
11. S. Agarwal, N. Snavely, I. Simon, S.M. Seitz, R. Szeliski, Building Rome in a day, in: IEEE Conference on Computer Vision, ICCV, Kyoto, 2009, pp. 72-79.
12. A. Hosseininaveh Ahmadabadian, S. Robson, J. Boehm, M. Shortis, K. Wenzel, and D. Fritsch A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs ISPRS J. Photogramm. Remote Sens. 78 2013 157 167 10.1016/j.isprsjprs.2013.01.015
13. F. Blais Review of 20 years of range sensor development J. Electron. Imaging 13 2004
14. F. Remondino, and D. Stoppa TOF Range-imaging Cameras 2013 Springer Berlin, New York
15. S. Mahadevan, H. Pandzo, M. Bennamoun, J.A. Williams, A 3D acquisition and modelling system, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, 2001, pp. 1941-1944. http://dx.doi.org/10.1109/ICASSP.2001.941326.
16. W. Scott, G. Roth, and J.-F. Rivest View planning for automated 3D object reconstruction inspection ACM Comput. Surv. 35 2003
17. V.H. Chan, M. Samaan, Spherical/cylindrical laser scanner for geometric reverse engineering, in: SPIE Three-Dimens. Image Capture Appl. VI, 2004, pp. 33-40. http://dx.doi.org/10.1117/12.525181.
18. X. Zexiao, W. Jianguo, and Z. Qiumei Complete 3D measurement in reverse engineering using a multi-probe system Int. J. Mach. Tools Manuf. 45 2005 1474 1486 10.1016/j.ijmachtools.2005.01.028
19. G. Paul, S. Webb, D. Liu, and G. Dissanayake Autonomous robot manipulator-based exploration and mapping system for bridge maintenance Robot. Auton. Syst. 59 2011 543 554 10.1016/j.robot.2011.04.001
20. M. Karaszewski, R. Sitnik, and E. Bunsch On-line, collision-free positioning of a scanner during fully automated three-dimensional measurement of cultural heritage objects Robot. Auton. Syst. 60 2012 1205 1219 10.1016/j.robot.2012.05.005
21. H. Zhuang, K. Wang, and Z.S. Roth Simultaneous calibration of a robot and a hand-mounted camera IEEE Trans. Robot. Autom. 11 1995 649 660 10.1109/70.466601
22. S.Y. Chen, and Y.F. Li Automatic sensor placement for model-based robot vision IEEE Trans. Syst. Man Cybern. Part B Cybern. 34 2004 393 408
23. S. Larsson, and J.A.P. Kjellander Path planning for laser scanning with an industrial robot Robot. Auton. Syst. 56 2008 615 624 10.1016/j.robot.2007.10. 006
24. A. Kasper, Z. Xue, and R. Dillmann Semi automatic object modeling for a service robot E. Prassler, M. Zöllner, R. Bischoff, W. Burgard, R. Haschke, M. Hägele, G. Lawitzky, B. Nebel, P. Plöger, U. Reiser, Towards Service Robots for Everyday Environments Springer Tracts in Advanced Robotics 2012 Springer Berlin, Heidelberg 167 179
25. S.R. Palma, B.C. Becker, C.N. Riviere, Simultaneous calibration of stereo vision and 3D optical tracker for robotic microsurgery, in: Bioengineering Conference, NEBEC, Philadelphia, PA, USA, 2012, pp. 351-352. http://dx.doi.org/10.1109/NEBC.2012.6207109.
26. M. Callieri, A. Fasano, G. Impoco, P. Cignoni, R. Scopigno, G. Parrini, G. Biagini, RoboScan: an automatic system for accurate and unattended 3D scanning, in: 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 3DPVT. Thessaloniki, Greece, 2004, pp. 805-812. http://dx.doi.org/10.1109/TDPVT.2004.1335398.
27. Kawasaki Robotics, 2013. Kawasaki Robot. URL: http://www. kawasakirobotics.com/products/?page=robots (accessed: 5.26.13).
28. I. Ainsworth, M. Ristic, and D. Brujic CAD-based measurement path planning for free-form shapes using contact probes Int. J. Adv. Manuf. Technol. 16 2000 23 31 10.1007/PL00013128
29. R.A. Newcombe, A.J. Davison, S. Izadi, P. Kohli, O. Hilliges, J. Shotton, D. Molyneaux, S. Hodges, D. Kim, A. Fitzgibbon, KinectFusion: real-time dense surface mapping and tracking, in: IEEE International Symposium on Mixed and Augmented Reality, ISMAR, Basel, 2011, pp. 127-136. http://dx.doi.org/10.1109/ ISMAR.2011.6092378.
30. PrimeSense, 2013. The PrimeSense 3D Awareness Sensor [WWW Document]. URL: http://www.primesense.com/wp-content/uploads/2012/12/PrimeSense-3D-Sensor-A4- Lo.pdf (accessed: 5.7.13).
31. C. Heindl, C. Kopf, ReconstructMe [WWW Document], 2012. URL: http://reconstructme.net.
32. N. Tisserand, N. Burrus, Skanect by Manctl 3D Scanning Made Easy [WWW Document], 2012. URL: http://skanect.manctl.com/ (accessed: 6.18.13).
33. PCL, 2011. PCL - Point Cloud Library (PCL) [WWW Document]. URL: http://pointclouds.org/ (accessed: 6.18.13).
34. C.S. Varma, C. Nittala, Matherix Labs [WWW Document], 2012. URL: http://www.matherix.com/ (accessed: 6.18.13).
35. J. Boehm, Natural user interface sensors for human body measurement, in: ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. XXXIX-B3, 2012, pp. 531-536. http://dx.doi.org/10.5194/isprsarchives-XXXIX-B3-531-2012.
36. L. Marc, The Stanford Spherical Gantry [WWW Document], Stanf. Spherical Gantry, 2002. URL: http://graphics.stanford.edu/projects/gantry/ (accessed: 4.15.13).
37. F. Farshidi, S. Sirouspour, and T. Kirubarajan Robust sequential view planning for object recognition using multiple cameras Image Vis. Comput. 27 2009 1072 1082 10.1016/j.imavis.2008.09.009
38. W. Scott Model-based view planning Mach. Vis. Appl. 20 2009 47 69 10.1007/s00138-007-0110-2
39. W.R. Scott, G. Roth, and J.-F. Rivest View planning for automated three-dimensional object reconstruction and inspection ACM Comput. Surv. 35 2003 64 96 10.1145/641865.641868
40. M. Saadatseresht, C.S. Fraser, F. Samadzadegan, and A. Azizi Visibility analysis in vision metrology network design Photogramm. Rec. 19 2004 219 236
41. M. Saadatseresht, and F. Samadzadegan Multi-objective optimization of vision metrology camera placement based on pareto front concept by NSGA-II method J. Fac. Eng. Univ. Tehran 42 2008 313 326
42. M. Saadatseresht, and M. Varshosaz Visibility prediction based on artificial neural networks used in automatic network design Photogramm. Rec. 22 2007 336 355 10.1111/j.1477-9730.2007.00454.x
43. G. Olague, and E. Dunn Development of a practical photogrammetric network design using evolutionary computing Photogramm. Rec. 22 2007 22 38
44. S. Mason Expert system-based design of close-range photogrammetric networks ISPRS J. Photogramm. Remote Sens. 50 1995 13 24 10.1016/0924-2716(95) 90117-W
45. E. Dunn, J.M. Frahm, Next best view planning for active model improvement, in: British Machine Vision Conference. London, UK, 2009, pp. 1-11.
46. B.S. Alsadik, M. Gerke, G. Vosselman, Optimal camera network design for 3D modeling of cultural heritage, in: ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. 1-3, 2012, pp. 7-12. http://dx.doi.org/10.5194/isprsannals-I-3- 7-2012.
47. A. Hosseininaveh Ahmadabadian, S. Robson, J. Böehm, M. Shortis, Image selection in photogrammetric multi-view stereo methods for metric and complete 3D reconstruction, in: SPIE 8791 Videometrics Range Imaging Appl. XII Autom. Vis. Insp. 8791, 2013, pp. 7-18. http://dx.doi.org/10.1117/12.2020472.
48. A. Hosseininaveh Ahmadabadian, M. Serpico, S. Robson, M. Hess, J. Boehm, I. Pridden, G. Amati, Automatic image selection in photogrammetric multi-view stereo methods, in: Eurographics EG Eur. Assoc. Comput. Graph., 2012, pp. 9-16. http://dx.doi.org/10.2312/VAST/VAST12/009-016.
49. B. Alsadik, M. Gerke, and G. Vosselman Automated camera network design for 3D modeling of cultural heritage objects J. Cult. Herit. 2012 10.1016/j.culher.2012.11.007
50. A.L. Olsen, and H.G. Petersen Inverse kinematics by numerical and analytical cyclic coordinate descent Robotica 29 2011 619 626 10.1017/S026357471000038X
51. S.R. Buss Introduction to inverse kinematics with Jacobian transpose, pseudo inverse and damped least squares methods IEEE J. Robot. Autom. 17 2004
52. Z.-Q. Hu, Z.-G. Fu, H.-R. Fang, Study of singularity robust inverse of jacobian matrix for manipulator, in: International Conference on Machine Learning and Cybernetics. Beijing, China, Vol. 1, 2002, pp. 406-410. http://dx.doi.org/10.1109/ICMLC.2002.1176785.
53. C.W. Wampler Manipulator inverse kinematic solutions based on vector formulations and damped least-squares methods IEEE Trans. Syst. Man Cybern. 16 1986 93 101 10.1109/TSMC.1986.289285
54. W. Shen, J. Gu, E.E. Milios, Self-configuration fuzzy system for inverse kinematics of robot manipulators, in: Annual Meeting of the North American Fuzzy Information Processing Society, NAFIPS, Montreal, Que, 2006, pp. 41-45. http://dx.doi.org/10.1109/NAFIPS.2006.365856.
55. Z. Bingul, H.M. Ertunc, C. Oysu, Comparison of inverse kinematics solutions using neural network for 6R robot manipulator with offset, in: ICSC Congress on Computational Intelligence Methods and Applications, Istanbul, 2005, p. 5. http://dx.doi.org/10.1109/CIMA.2005.1662342.
56. D.T. Pham, M. Castellani, A.A. Fahmy, Learning the inverse kinematics of a robot manipulator using the Bees algorithm, in: IEEE International Conference on Industrial Informatics, Daejeon, South Korea, 2008, pp. 493-498. http://dx.doi.org/10.1109/INDIN.2008.4618151.
57. Y. Yang, G. Peng, Y. Wang, H. Zhang, A new solution for inverse kinematics of 7-DOF manipulator based on genetic algorithm, in: IEEE International Conference on Automation and Logistics. Jinan, China, 2007, pp. 1947-1951. http://dx.doi.org/10.1109/ICAL.2007.4338892.
58. H.-C. Huang, C.-P. Chen, P.-R. Wang, Particle swarm optimization for solving the inverse kinematics of 7-DOF robotic manipulators, in: Presented at the IEEE International Conference on Systems, Man, and Cybernetics, SMC, Seoul, South Korea, 2012, pp. 3105-3110. http://dx.doi.org/10.1109/ICSMC.2012.6378268.
59. B. Sargeant, A. Hosseininaveh Ahmadabadian, T. Erfani, S. Robson, J. Boehm, A Webcam photogrammetric method for robot calibration, in: SPIE. Presented at the Videometrics, Range Imaging, and Applications XII, 2013, p. 13. http://dx.doi.org/10.1117/12.2020484.
60. W. Forstner, Computer vision and photogrammetry: mutual questions: geometry, statistics and cognition, in: Bild. Sci. Swed. Soc. Photogramm. Remote Sens., 2002, pp. 151-164.
61. R. Godding, T. Luhmann, A. Wendt, 4D Surface Matching for High-speed Stereo Sequences, in: ISPRS Symp. Comm. V Dresd. 2.2.2, 2006.
62. Z. Xiao, J. Liang, D. Yu, Z. Tang, and A. Asundi An accurate stereo vision system using cross-shaped target self-calibration method based on photogrammetry Opt. Lasers Eng. 48 2010 52 61 10.1016/j.optlaseng.2010.06.006
63. P. Grussenmeyer, and O.A. Khalil Solutions for exterior orientation in photogrammetry: a review Photogramm. Rec. 17 2002 615 634 10.1111/j.1477-9730. 2002.tb01907.x
64. D. Fritsch, A.M. Khosravani, A. Cefalu, K. Wenzel, Multi-sensors and multi-ray reconstruction for digital preservation, in: Photogrammetric Week 2011. Institute for Photogrammetry, Stuttgart, Germany, 2011, pp. 305-323.
65. Y. Furukawa, and J. Ponce Accurate, dense, and robust multi-view stereopsis IEEE Trans. Pattern Anal. Mach. Intell. 32 2009 1362 1376
66. M. Shortis, S. Robson, VMS User Guide [WWW Document], 2013. URL: http://www.geomsoft.com.au/VMS/index.html (accessed: 10.2.13).
67. J.L. Awange, K.-H. Bae, and S.J. Claessens Procrustean solution of the 9-parameter transformation problem Earth Planets Space 60 2008 529 537
68. N. Snavely, S.M. Seitz, and R. Szeliski Modeling the world from Internet photo collections Int. J. Comput. Vis. 80 2008 189 210
69. F. Remondino, S.D. Pizzo, T.P. Kersten, and S. Troisi Low-cost and open-source solutions for automated image orientation - a critical overview M. Ioannides, D. Fritsch, J. Leissner, R. Davies, F. Remondino, R. Caffo, Progress in Cultural Heritage Preservation Lecture Notes in Computer Science 2012 Springer Berlin, Heidelberg 40 54
70. Arius Technologies (Arius3D), 2014. URL: http://www.ariustechnology.com/ (accessed: 3.30.14).