Structured light-based 3D reconstruction system for plants

Sensors (Switzerland)

Volumn 15, Issue 8, 2015, Pages 18587-18612

  Nguyen, Thuy Tuong ^a   Slaughter, David C ^b   Max, Nelson ^a   Maloof, Julin N ^c   Sinha, Neelima ^c  

^a Davis   (United States)

^b University of California   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

3D feature extraction; 3D reconstruction; Plant phenotyping; Point cloud; Stereo vision; Structured light

Indexed keywords

COMPUTER HARDWARE; COMPUTER VISION; FEATURE EXTRACTION; HARDWARE; IMAGE RECONSTRUCTION; PLANTS (BOTANY); STEREO VISION;

3-D FEATURE EXTRACTION; 3D RECONSTRUCTION; PLANT PHENOTYPING; POINT CLOUD; STRUCTURED LIGHT;

STEREO IMAGE PROCESSING;

SOIL;

ALGORITHM; ANATOMY AND HISTOLOGY; BRASSICA; CUCUMBER; LIGHT; ORGAN SIZE; PHENOTYPE; PLANT; PLANT LEAF; PROCEDURES; SOIL; THREE DIMENSIONAL IMAGING; TOMATO;

ALGORITHMS; BRASSICA; CUCUMIS SATIVUS; IMAGING, THREE-DIMENSIONAL; LIGHT; LYCOPERSICON ESCULENTUM; ORGAN SIZE; PHENOTYPE; PLANT LEAVES; PLANTS; SOIL;

EID: 84938411714     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s150818587     Document Type: Article

References (42)

1. Dhondt, S.; Wuyts, N.; Inze, D. Cell to whole-plant phenotyping: The best is yet to come. Trends Plant Sci. 2013, 18, 428–439.
2. Furbank, R.T.; Tester, M. Phenomics-technologies to relieve the phenotyping bottleneck. Trends Plant Sci. 2011, 16, 635–644.
3. Scotford, I.M.; Miller, P.C.H. Applications of spectral reflectance techniques in northern European cereal production: A review. Biosyst. Eng. 2005, 90, 235–250.
4. Garrido, M.; Perez-Ruiz, M.; Valero, C.; Gliever, C.J.; Hanson, B.D.; Slaughter, D.C. Active optical sensors for tree stem detection and classification in nurseries. Sensors 2014, 14, 10783–10803.
5. Slaughter, D.C.; Giles, D.K.; Downey, D. Autonomous robotic weed control systems: A review. Comput. Electron. Agric. 2008, 61, 63–78.
6. Cui, Y.; Schuon, S.; Chan, D.; Thrun, S.; Theobalt, C. 3D shape scanning with a time-of-flight camera. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, 13–18 June 2010; pp. 1173–1180.
7. Wu, C. Towards linear-time incremental structure from motion. In Proceedings of the 2013 International Conference on 3D Vision, Seattle, WA, USA, 29 June–1 July 2013; pp. 127–134.
8. Li, J.; Miao, Z.; Liu, X.; Wan, Y. 3D reconstruction based on stereovision and texture mapping. In Proceedings of the ISPRS Technical Commission III Symposium, Photogrammetric Computer Vision and Image Analysis, Paris, France, 1–3 September 2010; pp. 1–6.
9. Brandou, V.; Allais, A.; Perrier, M.; Malis, E.; Rives, P.; Sarrazin, J.; Sarradin, P.M. 3D reconstruction of natural underwater scences using the stereovision system IRIS. In Proceedings of the Europe OCEANS, Aberdeen, Hong Kong, China, 18–21 June 2007; pp. 1–6.
10. Zhang, Z. Microsoft Kinect sensor and its effect. IEEE Multimed. 2012, 19, 4–12.
11. Newcombe, R.A.; Davison, A.J.; Izadi, S.; Kohli, P.; Hilliges, O.; Shotton, J.; Molyneaux, D.; Hodges, S.; Kim, D.; Fitzgibbon, A., et al. KinectFusion: Real-time dense surface mapping and tracking. In Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland, 26–29 October 2011; pp. 127–136.
12. Ni, Z.; Burks, T.F.; Lee, W.S. 3D reconstruction of small plant from multiple views. In Proceedings of the ASABE and CSBE/SCGAB Annual International Meeting, Montreal, QC, Canada, 13–16 July 2014.
13. Alenya, G.; Dellen, B.; Torras, C. 3D modelling of leaves from color and ToF data for robotized plant measuring. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011; pp. 3408–3414.
14. Song, Y.; Glasbey, C.A.; Polder, G.; van der Heijden, G.W.A.M. Non-destructive automatic leaf area measurements by combining stereo and time-of-flight images. IEEE Multimed. 2014, 8, 391–403.
15. Azzari, G.; Goulden, M.L.; Rusu, R.B. Rapid characterization of vegetation structure with a Microsoft Kinect sensor. Sensors 2013, 13, 2384–2398.
16. Rusu, R.B.; Cousins, S. 3D is here: Point cloud library (PCL). In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011; pp. 1–4.
17. Li, D.; Xu, L.; Tan, C.; Goodman, E.D.; Fu, D.; Xin, L. Digitization and visualization of greenhouse tomato plants in indoor environments. Sensors 2015, 15, 4019–4051.
18. Chene, Y.; Rousseau, D.; Lucidarme, P.; Bertheloot, J.; Caffier, V.; Morel, P.; Belin, E.; Chapeau-Blondeau, F. On the use of depth camera for 3D phenotyping of entire plants. Comput. Electron. Agric. 2012, 82, 122–127.
19. Paproki, A.; Sirault, X.; Berry, S.; Furbank, R.; Fripp, J. A novel mesh processing based technique for 3D plant analysis. BMC Plant Biol. 2012, 12, 1–13.
20. Baumberg, A.; Lyons, A.; Taylor, R. 3D S.O.M.—A commercial software solution to 3D scanning. Graph. Models 2005, 67, 476–495.
21. Andujar, D.; Fernandez-Quintanilla, C.; Dorado, J. Matching the best viewing angle in depth cameras for biomass estimation based on poplar seedling geometry. Sensors 2015, 15, 12999–13011.
22. Rose, J.C.; Paulus, S.; Kuhlmann, H. Accuracy analysis of a multi-view stereo approach for phenotyping of tomato plants at the organ level. Sensors 2015, 15, 9651–9665.
23. Polder, G.; Hofstee, J.W. Phenotyping large tomato plants in the greenhouse using a 3D light-field camera. In Proceedings of the ASABE and CSBE/SCGAB Annual International Meeting, Montreal, QC, Canada, 13–16 July 2014.
24. Paulus, S.; Dupuis, J.; Mahlein, A.K.; Kuhlmann, H. Surface feature based classification of plant organs from 3D laser scanned point clouds for plant phenotyping. BMC Bioinform. 2013, 14, 1–12.
25. Paulus, S.; Dupuis, J.; Riedel, S.; Kuhlmann, H. Automated analysis of barley organs using 3D laser scanning: An approach for high throughput phenotyping. Sensors 2014, 14, 12670–12686.
26. digiCamControl—Free Windows DSLR Camera Controlling Solution. Available online: http://digicamcontrol.com(accessed on 24 July 2015).
27. Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334.
28. Bouguet, J.Y. Camera Calibration Toolbox for Matlab; California Institute of Technology: Pasadena, CA, USA, 2013.
29. Comaniciu, D.; Meer, P. Mean shift: A robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 603–619.
30. Men, L.; Huang, M.; Gauch, J. Accelerating mean shift segmentation algorithm on hybrid CPU/GPU platforms. In Proceedings of the International Workshop Modern Accelerator Technologies for GIScience, Columbus, OH, USA, 18–21 September 2012.
31. Felzenszwalb, P.F.; Huttenlocher, D.P. Efficient belief propagation for early vision. Int. J. Comput. Vis. 2006, 70, 972–986.
32. Nguyen, V.D.; Nguyen, T.T.; Nguyen, D.D.; Lee, S.J.; Jeon, J.W. A fast evolutionary algorithm for real-time vehicle detection. IEEE. Trans. Veh. Technol. 2013, 62, 2453–2468.
33. Taniai, T.; Matsushita, Y.; Naemura, T. Graph cut based continuous stereo matching using locally shared labels. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, 23–28 June 2014.
34. Nguyen, V.D.; Nguyen, T.T.; Nguyen, D.D.; Jeon, J.W. Adaptive ternary-derivative pattern for disparity enhancement. In Proceedings of the 19th IEEE International Conference on Image Processing (ICIP), Orlando, FL, USA, 30 September–3 October 2012; pp. 2969–2972.
35. Nguyen, V.D.; Nguyen, D.D.; Nguyen, T.T.; Dinh, V.Q.; Jeon, J.W. Support local pattern and its application to disparity improvement and texture classification. IEEE Trans. Circuit Syst. Video Technol. 2014, 24, 263–276.
36. Yang, Q.; Wang, L.; Ahuja, N. A constant-space belief propagation algorithm for stereo matching. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, 13–18 June 2010; pp. 1458–1465.
37. Aiger, D.; Mitra, N.J.; Cohen-Or, D. 4-Points congruent for robust surface registration. ACM Trans. Graph. 2008, 27, 1–10.
38. Rusu, R.B. Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments. PhD Thesis, Computer Science Department, Technische Universitaet Muenchen, Munich, Germany, 2009.
39. Heijden, G.; Song, Y.; Horgan, G.; Polder, G.; Dieleman, A.; Bink, M.; Palloix, A.; Eeuwijk, F.; Glasbey, C. SPICY: Towards automated phenotyping of large pepper plants in the greenhouse. Funct. Plant Biol. 2012, 39, 870–877.
40. MeshLab. Available online: http://meshlab.sourceforge.net(accessed on 24 July 2015).
41. Pix4D UAV Mapping Photogrammetry Software, Pix4Dmapper. Available online: https://pix4d.com(accessed on 24 July 2015).
42. Skanect 3D Scanning Software by Occipital. Available online: http://skanect.occipital.com (accessed on 24 July 2015).