Cloud-based networked visual servo control

IEEE Transactions on Industrial Electronics

Volumn 60, Issue 2, 2013, Pages 554-566

  Wu, Haiyan ^a,b   Lou, Lei ^a   Chen, Chih Chung ^a,c   Hirche, Sandra ^a   Kuhnlenz, Kolja ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^c ASML   (Netherlands)

Author keywords

Cloud computing; control with time varying time delay; networked visual servo control (NVSC); real time image transmission; sending rate scheduling

Indexed keywords

CLOUD COMPUTING; CONTROL THEORY; DELAY CONTROL SYSTEMS; IMAGE PROCESSING; PNEUMATIC CONTROL EQUIPMENT; SCHEDULING; VISUAL COMMUNICATION;

COMPUTATIONAL RESOURCES; DUAL-ARM ROBOT; IMAGE DATA; OBJECT TRACKING; PERFORMANCE DEGRADATION; REAL TIME TRANSPORT PROTOCOLS; SAMPLING RATES; SCHEDULING STRATEGIES; SENDING RATE; STABILIZING CONTROL LAW; TIME VARYING; TIME-VARYING FEEDBACK; VISION BASED; VISION BASED CONTROL; VISUAL FEEDBACK; VISUAL SERVO CONTROL;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84866548197     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2012.2186775     Document Type: Article

References (69)

1. Y. Shirai and H. Inoue, "Guiding a robot by visual feedback in assembling tasks," Pattern Recognit., vol. 5, no. 2, pp. 99-106, Jun. 1973.
2. L. Weiss, A. Sanderson, and C. Neuman, "Dynamic sensor-based control of robots with visual feedback," IEEE J. Robot. Autom., vol. RA-3, no. 5, pp. 404-417, Oct. 1987. (Pubitemid 18568086)
3. K. Hashimoto, Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback. Singapore: World Scientific, 1993.
4. P. Corke, "Visual control of robot manipulators - A review," in Visual Servoing. Singapore: World Scientific, 1994, pp. 1-31.
5. F. Chaumette and S. Hutchinson, "Visual servo control. I. Basic approaches," IEEE Robot. Autom. Mag., vol. 13, no. 4, pp. 82-90, Dec. 2006. (Pubitemid 46454544)
6. S. Funiak, C. Guestrin, M. Paskin, and R. Sukthankar, "Distributed localization of networked cameras," in Proc. 5th Int. Conf. Inform. Process. Sens. Netw., 2006, pp. 34-42.
7. B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, andM. Levoy, "High performance imaging using large camera arrays," ACM Trans. Graph. (TOG), vol. 24, no. 3, pp. 765- 776, Jul. 2005.
8. B. Weber and K. Kühnlenz, "Visual servoing using triangulation with an omnidirectional multi-camera system," in Proc. ICARCV, 2010, pp. 1440-1445.
9. F. Chaumette, "Image moments: A general and useful set of features for visual servoing," IEEE Trans. Robot., vol. 20, no. 4, pp. 713-723, Aug. 2004.
10. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
11. M. Nixon and A. Aguado, Feature Extraction and Image Processing. New York: Academic, 2008.
12. S. Hutchinson, G. Hager, and P. Corke, "A tutorial on visual servo control," IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 651-670, Oct. 1996. (Pubitemid 126786243)
13. E. Malis, F. Chaumette, and S. Boudet, "2 1/2 d visual servoing," IEEE Trans. Robot. Autom., vol. 15, no. 2, pp. 238-250, Apr. 1999.
14. P. Corke and M. Good, "Dynamic effects in visual closed-loop systems," IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 671-683, Oct. 1996. (Pubitemid 126786244)
15. N. Gans and S. Hutchinson, "Stable visual servoing through hybrid switched-system control," IEEE Trans. Robot., vol. 23, no. 3, pp. 530- 540, Jun. 2007. (Pubitemid 47062028)
16. H. Wu, T. Zhang, A. Borst, K. Kühnlenz, and M. Buss, "An explorative study of visual servo control with insect-inspired Reichardt-model," in Proc. IEEE ICRA, 2009, pp. 345-350.
17. H. Bay, T. Tuytelaars, and L. Van Gool, "Surf: Speeded up robust features," in Proc. ECCV, 2006, pp. 404-417. (Pubitemid 44029795)
18. A. Namiki, Y. Nakabo, I. Ishii, and M. Ishikawa, "High speed grasping using visual and force feedback," in Proc. IEEE ICRA, 1999, vol. 4, pp. 3195-3200.
19. T. Zhang, H. Wu, A. Borst, K. Kühnlenz, and M. Buss, "An FPGA implementation of insect-inspired motion detector for high-speed vision systems," in Proc. IEEE ICRA, 2008, pp. 335-340.
20. T. Xu, T. Pototschnig, K. Kühnlenz, and M. Buss, "A high-speed multi- GPU implementation of bottom-up attention using CUDA," in Proc. IEEE ICRA, 2009, pp. 41-47.
21. V. Sunderam, "PVM: A framework for parallel distributed computing," Concurrency Pract. Experience, vol. 2, no. 4, pp. 315-339, Dec. 1990.
22. D. Henrich and T. Honiger, "Parallel processing approaches in robotics," in Proc. IEEE ISIE, 1997, vol. 2, pp. 702-707.
23. R. Buyya, High Performance Cluster Computing: Architectures and Systems, Volume 1, vol. 82. Englewood Cliffs, NJ: Prentice-Hall, 1999, pp. 327-350.
24. X. Li, B. Veeravalli, and C. Ko, "Distributed image processing on a network of workstations," Int. J. Comput. Appl., vol. 25, no. 2, pp. 136- 145, 2003.
25. H. Wu, L. Lou, C. Chen, S. Hirche, and K. Kühnlenz, "A framework of networked visual servo control system with distributed computation," in Proc. 11th ICARCV, 2010, pp. 1466-1471.
26. H. Li, B. Manjunath, and S. Mitra, "Multisensor image fusion using the wavelet transform," Graph. Models Image Process., vol. 57, no. 3, pp. 235-245, May 1995.
27. G. Cena and A. Valenzano, "An improved CAN fieldbus for industrial applications," IEEE Trans. Ind. Electron., vol. 44, no. 4, pp. 553-564, Aug. 1997. (Pubitemid 127828684)
28. E. Tovar and F. Vasques, "Real-time fieldbus communications using profibus networks," IEEE Trans. Ind. Electron., vol. 46, no. 6, pp. 1241- 1251, Dec. 1999. (Pubitemid 30527862)
29. T. Yang, "Networked control system: A brief survey," Proc. Inst. Elect. Eng. - Control Theory Appl., vol. 153, no. 4, pp. 403-412, Jul. 2006. (Pubitemid 43781893)
30. J. Wang and B. Ravindran, "Time-utility function-driven switched ethernet: Packet scheduling algorithm, implementation, and feasibility analysis," IEEE Trans. Parallel Distrib. Syst., vol. 15, no. 2, pp. 119-133, Feb. 2004.
31. D. Jansen and H. Buttner, "Real-time Ethernet: The EtherCAT solution," Comput. Control Eng., vol. 15, no. 1, pp. 16-21, Feb./Mar. 2004.
32. J. Feld, "Profinet-scalable factory communication for all applications," in Proc. IEEE Int. Workshop Fact. Commun. Syst., 2004, pp. 33-38. (Pubitemid 40575202)
33. G. Walsh and H. Ye, "Scheduling of networked control systems," IEEE Control Syst. Mag., vol. 21, no. 1, pp. 57-65, Feb. 2001. (Pubitemid 32869526)
34. D. Henriksson and A. Cervin, "Optimal on-line sampling period assignment for real-time control tasks based on plant state information," in Proc. 44th IEEE CDC, 2005, pp. 4469-4474.
35. M. Gaid, A. Çela, and Y. Hamam, "Optimal integrated control and scheduling of networked control systems with communication constraints: Application to a car suspension system," IEEE Trans. Control Syst. Technol., vol. 14, no. 4, pp. 776-787, Jul. 2006. (Pubitemid 43983620)
36. P. Otanez, J. Moyne, and D. Tilbury, "Using deadbands to reduce communication in networked control systems," in Proc. Amer. Control Conf., 2002, vol. 4, pp. 3015-3020.
37. S. Hirche, P. Hinterseer, E. Steinbach, and M. Buss, "Towards deadband control in networked teleoperation systems," in Proc. IFAC, Prague, Czech Republic, 2005.
38. K. Åström and B. Bernhardsson, "Comparison of Riemann and Lebesgue sampling for first order stochastic systems," in Proc. 41st IEEE Conf. Decision Control, 2002, vol. 2, pp. 2011-2016.
39. A. Molin and S. Hirche, "On LQG joint optimal scheduling and control under communication constraints," in Proc. 48th IEEE CDC, 2009, pp. 5832-5838.
40. A. Molin and S. Hirche, "Structural characterization of optimal eventbased controllers for linear stochastic systems," in Proc. 49th IEEE CDC, 2010, pp. 3227-3233.
41. A. Molin and S. Hirche, "On the optimality of certainty equivalence for event-triggered control systems," IEEE Trans. Autom. Control, 2012, to be published.
42. K. Shin and X. Cui, "Computing time delay and its effects on realtime control systems," IEEE Trans. Control Syst. Technol., vol. 3, no. 2, pp. 218-224, Jun. 1995.
43. T. Chen and B. Francis, Optimal Sampled-Data Control Systems, vol. 124. London, U.K.: Springer-Verlag, 1995.
44. L. Xiao, A. Hassibi, and J. How, "Control with random communication delays via a discrete-time jump system approach," in Proc. Amer. Control Conf., 2000, vol. 3, pp. 2199-2204. (Pubitemid 32028348)
45. L. Zhang, Y. Shi, T. Chen, and B. Huang, "A new method for stabilization of networked control systems with random delays," IEEE Trans. Autom. Control, vol. 50, no. 8, pp. 1177-1181, Aug. 2005. (Pubitemid 41410115)
46. C. Chen, S. Hirche, andM. Buss, "Controller design and experimental validation for networked control systems with time-varying random delay," J. Soc. Instrum. Control Eng., vol. 47, no. 8, pp. 676-685, 2008.
47. S. Hirche, C. Chen, and M. Buss, "Performance oriented control over networks: Switching controllers and switched time delay," Asian J. Control, vol. 10, no. 1, pp. 24-33, Jan. 2008.
48. C. Chen, A. Molin, and S. Hirche, "Guaranteed cost control over qualityof- service networks," in Proc. Eur. Control Conf., Budapest, Hungary, 2009, pp. 2355-2360.
49. C. Chen, S. Hirche, and M. Buss, "Stability, stabilization and experiments for networked control systems with random time delay," in Proc. Amer. Control Conf., 2008, pp. 1552-1557.
50. C. Chen, S. Hirche, and M. Buss, "Sampled-data networked control systems with random time delay," in Proc. 17th World Congr. Int. Feder. Autom. Control, 2008, pp. 11594-11599.
51. S. Hirche, C. Chen, and M. Buss, "Performance oriented control over networks - Switching controllers and switched time delay," in Proc. 45th IEEE Conf. Decision Control, San Diego, CA, 2006, pp. 4999-5005. (Pubitemid 351284241)
52. C. Chen, S. Hirche, and M. Buss, "Towards quality-of-service control of networked control systems: A switched time delay systems approach," in Proc. IEEE Int. CCA, 2006, pp. 1325-1330.
53. R. Gupta and M. Chow, "Networked control system: Overview and research trends," IEEE Trans. Ind. Electron., vol. 57, no. 7, pp. 2527-2535, Jul. 2010.
54. RFC Editor United States, H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, RFC3550: RTP: A Transport Protocol for Real-Time Applications2003.
55. [Online]. Available: http://www.gnu.org/software/ccrtp/
56. Internet Engineering Task Force, RFC2581 W. Stevens, TCP Congestion Control 1999.
57. S. W. R. Wright and R. Gary, TCP/IP illustrated. Vol.2: The Implementation. Reading, MA: Addison-Wesley, 1995, ser. Professional Computing Series.
58. Internet Engineering Task Force, RFC3551 H. Schulzrinne, Rtp Profile for Audio and Video Conferences With Minimal Control.
59. L. Montestruque and P. Antsaklis, "Stability of model-based networked control systems with time-varying transmission times," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1562-1572, Sep. 2004.
60. L. Sciavicco and B. Siciliano, Modelling and Control of Robot Manipulators. New York: Springer-Verlag, 2000.
61. T. Chen and B. Francis, Optimal Sampled-Data Control Systems. Berlin, Germany: Springer-Verlag, 1995.
62. E. Fridman, A. Seuret, and J.-P. Richard, "Robust sampled-data stabilization of linear systems: An input delay approach," Automatica, vol. 40, no. 8, pp. 1441-1446, Aug. 2004.
63. C. Chen, H. Wu, K. Kühnlenz, and Hirche, "Switching control for a networked vision-based control system," Automatisierungstechnik, vol. 59, no. 2, pp. 124-133, Feb. 2011.
64. H. Wu, C. Chen, J. Feng, K. Kühnlenz, and S. Hirche, "A switching control law for a networked visual servo control system," in Proc. IEEE ICRA, Anchorage, AK, 2010, pp. 5556-5563.
65. H. Wu, L. Lou, C. Chen, S. Hirche, and K. Kuhnlenz, " Performanceoriented networked visual servo control with sending rate scheduling," in Proc. IEEE ICRA, 2011, pp. 6180-6185.
66. H. Wu, L. Lou, C. Chen, K. Kühnlenz, and S. Hirche, "Distributed computation and data scheduling for networked visual servo control systems," in Proc. IEEE/RSJ Int. Conf. IROS, 2010, pp. 6216-6221.
67. B. Stanczyk, "Development and Control of an Anthropomorphic Telerobotic System," Ph.D. dissertation, Technische Univ. München, Munich, Germany, 2006.
68. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. VISSAPP, 2009, pp. 331-340.
69. M. A. Fischer and R. C. Bolles, "Random sampled consensus: A paradigm for modeling fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.