Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor

Frontiers in Neuroscience

Volumn , Issue 7 NOV, 2013, Pages

  Delbruck, Tobi ^a   Lang, Manuel ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Address event representation; AER; Asynchronous vision sensor; High frame rate; High speed visually guided robotics; Neuromorphic system; Soccer

Indexed keywords

ARM MOVEMENT; ARTICLE; COMPUTER SYSTEM; DYNAMIC VISION SENSOR; HUMAN; ILLUMINATION; LATENT PERIOD; MICROPROCESSOR; MOTOR CONTROL; RESPONSE TIME; ROBOTICS; RUNNING; SENSOR; SOCCER; TACTILE FEEDBACK; VELOCITY; VISUAL FEEDBACK; VISUAL INFORMATION;

EID: 84888773850     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00223     Document Type: Article

References (18)

1. (2007). jAER Open Source Project: Real Time Sensory-Motor Processing for Event-Based Sensors and Systems. Available online at: http://www.jaerproject.org
2. Axelson, J. (2001). USB Complete. Madison, WI: Lakeview Research.
3. Cheng, Y. (1995). Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Analysis Mach. Intell. 17, 790-799. doi: 10.1109/34.400568
4. Comaniciu, D., and Ramesh, V. (2000). "Mean shift and optimal prediction for efficient object tracking," in IEEE International Conference on Image Processing (ICIP) (Vancouver, BC), 70-73.
5. Conradt, J., Berner, R., Cook, M., Delbruck, T. (2009a). "An embedded AER dynamic vision sensor for low-latency pole balancing," in 5th IEEE Workshop on Embedded Computer Vision (in Conjunction with ICCV 2009) (Kyoto), 1-6.
6. Conradt, J., Cook, M., Berner, R., Lichtsteiner, P., Douglas, R. J., and Delbruck, T. (2009b). "Live demonstration: a pencil balancing robot using a pair of AER dynamic vision sensors," in ISCAS 2009, (Taipei), 781-785.
7. Delbruck, T., and Lichtsteiner, P. (2007). "Fast sensory motor control based on event-based hybrid neuromorphic-procedural system," in ISCAS 2007 (New Orleans, LA), 845-848.
8. Delbruck, T., Linares-Barranco, B., Culurciello, E., and Posch, C. (2010). "Activity-driven, event-based vision sensors," Presented at the IEEE International Symposium on Circuits and Systems (Paris), 2426-2429.
9. Domínguez-Morales, M., Jimenez-Fernandez, A., Paz-Vicente, R., Jimenez, G., and Linares-Barranco, A. (2012). "Live demonstration: on the distance estimation of moving targets with a stereo-vision AER system," in IEEE International Symposium on Circuits and Systems (ISCAS) 2012, (Seoul), 721-725.
10. Graetzel, C. G., Fry, S. N., and Nelson, B. J. (2006). A 6000 Hz computer vision system for real-time wing beat analysis of Drosophila. Biorob 2006, 278-284. doi: 10.1109/BIOROB.2006.1639099
11. Lichtsteiner, P., Posch, C., and Delbruck, T. (2006). "A 128×128 120dB 30mW asynchronous vision sensor that responds to relative intensity change," in Visuals Supplement to ISSCC Digest of Technical Papers (San Francisco, CA), 508-509 (27.9).
12. Lichtsteiner, P., Posch, C., and Delbruck, T. (2007). A 128×128 120dB 15us latency asynchronous temporal contrast vision sensor. IEEE J. Solid State Circuits 43, 566-576. doi: 10.1109/JSSC.2007.914337
13. Linares-Barranco, A., Gómez-Rodríguez, F., Jiménez, A., Delbruck, T., and Lichtsteiner, P. (2007). "Using FPGA for visuo-motor control with a silicon retina and a humanoid robot," in ISCAS 2007, (New Orleans, LA), 1192-1195.
14. Litzenberger, M., Posch, C., Bauer, D., Schön, P., Kohn, B., Garn, H., et al. (2006). "Embedded vision system for real-time object tracking using an asynchronous transient vision sensor," in IEEE Digital Signal Processing Workshop 2006 (Grand Teton, WY), 173-178.
15. Ni, Z., Bolopion, A., Agnus, J., Benosman, R., and Regnier, S. (2013). Asynchronous event-based visual shape tracking for stable haptic feedback in microrobotics. IEEE Transactions on Robotics 28, 1081-1089. doi: 10.1109/TRO.2012.2198930
16. Oaks, S., and Wong, H. (2004). Java Threads. O'Reilly.
17. Serrano-Gotarredona, R., Oster, M., Lichtsteiner, P., Linares-Barranco, A., Paz-Vicente, R. Gomez-Rodriguez, F., et al. (2009). CAVIAR: A 45k Neuron, 5M Synapse, 12G Connects/s AER hardware sensory-processing- learning-actuating system for high-speed visual object recognition and tracking. IEEE Trans. Neural Netw. 20, 1417-1438. doi: 10.1109/TNN.2009.2023653
18. Wilson, A. (2007). Beyond camera link: looking forward to a new camera/frame grabber interface standard. Vis. Syst. Design. 12, 79-83. Available online at: http://www.vision-systems.com/articles/print/volume-12/issue-10/features/product-focus/beyond-camera-link.html