DeepCham: Collaborative edge-mediated adaptive deep learning for mobile object recognition

Proceedings - 1st IEEE/ACM Symposium on Edge Computing, SEC 2016

Volumn , Issue , 2016, Pages 64-76

  Li, Dawei ^a   Salonidis, Theodoros ^b   Desai, Nirmit V ^b   Chuah, Mooi Choo ^a  

^a LEHIGH UNIVERSITY   (United States)

^b IBM RESEARCH   (United States)

Author keywords

Adaptive Deep Learning; Crowd sourcing; Edge Computing; Mobile Object Recognition

Indexed keywords

COMPUTER VISION; LEARNING ALGORITHMS; LEARNING SYSTEMS; MOBILE DEVICES; MOBILE TELECOMMUNICATION SYSTEMS;

ADAPTATION MODELS; AUTOMATICALLY GENERATED; DEEP LEARNING; EDGE COMPUTING; LARGE-SCALE OBJECTS; MOBILE ENVIRONMENTS; RECOGNITION ACCURACY; STATE-OF-THE-ART PERFORMANCE;

OBJECT RECOGNITION;

EID: 85010748102     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SEC.2016.38     Document Type: Conference Paper

References (48)

1. https://github.com/BVLC/caffe/tree/master/models/bvlc reference caffenet/.
2. https://github.com/jetpacapp/deepbeliefsdk.
3. https://github.com/pdollar/edges.
4. https://github.com/sh1r0/caffe-android-lib.
5. ABADI, M., AND ET AL. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org
6. ARTHUR, D., AND VASSILVITSKII, S. K-means++: The advantages of careful seeding. SODA-07
7. BARDENET, R., BRENDEL, M., KGL, B., AND SEBAG, M. Collaborative hyperparameter tuning. In ICML-13 (May 2013), S. Dasgupta and D. Mcallester, Eds., vol. 28, JMLR Workshop and Conference Proceedings, pp. 199-207
8. BONOMI, F.,MILITO, R., ZHU, J., AND ADDEPALLI, S. Fog computing and its role in the internet of things. In Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing (New York, NY, USA, 2012), MCC-12, ACM, pp. 13-16
9. BRODLEY, C. E., AND FRIEDL, M. A. Identifying mislabeled training data. CoRR abs/1106.0219 (2011)
10. CASTRO, D., HICKSON, S., BETTADAPURA, V., THOMAZ, E., ABOWD, G., CHRISTENSEN, H., AND ESSA, I. Predicting daily activities from egocentric images using deep learning. ISWC-15
11. CHATZICHRISTOFIS, S., AND BOUTALIS, Y. Cedd: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval. In Computer Vision Systems, vol. 5008. Springer Berlin Heidelberg, 2008, pp. 312-322
12. CHON, Y., LANE, N. D., LI, F., CHA, H., AND ZHAO, F. Automatically characterizing places with opportunistic crowdsensing using smartphones. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (New York, NY, USA, 2012), UbiComp-12, ACM, pp. 481-490
13. DONAHUE, J., JIA, Y., VINYALS, O., HOFFMAN, J., ZHANG, N., TZENG, E., AND DARRELL, T. Decaf: A deep convolutional activation feature for generic visual recognition. CoRR abs/1310.1531 (2013)
14. FAN, R.-E., CHEN, P.-H., AND LIN, C.-J. Working set selection using second order information for training support vector machines. J. Mach. Learn. Res. 6 (Dec. 2005), 1889-1918
15. FURNARI, A., FARINELLA, G. M., AND BATTIATO, S. Recognizing personal contexts from egocentric images
16. GIRSHICK, R. B. Fast R-CNN. CoRR abs/1504.08083 (2015)
17. GIRSHICK, R. B., DONAHUE, J., DARRELL, T., AND MALIK, J. Rich feature hierarchies for accurate object detection and semantic segmentation. CoRR abs/1311.2524 (2013)
18. HOFFMAN, J., TZENG, E., DONAHUE, J., JIA, Y., SAENKO, K., AND DARRELL, T. One-shot adaptation of supervised deep convolutional models. CoRR abs/1312.6204 (2013)
19. JAIN, P., MANWEILER, J., AND CHOWDHURY, R. Overlay: Practical Mobile Augmented Reality. In Proc. ACM MobiSys (Florence, Italy, May 2015)
20. JIA, Y., SHELHAMER, E., DONAHUE, J., KARAYEV, S., LONG, J., GIRSHICK, R., GUADARRAMA, S., AND DARRELL, T. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093 (2014)
21. KAHN, JR., P. H., FRIEDMAN, B., PEREZ-GRANADOS, D. R., AND FREIER, N. G. Robotic pets in the lives of preschool children. In CHI-04 Extended Abstracts on Human Factors in Computing Systems (New York, NY, USA, 2004), CHI EA-04, ACM, pp. 1449-1452
22. KIDD, C. D., AND BREAZEAL, C. Robots at home: Understanding long-term human-robot interaction. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (Sept 2008), pp. 3230-3235
23. KRIZHEVSKY, A., SUTSKEVER, I., AND HINTON, G. E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25. Curran Associates, Inc., 2012
24. LANE, N. D., AND GEORGIEV, P. Can deep learning revolutionize mobile sensing? In Proc. ACM HotMobile (2015), ACM, pp. 117-122
25. LANE, N. D., GEORGIEV, P., AND QENDRO, L. Deepear: robust smartphone audio sensing in unconstrained acoustic environments using deep learning. In Proc. ACM UBICOMP (2015), ACM, pp. 283-294
26. LI, D., AND CHUAH, M. C. Emod: An efficient on-device mobile visual search system. In Proceedings of the 6th ACM Multimedia Systems Conference (New York, NY, USA, 2015), MMSys-15, ACM, pp. 25-36
27. LI, D., CHUAH, M.-C., AND TIAN, L. Demo: Lehigh explorer augmented campus tour (lact). In Proceedings of the 2014 Workshop on Mobile Augmented Reality and Robotic Technology-based Systems (New York, NY, USA, 2014), MARS-14, ACM, pp. 15-16
28. LIN, M., CHEN, Q., AND YAN, S. Network in network. CoRR abs/1312.4400 (2013)
29. LODI, S., ANCULEF, R., AND SARTORI, C. Single-Pass Distributed Learning of Multi-Class SVMs using Core-Sets. ch. 22, pp. 257-268
30. MENSINK, T., VERBEEK, J., AND CSURKA, G. Learning structured prediction models for interactive image labeling. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on (2011), IEEE, pp. 833-840
31. MENSINK, T., VERBEEK, J., AND CSURKA, G. Tree-structured crf models for interactive image labeling. Pattern Analysis and Machine Intelligence, IEEE Transactions on 35, 2 (2013), 476-489
32. MORVANT, E., HABRARD, A., AND AYACHE, S. Majority Vote of Diverse Classifiers for Late Fusion. Springer Berlin Heidelberg, Berlin, Heidelberg, 2014, pp. 153-162
33. ORTEGA, R., AVERY, J., AND FREDERICK, R. Search query autocompletion, May 13 2003. US Patent 6,564,213
34. PATEL, V. M., GOPALAN, R., LI, R., AND CHELLAPPA, R. Visual domain adaptation: A survey of recent advances. Signal Processing Magazine, IEEE 32, 3 (2015), 53-69
35. RAYKAR, V. C., AND YU, S. Eliminating spammers and ranking annotators for crowdsourced labeling tasks. J. Mach. Learn. Res. 13, 1 (Feb. 2012), 491-518
36. RUSSAKOVSKY, O., DENG, J., SU, H., KRAUSE, J., SATHEESH, S., MA, S., HUANG, Z., KARPATHY, A., KHOSLA, A., BERNSTEIN, M., BERG, A. C., AND FEI-FEI, L. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV) 115, 3 (2015), 211-252
37. SATYANARAYANAN, M., BAHL, P., CACERES, R., AND DAVIES, N. The case for vm-based cloudlets in mobile computing. IEEE Pervasive Computing 8, 4 (Oct 2009), 14-23
38. SATYANARAYANAN, M., CHEN, Z., HA, K., HU, W., RICHTER, W., AND PILLAI, P. Cloudlets: at the leading edge of mobile-cloud convergence. In Mobile Computing, Applications and Services (MobiCASE), 2014 6th International Conference on (Nov 2014), pp. 1-9
39. TAKACS, G., AND ET AL. Outdoors augmented reality on mobile phone using loxel-based visual feature organization
40. UIJLINGS, J. R. R., VAN DE SANDE, K. E. A., GEVERS, T., AND SMEULDERS, A. W. M. Selective search for object recognition. International Journal of Computer Vision 104, 2 (2013), 154-171
41. VERBELEN, T., SIMOENS, P., DE TURCK, F., AND DHOEDT, B. Cloudlets: Bringing the cloud to the mobile user. In Proceedings of the Third ACM Workshop on Mobile Cloud Computing and Services (New York, NY, USA, 2012), MCS-12, ACM, pp. 29-36
42. WAN, J., WANG, D., HOI, S. C. H., WU, P., ZHU, J., ZHANG, Y., AND LI, J. Deep learning for content-based image retrieval: A comprehensive study. In Proceedings of the 22Nd ACM International Conference on Multimedia (New York, NY, USA, 2014), MM-14, ACM, pp. 157-166
43. WANG, X., GUO, R., AND KAMBHAMETTU, C. Deeply-learned feature for age estimation. In 2015 IEEE Winter Conference on Applications of Computer Vision (Jan 2015), pp. 534-541
44. WENYIN, L., DUMAIS, S., SUN, Y., ZHANG, H., CZERWINSKI, M., AND FIELD, B. Semi-automatic image annotation. In Proc. of Human-Computer Interaction-Interact (2001), pp. 326-333
45. YI, S., LI, C., AND LI, Q. A survey of fog computing: Concepts, applications and issues. In Proceedings of the 2015 Workshop on Mobile Big Data (New York, NY, USA, 2015), Mobidata-15, ACM, pp. 37-42
46. ZHANG, L., TIWANA, B., QIAN, Z., WANG, Z., DICK, R. P., MAO, Z. M., AND YANG, L. Accurate online power estimation and automatic battery behavior based power model generation for smartphones. In Proceedings of the Eighth IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (New York, NY, USA, 2010), CODES/ISSS-10, ACM, pp. 105-114
47. ZHANG, L., TONG, Y., AND JI, Q. Active image labeling and its application to facial action labeling. In Computer Vision-ECCV 2008. Springer, 2008, pp. 706-719
48. ZITNICK, C. L., AND DOLL AR, P. Edge boxes: Locating object proposals from edges. In Computer Vision-ECCV 2014. Springer, 2014, pp. 391-405