Friction from reflectance: deep reflectance codes for predicting physical surface properties from one-shot in-field reflectance

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 9908 LNCS, Issue , 2016, Pages 808-824

  Zhang, Hang ^a   Dana, Kristin ^a   Nishino, Ko ^b  

^a RUTGERS UNIVERSITY   (United States)

^b Drexel University   (United States)

Author keywords

Binary embedding; Material recognition; Reflectance; Surface friction

Indexed keywords

CODES (SYMBOLS); EMBEDDINGS; FRICTION; PHYSICAL PROPERTIES; REFLECTOMETERS;

BINARY EMBEDDING; DISCRIMINATORY POWER; FRICTION ESTIMATION; MATERIAL RECOGNITION; PHYSICAL SURFACE PROPERTIES; SCENE UNDERSTANDING; SPATIAL INVARIANCE; SURFACE FRICTION;

REFLECTION;

EID: 84990050144     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-46493-0_49     Document Type: Conference Paper

References (49)

1. Arriaga, R., Vempala, S., et al.: An algorithmic theory of learning: robust concepts and random projection. In: 40th Annual Symposium on Foundations of Computer Science, pp. 616-623. IEEE (1999)
2. Bell, S., Upchurch, P., Snavely, N., Bala, K.: Material recognition in the wild with the materials in context database. In: Computer Vision and Pattern Recognition (CVPR) (2015)
3. Bertaux, E., Lewandowski, M., Derler, S.: Relationship between friction and tactile properties for woven and knitted fabrics. Text. Res. J. 77(6), 387-396 (2007)
4. Caputo, B., Hayman, E., Mallikarjuna, P.: Class-specific material categorisation. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, vol. 2, pp. 1597-1604. IEEE (2005)
5. Charikar, M.S.: Similarity estimation techniques from rounding algorithms. In: Proceedings of the Thiry-Fourth Annual ACM Symposium on Theory of Computing, pp. 380-388. ACM (2002)
6. Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: British Machine Vision Conference (2014)
7. Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., Vedaldi, A.: Describing textures in the wild. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3606-3613. IEEE (2014)
8. Cimpoi, M., Maji, S., Vedaldi, A.: Deep filter banks for texture recognition and segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3828-3836 (2015)
9. Cula, O.G., Dana, K.J.: Compact representation of bidirectional texture functions. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1041-1067 (2001)
10. Cula, O.G., Dana, K.J.: Recognition methods for 3d textured surfaces. In: Proceedings of SPIE Conference on Human Vision and Electronic Imaging VI, vol. 4299, pp. 209-220 (2001)
11. Dana, K.J.: BRDF/BTF measurement device. In: International Conference on Computer Vision, vol. 2, pp. 460-466 (2001)
12. Dana, K., Wang, J.: Device for convenient measurement of spatially varying bidirectional reflectance. J. Opt. Soc. Am. A 21, 1-12 (2004)
13. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., Darrell, T.: DeCAF: a deep convolutional activation feature for generic visual recognition. In: Proceedings of the 31st International Conference on Machine Learning, pp. 647-655 (2014)
14. Erdogan, G., Alexander, L., Rajamani, R.: A novel wireless piezoelectric tire sensor for the estimation of slip angle. Meas. Sci. Technol. 21(1), 015201 (2010)
15. Erin Liong, V., Lu, J., Wang, G., Moulin, P., Zhou, J.: Deep hashing for compact binary codes learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2475-2483 (2015)
16. Gong, Y., Kumar, S., Rowley, H.A., Lazebnik, S.: Learning binary codes for highdimensional data using bilinear projections. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 484-491 (2013)
17. Gong, Y., Kumar, S., Verma, V., Lazebnik, S.: Angular quantization-based binary codes for fast similarity search. In: Advances in Neural Information Processing Systems, pp. 1196-1204 (2012)
18. Gong, Y., Lazebnik, S., Gordo, A., Perronnin, F.: Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2916-2929 (2013)
19. Gong, Y., Wang, L., Guo, R., Lazebnik, S.: Multi-scale orderless pooling of deep convolutional activation features. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VII. LNCS, vol. 8695, pp. 392-407. Springer, Heidelberg (2014)
20. Gustafsson, F.: Slip-based tire-road friction estimation. Automatica 33(6), 1087-1099 (1997)
21. Jégou, H., Douze, M., Schmid, C., Pérez, P.: Aggregating local descriptors into a compact image representation. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3304-3311. IEEE (2010)
22. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia, pp. 675-678. ACM (2014)
23. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097-1105 (2012)
24. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436-444 (2015)
25. Leung, T., Malik, J.: Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vis. 43(1), 29-44 (2001)
26. Liu, C., Yang, G., Gu, J.: Learning discriminative illumination and filters for raw material classification with optimal projections of bidirectional texture functions. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2013
27. Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(2579-2605), 85 (2008)
28. Matsuzaki, R., Todoroki, A.: Wireless strain monitoring of tires using electrical capacitance changes with an oscillating circuit. Sens. Actuators A: Phys. 119(2), 323-331 (2005)
29. Nyahumwa, C., Jeswiet, J.: A friction sensor for sheet-metal rolling. CIRP Ann. Manufact. Technol. 40(1), 231-233 (1991)
30. Perronnin, F., Liu, Y., S´anchez, J., Poirier, H.: Large-scale image retrieval with compressed fisher vectors. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3384-3391. IEEE (2010)
31. Perronnin, F., Sánchez, J., Mensink, T.: Improving the fisher kernel for large-scale image classification. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 143-156. Springer, Heidelberg (2010)
32. Raginsky, M., Lazebnik, S.: Locality-sensitive binary codes from shift-invariant kernels. In: Advances in Neural Information Processing Systems, pp. 1509-1517 (2009)
33. Ramkumar, S., Wood, D., Fox, K., Harlock, S.: Developing a polymeric human finger sensor to study the frictional properties of textiles part I: artificial finger development. Text. Res. J. 73(6), 469-473 (2003)
34. Razavian, A.S., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 512-519. IEEE (2014)
35. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., Fei-Fei, L.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. (IJCV) 115, 1-42 (2015)
36. Salakhutdinov, R., Hinton, G.: Semantic hashing. Int. J. Approx. Reason. 50(7), 969-978 (2009)
37. Sharan, L., Liu, C., Rosenholtz, R., Adelson, E.H.: Recognizing materials using perceptually inspired features. Int. J. Comput. Vis. 103(3), 348-371 (2013)
38. Shi, Q., Shen, C., Hill, R., Hengel, A.: Is margin preserved after random projection? In: Proceedings of the 29th International Conference on Machine Learning (ICML 2012), pp. 591-598 (2012)
39. Su, S., Heide, F., Swanson, R., Klein, J., Callenberg, C., Hullin, M., Heidrich, W.: Material classification using raw time-of-flight measurements. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3503-3511 (2016)
40. Torralba, A., Fergus, R., Weiss, Y.: Small codes and large image databases for recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1-8. IEEE (2008)
41. Varma, M., Zisserman, A.: Classifying images of materials: achieving viewpoint and illumination independence. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 255-271. Springer, Heidelberg (2002)
42. Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms (2008). http://www.vlfeat.org/
43. Vedaldi, A., Lenc, K.: Matconvnet-convolutional neural networks for matlab (2015)
44. Wang, J., Dana, K.J.: Relief texture from specularities. IEEE Trans. Pattern Anal. Mach. Intell. 28(3), 446-457 (2006)
45. Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems, vol. 21, pp. 1753-1760. Curran Associates, Inc. (2009). http://papers.nips.cc/paper/3383-spectral-hashing.pdf
46. Yu, F.X., Kumar, S., Gong, Y., Chang, S.F.: Circulant binary embedding. In: International Conference on Machine Learning (2014)
47. Zhang, H., Dana, K., Nishino, K.: Reflectance hashing for material recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3071-3080 (2015)
48. Zhang, X., Yu, F.X., Guo, R., Kumar, S., Wang, S., Chang, S.F.: Fast orthogonal projection based on kronecker product. In: International Conference on Computer Vision (2015)
49. Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., Oliva, A.: Learning deep features for scene recognition using places database. In: Advances in Neural Information Processing Systems, pp. 487-495 (2014)