Deep fully-connected networks for video compressive sensing

Digital Signal Processing: A Review Journal

Volumn 72, Issue , 2018, Pages 9-18

  Iliadis, Michael ^a   Spinoulas, Leonidas ^a   Katsaggelos, Aggelos K ^a  

^a Northwestern University   (United States)

Author keywords

Deep neural networks; Fully connected networks; Video compressive sensing

Indexed keywords

COMPRESSED SENSING; DEEP NEURAL NETWORKS; NETWORK ARCHITECTURE; VIDEO RECORDING;

COMPRESSIVE SENSING; EXTENSIVE SIMULATIONS; FULLY CONNECTED NETWORKS; LEARNING FRAMEWORKS; LINEAR FORMULATION; PERFORMANCE GAIN; RECONSTRUCTION QUALITY; VIDEO ARCHITECTURE;

IMAGE COMPRESSION;

EID: 85030851833     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2017.09.010     Document Type: Article

References (45)

1. Llull, P., Yuan, X., Liao, X., Yang, J., Kittle, D., Carin, L., Sapiro, G., Brady, D.J., Temporal Compressive Sensing for Video. 2015, Springer International Publishing, Cham, 41–74, 10.1007/978-3-319-16042-9_2.
2. Wang, Z., Spinoulas, L., He, K., Tian, L., Cossairt, O., Katsaggelos, A.K., Chen, H., Compressive holographic video. Opt. Express 25:1 (2017), 250–262, 10.1364/OE.25.000250.
3. Babacan, S.D., Luessi, M., Spinoulas, L., Katsaggelos, A.K., Gopalsami, N., Elmer, T., Ahern, R., Liao, S., Raptis, A., Compressive passive millimeter-wave imaging. IEEE Int. Conf. Image Processing, 2011, 2705–2708, 10.1109/ICIP.2011.6116227.
4. Chen, H., Asif, M.S., Sankaranarayanan, A.C., Veeraraghavan, A., FPA-CS: focal plane array-based compressive imaging in short-wave infrared. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2015, 2358–2366, 10.1109/CVPR.2015.7298849.
5. Duarte, M.F., Davenport, M.A., Takhar, D., Laska, J.N., Sun, T., Kelly, K.F., Baraniuk, R.G., Single-Pixel imaging via compressive sampling. IEEE Signal Process. Mag. 25:2 (2008), 83–91, 10.1109/MSP.2007.914730.
6. Chen, H., Weng, Z., Liang, Y., Lei, C., Xing, F., Chen, M., Xie, S., High speed single-pixel imaging via time domain compressive sampling. CLEO: 2014, 2014, Optical Society of America, JTh2A.132, 10.1364/CLEO_AT.2014.JTh2A.132.
7. Wang, J., Gupta, M., Sankaranarayanan, A.C., LiSens – A scalable architecture for video compressive sensing. Proc. IEEE Conf. Comp. Photography, 2015, 1–9, 10.1109/ICCPHOT.2015.7168369.
8. Gao, L., Liang, J., Li, C., Wang, L.V., Single-Shot compressed ultrafast photography at one hundred billion frames per second. Nature 516 (2014), 74–77, 10.1038/nature14005.
9. Liu, D., Gu, J., Hitomi, Y., Gupta, M., Mitsunaga, T., Nayar, S.K., Efficient space–time sampling with pixel-wise coded exposure for high-speed imaging. IEEE Trans. Pattern Anal. Mach. Intell. 36:2 (2014), 248–260, 10.1109/TPAMI.2013.129.
10. Reddy, D., Veeraraghavan, A., Chellappa, R., P2C2: programmable pixel compressive camera for high speed imaging. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2011, 329–336, 10.1109/CVPR.2011.5995542.
11. Koller, R., Schmid, L., Matsuda, N., Niederberger, T., Spinoulas, L., Cossairt, O., Schuster, G., Katsaggelos, A.K., High spatio-temporal resolution video with compressed sensing. Opt. Express 23:12 (2015), 15992–16007, 10.1364/OE.23.015992.
12. Llull, P., Liao, X., Yuan, X., Yang, J., Kittle, D., Carin, L., Sapiro, G., Brady, D.J., Coded aperture compressive temporal imaging. Opt. Express 21:9 (2013), 10526–10545, 10.1364/OE.21.010526.
13. Fernandez-Cull, C., Tyrrell, B.M., D'Onofrio, R., Bolstad, A., Lin, J., Little, J.W., Blackwell, M., Renzi, M., Kelly, M., Smart pixel imaging with computational-imaging arrays. Proc. SPIE, vol. 9070, 2014, 10.1117/12.2057520 pp. 90703D–90703D-13.
14. Orchard, G., Zhang, J., Suo, Y., Dao, M., Nguyen, D.T., Chin, S., Posch, C., Tran, T.D., Etienne-Cummings, R., Real time compressive sensing video reconstruction in hardware. IEEE Trans. Emerg. Sel. Topics Circuits Syst. 2:3 (2012), 604–615, 10.1109/JETCAS.2012.2214614.
15. Spinoulas, L., He, K., Cossairt, O., Katsaggelos, A., Video compressive sensing with on-chip programmable subsampling. Proc. IEEE Conf. Comp. Vision Pattern Recognition Workshops, 2015, 49–57, 10.1109/CVPRW.2015.7301375.
16. Holloway, J., Sankaranarayanan, A.C., Veeraraghavan, A., Tambe, S., Flutter shutter video camera for compressive sensing of videos. IEEE Int. Conf. Comp. Photography, 2012, 1–9, 10.1109/ICCPhot.2012.6215211.
17. Yang, J., Liao, X., Yuan, X., Llull, P., Brady, D.J., Sapiro, G., Carin, L., Compressive sensing by learning a gaussian mixture model from measurements. IEEE Trans. Image Process. 24:1 (2015), 106–119, 10.1109/TIP.2014.2365720.
18. Yang, J., Yuan, X., Liao, X., Llull, P., Brady, D.J., Sapiro, G., Carin, L., Video compressive sensing using gaussian mixture models. IEEE Trans. Image Process. 23:11 (2014), 4863–4878, 10.1109/TIP.2014.2344294.
19. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521:7553 (2015), 436–444, 10.1038/nature14539.
20. He, K., Zhang, X., Ren, S., Sun, J., Deep residual learning for image recognition. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2016, 770–778, 10.1109/CVPR.2016.90.
21. Pinheiro, P.O., Collobert, R., Dollár, P., Learning to segment object candidates. Proc. Int. Conf. Neural Inf. Process. Systems, NIPS'15, 2015, MIT Press, Cambridge, MA, USA, 1990–1998 http://dl.acm.org/citation.cfm?id=2969442.2969462.
22. Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q., (eds.) Adv. Neural Inf. Process. Syst. 25, 2012, Curran Associates, Inc., 1097–1105.
23. Lecun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE 86:11 (1998), 2278–2324, 10.1109/5.726791.
24. Burger, H.C., Schuler, C.J., Harmeling, S., Image denoising: can plain neural networks compete with BM3D?. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2012, 2392–2399, 10.1109/CVPR.2012.6247952.
25. Schuler, C., Burger, H., Harmeling, S., Scholkopf, B., A machine learning approach for non-blind image deconvolution. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2013, 1067–1074, 10.1109/CVPR.2013.142.
26. Xie, J., Xu, L., Chen, E., Image denoising and inpainting with deep neural networks. Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q., (eds.) Adv. Neural Inf. Process. Syst. 25, 2012, Curran Associates, Inc., 341–349.
27. Agostinelli, F., Anderson, M.R., Lee, H., Adaptive multi-column deep neural networks with application to robust image denoising. Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., Weinberger, K.Q., (eds.) Adv. Neural Inf. Process. Syst. 26, 2013, Curran Associates, Inc., 1493–1501.
28. Cui, Z., Chang, H., Shan, S., Zhong, B., Chen, X., Deep network cascade for image super-resolution. Computer Vision – ECCV 2014 Lect. Notes Comput. Sci., vol. 8693, 2014, Springer International Publishing, 49–64, 10.1007/978-3-319-10602-1_4.
29. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., Stacked Denoising Autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11 (2010), 3371–3408 http://dl.acm.org/citation.cfm?id=1756006.1953039.
30. Sun, J., Cao, W., Xu, Z., Ponce, J., Learning a convolutional neural network for non-uniform motion blur removal. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2015, 769–777, 10.1109/CVPR.2015.7298677.
31. Dong, C., Loy, C., He, K., Tang, X., Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38:2 (2016), 295–307, 10.1109/TPAMI.2015.2439281.
32. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., Jackel, L., Backpropagation applied to handwritten zip code recognition. Neural Comput. 1:4 (1989), 541–551, 10.1162/neco.1989.1.4.541.
33. Ren, J.S., Xu, L., Yan, Q., Sun, W., Shepard convolutional neural networks. Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R., (eds.) Adv. Neural Inf. Process. Syst. 28, 2015, Curran Associates, Inc., 901–909.
34. Xu, L., Ren, J.S., Liu, C., Jia, J., Deep convolutional neural network for image deconvolution. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q., (eds.) Adv. Neural Inf. Process. Syst. 27, 2014, Curran Associates, Inc., 1790–1798.
35. Huang, Y., Wang, W., Wang, L., Bidirectional recurrent convolutional networks for multi-frame super-resolution. Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R., (eds.) Adv. Neural Inf. Process. Syst. 28, 2015, Curran Associates, Inc., 235–243.
36. Mousavi, A., Patel, A.B., Baraniuk, R.G., A deep learning approach to structured signal recovery. Annual Allerton Conf. Communication, Control, and Computing, 2015, 1336–1343, 10.1109/ALLERTON.2015.7447163.
37. Kulkarni, K., Lohit, S., Turaga, P., Kerviche, R., Ashok, A., ReconNet: non-iterative reconstruction of images from compressively sensed measurements. Proc. IEEE Conf. Comp. Vision Pattern Recognition, 2016, 449–458, 10.1109/CVPR.2016.55.
38. Wang, Z., Bovik, A.C., Sheikh, H., Simoncelli, E.P., Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13:4 (2004), 600–612, 10.1109/TIP.2003.819861.
39. Tran, D., Bourdev, L., Fergus, R., Torresani, L., Paluri, M., Learning spatiotemporal features with 3D convolutional networks. IEEE Int. Conf. Computer Vision, 2015, 4489–4497, 10.1109/ICCV.2015.510.
40. Mehta, J., Majumdar, A., Rodeo: robust de-aliasing autoencoder for real-time medical image reconstruction. Pattern Recognit. 63 (2017), 499–510, 10.1016/j.patcog.2016.09.022.
41. Nair, V., Hinton, G.E., Rectified linear units improve restricted Boltzmann machines. Fürnkranz, J., Joachims, T., (eds.) Proc. Int. Conf. Machine Learning, 2010, Omnipress, 807–814 http://www.icml2010.org/papers/432.pdf.
42. Rumelhart, D.E., Hinton, G.E., Williams, R.J., Learning representations by back-propagating errors. Neurocomputing: Foundations of Research, 1988, MIT Press, Cambridge, MA, USA, 696–699.
43. Glorot, X., Bengio, Y., Understanding the difficulty of training deep feedforward neural networks. Teh, Y.W., Titterington, M., (eds.) Proc. Int. Conf. Artificial Intelligence and Statistics, Chia Laguna Resort, Sardinia, Italy Proceedings of Machine Learning Research, PMLR, vol. 9, 2010, 249–256 http://proceedings.mlr.press/v9/glorot10a.html.
44. Pascanu, R., Mikolov, T., Bengio, Y., On the difficulty of training recurrent neural networks. Dasgupta, S., McAllester, D., (eds.) Proc. Int. Conf. Machine Learning, Atlanta, Georgia, USA Proceedings of Machine Learning Research, PMLR, vol. 28, 2013, 1310–1318 http://proceedings.mlr.press/v28/pascanu13.html.
45. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T., Caffe: convolutional architecture for fast feature embedding. Proc. ACM Int. Conf. Multimedia, MM ′14, 2014, ACM, New York, NY, USA, 675–678, 10.1145/2647868.2654889.