Deep Learning for Joint Source-Channel Coding of Text

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2018-April, Issue , 2018, Pages 2326-2330

  Farsad, Nariman ^a   Rao, Milind ^a   Goldsmith, Andrea ^a  

^a Stanford University   (United States)

Author keywords

Deep learning; Joint source channel coding; Natural language processing

Indexed keywords

EID: 85053478947     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2018.8461983     Document Type: Conference Paper

References (32)

1. Claude E Shannon andWarrenWeaver, The mathematical theory of communication, University of Illinois press, 1998.
2. Sridhar Vembu, Sergio Verdu, and Yossef Steinberg, "The source-channel separation theorem revisited, " IEEE Transactions on Information Theory, vol. 41, no. 1, pp. 44-54, 1995.
3. A. Goldsmith, "Joint source/channel coding for wireless channels, " in IEEE Vehicular Technology Conference. Countdown to the Wireless Twenty-First Century, Jul 1995, vol. 2, pp. 614-618 vol. 2.
4. Fan Zhai, Yiftach Eisenberg, and Aggelos K Katsaggelos, "Joint source-channel coding for video communications, " Handbook of Image and Video Processing, 2005.
5. Geoffrey Davis and John Danskin, "Joint source and channel coding for image transmission over lossy packet networks, " in Conf. Wavelet Applications to Digital Image Processing, 1996, pp. 376-387.
6. Ozgun Y Bursalioglu, Giuseppe Caire, and Dariush Divsalar, "Joint source-channel coding for deep-space image transmission using rateless codes, " IEEE Transactions on Communications, vol. 61, no. 8, pp. 3448-3461, 2013.
7. Venkat Anantharam and Sergio Verdu, "Bits through queues, " IEEE Transactions on Information Theory, vol. 42, no. 1, pp. 4-18, 1996.
8. Brian P Dunn, Matthieu Bloch, and J Nicholas Laneman, "Secure bits through queues, " in IEEE Information Theory Workshop. IEEE, 2009, pp. 37-41.
9. Negar Kiyavash, Farinaz Koushanfar, Todd P Coleman, and Mavis Rodrigues, "A timing channel spyware for the csma/ca protocol, " IEEE Transactions on Information Forensics and Security, vol. 8, no. 3, pp. 477-487, 2013.
10. Pritam Mukherjee and Sennur Ulukus, "Covert bits through queues, " in IEEE Conference on Communications and Network Security (CNS). IEEE, 2016, pp. 626-630.
11. Arnab Kumar Biswas, Dipak Ghosal, and Shishir Nagaraja, "A survey of timing channels and countermeasures, " ACM Computing Surveys (CSUR), vol. 50, no. 1, pp. 6, 2017.
12. Li Rongwei, Wu Lenan, and Guo Dongliang, "Joint source/channel coding modulation based on bp neural networks, " in Proceedings of the International Conference on Neural Networks and Signal Processing. IEEE, 2003, vol. 1, pp. 156-159.
13. George Toderici et al., "Variable rate image compression with recurrent neural networks, " in International Conference on Learning Representations, 2016.
14. George Toderici, Damien Vincent, Nick Johnston, Sung Jin Hwang, David Minnen, Joel Shor, and Michele Covell, "Full resolution image compression with recurrent neural networks, " arXiv preprint arXiv: 1608. 05148, 2016.
15. Jiwei Li, Minh-Thang Luong, and Dan Jurafsky, "A hierarchical neural autoencoder for paragraphs and documents, " arXiv preprint arXiv: 1506. 01057, 2015.
16. Yonghui Wu et al., "Google's neural machine translation system: Bridging the gap between human and machine translation, " CoRR, vol. Abs/1609. 08144, 2016.
17. Ilya Sutskever, Oriol Vinyals, and Quoc V Le, "Sequence to sequence learning with neural networks, " in Advances in neural information processing systems, 2014, pp. 3104-3112.
18. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio, "Neural machine translation by jointly learning to align and translate, " arXiv preprint arXiv: 1409. 0473, 2014.
19. Jeffrey Pennington, Richard Socher, and Christopher Manning, "Glove: Global vectors for word representation, " in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1532-1543.
20. Alex Graves and Jürgen Schmidhuber, "Framewise phoneme classification with bidirectional lstm and other neural network architectures, " Neural Networks, vol. 18, no. 5, pp. 602-610, 2005.
21. Haşim Sak, Andrew Senior, and Françoise Beaufays, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling, " in Fifteenth Annual Conference of the International Speech Communication Association, 2014.
22. Ronald J Williams, "Simple statistical gradient-following algorithms for connectionist reinforcement learning, " Machine learning, vol. 8, no. 3-4, pp. 229-256, 1992.
23. Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David, "Binaryconnect: Training deep neural networks with binary weights during propagations, " in Advances in Neural Information Processing Systems, 2015, pp. 3123-3131.
24. Tapani Raiko, Mathias Berglund, Guillaume Alain, and Laurent Dinh, "Techniques for learning binary stochastic feedforward neural networks, " stat, vol. 1050, pp. 11, 2014.
25. Nitish Srivastava, Geoffrey E Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting., " Journal of machine learning research, vol. 15, no. 1, pp. 1929-1958, 2014.
26. Alex Graves, "Sequence transduction with recurrent neural networks, " arXiv preprint arXiv: 1211. 3711, 2012.
27. Philipp Koehn, "Europarl: A parallel corpus for statistical machine translation, " in MT summit, 2005, vol. 5, pp. 79-86.
28. Jacob Ziv and Abraham Lempel, "A universal algorithm for sequential data compression, " IEEE Transactions on information theory, vol. 23, no. 3, pp. 337-343, 1977.
29. Irving S Reed and Gustave Solomon, "Polynomial codes over certain finite fields, " Journal of the society for industrial and applied mathematics, vol. 8, no. 2, pp. 300-304, 1960.
30. Chris Quirk, Chris Brockett, and William Dolan, "Monolingual machine translation for paraphrase generation, " in Proceedings of the 2004 conference on empirical methods in natural language processing, 2004.
31. Sander Wubben, Antal Van Den Bosch, and Emiel Krahmer, "Sentence simplification by monolingual machine translation, " in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1. Association for Computational Linguistics, 2012, pp. 1015-1024.
32. Ingwer Borg and Patrick JF Groenen, Modern multidimensional scaling: Theory and applications, Springer Science & Business Media, 2005.