Artificial higher order neural network training on limited precision processors

Artificial Higher Order Neural Networks for Computer Science and Engineering: Trends for Emerging Applications

Volumn , Issue , 2010, Pages 312-332

  Shawash, Janti ^a   Selviah, David R ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84900654380     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61520-711-4.ch014     Document Type: Chapter

References (37)

1. Bhatt, T. M., & McCain, D. (2005). Matlab as a development environment for FPGA design. In Proceedings of 42nd Design Automation Conference (pp. 607-610).
2. th ed.) London: Chapman & Hall.
3. Dias, F. M., Antunes, A., Vieira, J., & Mota, A. (2006). A sliding window solution for the on-line implementation of the Levenberg-Marquardt algorithm. Engineering Applications of Artificial Intelligence, 19, 1-7. doi:10.1016/j.engappai.2005.03.005
4. Fu, L. (1994). Neural Networks in Computer Intelligence. New York: McGraw-Hill.
5. Fulcher, J., Zhang, M., & Xu, S. (2006). Application of Higher-Order Neural Networks to Financial Time-Series Prediction. In Artificial Neural Networks in Finance and Manufacturing (pp. 80-108). Hershey, PA: Idea Group Publishing.
6. Giles, C. L., & Maxwell, T. (1987). Learning, Invariance, and Generalization in High-Order Neural Networks. Applied Optics, 26(23), 4972-4978. doi:10.1364/AO.26.004972
7. th ed.) New York: Prentice Hall.
8. Huang, W., Wang, S. Y., Yu, L., Bao, Y. K., & Wang, L. (2006). A new computational method of input selection for stock market forecasting with neural networks. In Proceedings of Computational Science - ICCS 2006, Pt 4, 3994, (308-315).
9. Jung, S., & Kim, S. S. (2007). Hardware implementation of a real-time neural network controller with a DSP and an FPGA for nonlinear systems. IEEE Transactions on Industrial Electronics, 54(1), 265-271. doi:10.1109/TIE.2006.888791
10. Kaastra, I., & Boyd, M. (1996). Designing a neural network for forecasting financial and economic time series. Neurocomputing, 10, 215-236. doi:10.1016/0925-2312(95)00039-9
11. Lee, D. W., Choi, H. J., & Lee, J. (2004). A regularized line search tunneling for efficient neural network learning. Advances in Neural Networks - ISNN 2004, Pt 1, 3173, (239-243).
12. Lee, J. (2007). A novel three-phase trajectory informed search methodology for global optimization. Journal of Global Optimization, 38, 61-77. doi:10.1007/s10898-006-9083-3
13. Lee, Y. C., Doolen, G., Chen, H. H., Sun, G. Z., Maxwell, T., & Lee, H. Y. (1986). Machine Learning using a Higher-Order Correlation Network. Physica D. Nonlinear Phenomena, 22(1-3), 276-306.
14. Lopez-Garcia, J. C., Moreno-Armendariz, M. A., Riera-Babures, J., Balsi, M., & Vilasis-Cardona, X. (2005). Real time vision by FPGA implemented CNNs. In European Conference on Circuit Theory and Design (pp. 281-284).
15. Maguire, L. P., McGinnity, T. M., Glackin, B., Ghani, A., Belatreche, A., & Harkin, J. (2007). Challenges for large-scale implementations of spiking neural networks on FPGAs. Neurocomputing, 71(1-3), 13-29. doi:10.1016/j.neucom.2006.11.029
16. Marchiori, D., & Warglien, M. (2008). Predicting human interactive learning by regret-driven neural networks. Science, 319, 1111-1113. doi:10.1126/science.1151185
17. Marquardt, D. W. (1963). An Algorithm for Least-Squares Estimation of Nonlinear Parameters. Journal of the Society for Industrial and Applied Mathematics, 11(2), 431-441. doi:10.1137/0111030
18. th ed.) New York: Morgan Kaufmann.
19. Nguyen, D., & Widrow, B. (1990). Improving the Learning Speed of 2-Layer Neural Networks by Choosing Initial Values of the Adaptive Weights. IJCNN International Joint Conference on Neural Networks, 1-3, C21-C26.
20. Oliveira, A. L. I., & Meira, S. R. L. (2006). Detecting novelties in time series through neural networks forecasting with robust confidence intervals. Neurocomputing, 70, 79-92. doi:10.1016/j.neucom.2006.05.008
21. Ou, J. Z., & Prasanna, V. K. (2004). PyGen: A MATLAB/Simulink based tool for synthesizing parameterized and energy efficient designs using FPGAs. In FCCM'04 12th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (pp. 47-56).
22. Ou, J. Z., & Prasanna, V. K. (2005). MATLAB/Simulink Based Hardware/Software Co-Simulation for Designing Using FPGA Configured Soft Processors. In Parallel and Distributed Processing Symposium (pp. 148b).
23. Pao, Y. H. (1989). Adaptive Pattern Recognition and Neural Networks. Boston, MA:Addison Wesley.
24. Papakonstantinou, I., James, R., & Selviah, D. R. (2009). Radiation and Bound Mode Propagation in Rectangular Multimode Dielectric Channel Waveguides with Sidewall Roughness. IEEE/OSA. Journal of Lightwave Technology, 27(18), 4151-4163. doi:10.1109/JLT.2009.2022766
25. Papakonstantinou, I., Selviah, D. R., Pitwon, R. C. A., & Milward, D.(2008). Low-Cost, Precision, Self-Alignment Technique for Coupling Laser and Photodiode Arrays to Polymer Waveguide Arrays on Multilayer PCBs. IEEE Transactions on Advanced Packaging, 31(3), 502-511. doi:10.1109/ TADVP.2008.924243
26. Personnaz, L., Guyon, I., & Dreyfus, G. (1987). High-Order Neural Networks: Information Storage without Errors. Europhysics Letters, 4, 863-867. doi:10.1209/0295-5075/4/8/001
27. Piche, S. W. (1995). The Selection of Weight Accuracies for Madalines. IEEE Transactions on Neural Networks, 6, 432-445. doi:10.1109/72.363478
28. Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterling, W. T. (1992). Numerical Recipes in C: The Art of Scientific Computing. Cambridge, UK: Cambridge University Press.
29. Sahin, S., Becerikli, Y., & Yazici, S. (2006). Neural network implementation in hardware using FPGAs. In NIP, Neural Information Processing (pp. 1105-1112). Berlin: Springer Verlag.
30. Selviah, D. R., & Shawash, J. (2008). Generalized Correlation Higher Order Neural Networks for Financial Time Series Prediction. In M. Zhang (Ed.), Artificial Higher Order Neural Networks for Artificial Higher Order Neural Networks for Economics and Business (pp. 212-249). Hershey, PA: IGI Global.
31. Smith, M. (1993). Neural Networks for Statistical Modeling. New York: Van Nostrand Reinhold.
32. Stevenson, M., Winter, R., & Widrow, B. (1990). Sensitivity of feedforward neural networks to weight errors. IEEE Transactions on Neural Networks, 1(1), 71-80. doi:10.1109/72.80206
33. Walczak, S. (2001). An empirical analysis of data requirements for financial forecasting with neural networks. Journal of Management Information Systems, 17, 203-222.
34. Walczak, S., & Cerpa, N. (1999). Heuristic principles for the design of artificial neural networks. Information and Software Technology, 41, 107-117. doi:10.1016/S0950-5849(98)00116-5
35. Xilinx (2008). AccelDSP Synthesis Tool. Retrieved June, 2008, fromhttp://www.xilinx.com/tools/dsp.htm
36. Zarrinkoub, H. (2006). Fixed-point Signal Processing with Matlab and Simulink. www.mathworks. com, Retrieved May 25, 2008, from http://www.mathworks.com/webex/recordings/fixedpt_042006/fixedpt_042006.html
37. Zhu, J. H., & Sutton, P. (2003). FPGA implementations of neural networks - A survey of a decade of progress. In Field-Programmable Logic and Applications (pp. 1062-1066). Berlin/Heidelberg: Springer.