Process data analytics in the era of big data

AIChE Journal

Volumn 60, Issue 9, 2014, Pages 3092-3100

  Qin, S Joe ^a,b  

^a THE CHINESE UNIVERSITY OF HONG KONG   (China)

^b S Joe Qin is on leave from the Mork Family Dept of Chemical Engineering and Materials Science University of Southern California ^*  (United States)

Author keywords

Big data; Machine learning; Optimization; Process control; Process data analytics; Process improvement

Indexed keywords

EID: 84905960935     PISSN: 00011541     EISSN: 15475905     Source Type: Journal    
DOI: 10.1002/aic.14523     Document Type: Article

References (52)

1. Grossmann IE. Advances in mathematical programming models for enterprise-wide optimization. Comput Chem Eng. 2012;47:2-18.
2. Davis J, Edgar T, Porter J, Bernaden J, Sarli M. Smart manufacturing, manufacturing intelligence and demand-dynamic performance. Comput Chem Eng. 2012;47:145-56.
3. Collins FS, Morgan M, Patrinos A. The Human Genome Project: lessons from large-scale biology. Science. 2003;300(5617):286-90.
4. Bickel PJ, Brown JB, Huang H, Li Q. An overview of recent developments in genomics and associated statistical methods. Philos Trans A Math Phys Eng Sci. 2009;367:4313-37.
5. 3M project. BGI. http://www.genomics.cn/en/navigation/show_navigation?nid=5656. Accessed on May 10, 2014.
6. Waterman MS. Introduction to Computational Biology: Maps, Sequences and Genomes. Boca Raton, FL: CRC; 1995.
7. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature. 2009;457:1012-4.
8. Tham M. Soft-sensors for process estimation and inferential control. J Process Control. 1991;1(1):3-14.
9. Qin SJ, McAvoy TJ. A data-based process modeling approach and its applications. In Proceedings of the 3rd IFAC DYCORD Symposium. College Park, MD: 1992:321-6.
10. Mayer-Schönberger V, Cukier K. Big Data: A Revolution that Will Transform How We Live, Work, and Think. Boston, MA: Houghton Mifflin Harcourt; 2013.
11. Manyika J, Chui M, Brown B, et al. Big data: the next frontier for innovation, competition, and productivity. McKinsey & Company. http://www.mckinsey.com/insights/business_technology/big_data_the_next_frontier_for_innovation. Published May 2011. Accessed on May 10, 2014.
12. National Research Council. Frontiers in Massive Data Analysis. Washington, DC: National Academies Press; 2013.
13. Tata Consultancy Services. The Emerging Big Returns on Big Data: A TCS 2013 Global Trend Study. Tata Consultancy Services: 2013. http://www.tcs.com/big-data-study/Pages/download-report.aspx. Accessed on May 10, 2014.
14. Stephanopoulos G, Reklaitis GV. Process systems engineering: from Solvay to modern bio- and nanotechnology. A history of development, successes and prospects for the future. Chem Eng Sci. 2011;66:4272-306.
15. Qin SJ, Cherry G, Good R, Wang J, Harrison CA. Semiconductor manufacturing process control and monitoring: a Fab-wide framework. J Process Control 2006;16:179-91.
16. Venkatasubramanian V. Drowning in data: informatics and modeling challenges in a data-rich networked world. AIChE J. 2009;55(1):2-8.
17. Geladi P, Kowalski BR. Partial least-squares regression: a tutorial. Anal Chim Acta. 1986;185:1-17.
18. Mah RS, Stanley GM, Downing DM. Reconciliation and rectification of process flow and inventory data. Ind Eng Chem Process Des Dev. 1976, 15(1), 175-83.
19. Bakshi BR, Stephanopoulos G. Representation of process trends-IV. Induction of real-time patterns from operating data for diagnosis and supervisory control. Comput Chem Eng. 1994;18(4):303-32.
20. Kalman RE. A new approach to linear filtering and prediction problems. J Basic Eng. 1960;82(1):35-45.
21. Gibbs BP. Advanced Kalman Filtering, Least-Squares and Modeling: A Practical Handbook. New York, NY: Wiley; 2011.
22. Klatt KU, Marquardt W. Perspectives for process systems engineering-personal views from academia and industry. Comput Chem Eng. 2009;33:536-50.
23. Nelson PR, Taylor PA, MacGregor JF. Missing data methods in PCA and PLS: score calculations with incomplete observations. Chemometr Intell Lab Syst. 1996;35:45-65.
24. Hinton GE, Salakhutdinov R. Reducing the dimensionality of data with neural networks. Science. 2006;313(5786):504-7.
25. Bengio Y, Lamblin P, Popovici D, Larochelle H. Greedy layer-wise training of deep networks. Adv Neural Inf Process Syst. 2007;19:153-60.
26. Keogh E, Kasetty S. On the need for time series data mining benchmarks: a survey and empirical demonstration. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2002:102-11.
27. Fu TC. A review on time series data mining. Eng Appl Artif Intell. 2011;24:164-81.
28. Yu H, MacGregor JF. Multivariate image analysis and regression for prediction of coating content and distribution in the production of snack foods. Chemometr Intell Lab Syst. 2003;67:125-44.
29. Kourti T, MacGregor JF. Process analysis, monitoring and diagnosis, using multivariate projection methods. Chemometr Intell Lab Syst. 1995;28(1):3-21.
30. Bengio Y, Courville A, Vincent P. Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell. 2013;35(8):1798-828.
31. Qin SJ. Survey on data-driven industrial process monitoring and diagnosis. Annu Rev Control. 2012;36:220-34.
32. Qin SJ, Zheng YY. Quality-relevant and process-relevant fault monitoring with concurrent projection to latent structures. AIChE J. 2013;59:496-504.
33. Ge ZQ, Yang CJ, Song ZH, Wang HQ. Robust online monitoring for multimode processes based on nonlinear external analysis. Ind Eng Chem Res. 2008;47:4775-83.
34. Singhal A, Seborg DE. Evaluation of a pattern matching method for the Tennessee Eastman challenge process. J Process Control. 2006;16:601-13.
35. Ku W, Storer R, Georgakis C. Disturbance detection and isolation by dynamic principal component analysis. Chemometr Intell Lab Syst. 1995;30(1):179-96.
36. Sun ZL, Qin SJ, Singhal A, Megan L. Performance monitoring of model-based controllers via model residual assessment. J Process Control. 2013;23:473-82.
37. Granger C. Some recent development in a concept of causality. J Econometr. 1988;39:199-211.
38. Yuan T, Qin SJ. Root cause diagnosis of plant-wide oscillations using granger causality. J Process Control. 2014;24:450-9.
39. Hoskins JC, Himmelblau DM. Artificial neural network models of knowledge representation in chemical engineering. Comput Chem Eng. 1988;12:881-90.
40. Ydstie BE. Forecasting and control using adaptive connectionist networks. Comput Chem Eng. 1990;14(4):583-99.
41. Vapnik V. The Nature of Statistical Learning Theory. New York, NY: Springer-Verlag; 1999.
42. Freund Y, Schapire RE. A short introduction to boosting. J Jpn Soc Artif Intell. 1999;14(5):771-80.
43. Boyd S, Parikh N, Chu E, Peleato B, Eckstein J. Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn. 2011;3(1):1-122.
44. Russell SJ. Judea Pearl A. M. Turning Award. http://amturing.acm.org/award_winners/pearl_2658896.cfm. Accessed on May 10, 2014.
45. Sra S, Nowozin S, Wright SJ. Optimization for Machine Learning. Cambridge, MA: MIT Press; 2011.
46. Cozad A, Sahinidis NV, Miller DC. Learning surrogate models for simulation-based optimization. AIChE J. 2014;60(6):2211-27.
47. Choi J, Realff MJ, Lee JH. Dynamic programming in a heuristically confined state space: a stochastic resource-constrained project scheduling application. Comput Chem Eng. 2004;28(6):1039-58.
48. Vance A. Hadoop, a free software program, finds uses beyond search, The New York Times. March 16, 2009. http://www.nytimes.com/2009/03/17/technology/business-computing/17cloud.html?_r=0. Accessed on May 10, 2014.
49. Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. Commun ACM. 2008;51(1):107-13.
50. Thusoo A, Sarma JS, Jain N, et al. Hive-a petabyte scale data warehouse using Hadoop. IEEE 26th International Conference on Data Engineering. 2010; 996-1005.
51. Mazur E, Li B, Diao Y, Shenoy P. Towards scalable one-pass analytics using MapReduce. In IPDPSW '11 Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum. Washington, DC: IEEE Computer Society; 2011:1102-11.
52. Li B, Mazur E, Diao Y, McGregor A, Shenoy P. A platform for scalable one-pass analytics using MapReduce. In SIGMOD '11 Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. New York, NY: Association for Computing Machinery; 2011:985-996.