Topic analysis and forecasting for science, technology and innovation: Methodology with a case study focusing on big data research

Technological Forecasting and Social Change

Volumn 105, Issue , 2016, Pages 179-191

  Zhang, Yi ^a,b   Zhang, Guangquan ^a   Chen, Hongshu ^a,b   Porter, Alan L ^c   Zhu, Donghua ^b   Lu, Jie ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b BEIJING INSTITUTE OF TECHNOLOGY   (China)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Technical intelligence; Technological forecasting; Text clustering; Text mining; Topic analysis

Indexed keywords

DATA MINING; FORECASTING; INNOVATION; TECHNOLOGICAL FORECASTING;

EMPIRICAL CASE STUDIES; NATIONAL SCIENCE FOUNDATIONS; QUANTITATIVE METHODOLOGY; TECHNICAL INTELLIGENCE; TECHNOLOGY ROADMAPPING; TEXT CLUSTERING; TEXT MINING; TOPIC ANALYSIS;

BIG DATA;

ANALYTICAL METHOD; DATA MINING; EMPIRICAL ANALYSIS; INNOVATION; RESEARCH; SCIENCE AND TECHNOLOGY;

EID: 84978010449     PISSN: 00401625     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.techfore.2016.01.015     Document Type: Article

References (66)

1. Aizawa A. An information-theoretic perspective of tf-idf measures. Inf. Process. Manag. 2003, 39(1):45-65.
2. Allan J., Carbonell J.G., Doddington G., Yamron J., Yang Y. Topic Detection and Tracking Pilot Study Final Report 1998.
3. Allison G., Blackwill R.D., Wyne A., Kissinger H.A. Lee Kuan Yew: The Grand Master's Insights on China, the United States, and the World 2013, MIT Press.
4. Begelman G., Keller P., Smadja F. Automated tag clustering: improving search and exploration in the tag space. Paper Presented at the Collaborative Web Tagging Workshop at WWW2006 2006, (Edinburgh, Scotland).
5. Beil F., Ester M., Xu X. Frequent term-based text clustering. Paper Presented at the Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2002.
6. Bengisu M. Critical and emerging technologies in materials, manufacturing, and industrial engineering: a study for priority setting. Scientometrics 2003, 58(3):473-487.
7. Blei D.M. Probabilistic topic models. Commun. ACM 2012, 55(4):77-84.
8. Blei D.M., Lafferty J.D. Dynamic topic models. Paper Presented at the Proceedings of the 23rd International Conference on Machine Learning 2006.
9. Boyack K.W., Newman D., Duhon R.J., Klavans R., Patek M., Biberstine J.R., Börner K. Clustering more than two million biomedical publications: comparing the accuracies of nine text-based similarity approaches. PLoS One 2011, 6(3).
10. Bughin J., Chui M., Manyika J. Clouds, big data, and smart assets: ten tech-enabled business trends to watch. McKinsey Q. 2010, 56(1):75-86.
11. Cataldi M., Di Caro L., Schifanella C. Emerging topic detection on twitter based on temporal and social terms evaluation. Paper Presented at the Proceedings of the Tenth International Workshop on Multimedia Data Mining 2010.
12. Chang C.-H., Hsu C.-C. Customizable multi-engine search tool with clustering. Comput. Netw. ISDN syst. 1997, 29(8):1217-1224.
13. Chen C. CiteSpace II: detecting and visualizing emerging trends and transient patterns in scientific literature. J. Am. Soc. Inf. Sci. Technol. 2006, 57(3):359-377.
14. Chen H., Zhang G., Lu J. A time-series-based technology intelligence framework by trend prediction functionality. Paper Presented at the Systems, Man, and Cybernetics (SMC), 2013 IEEE International Conference on 2013.
15. Choi C., Park Y. Monitoring the organic structure of technology based on the patent development paths. Technol. Forecast. Soc. Chang. 2009, 76(6):754-768.
16. Choi S., Yoon J., Kim K., Lee J.Y., Kim C.-H. SAO network analysis of patents for technology trends identification: a case study of polymer electrolyte membrane technology in proton exchange membrane fuel cells. Scientometrics 2011, 88(3):863-883.
17. Choi S., Kim H., Yoon J., Kim K., Lee J.Y. An SAO-based text-mining approach for technology roadmapping using patent information. R&D Manag. 2013, 43(1):52-74.
18. Cutting D.R., Karger D.R., Pedersen J.O., Tukey J.W. Scatter/gather: a cluster-based approach to browsing large document collections. Paper Presented at the Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1992.
19. Dai X.-Y., Chen Q.-C., Wang X.-L., Xu J. Online topic detection and tracking of financial news based on hierarchical clustering. Paper Presented at the Machine Learning and Cybernetics (ICMLC), 2010 International Conference on 2010.
20. Garcia M.L., Bray O.H. Fundamentals of Technology Roadmapping: Sandia National Laboratories Albuquerque, NM 1997.
21. Gretarsson B., O'donovan J., Bostandjiev S., Höllerer T., Asuncion A., Newman D., Smyth P. Topicnets: visual analysis of large text corpora with topic modeling. ACM Trans. Intell. Syst. Technol. 2012, 3(2):23.
22. Guo Y., Ma T., Porter A.L., Huang L. Text mining of information resources to inform forecasting innovation pathways. Tech. Anal. Strat. Manag. 2012, 24(8):843-861.
23. Huang A. Similarity measures for text document clustering. Paper Presented at the Proceedings of the Sixth New Zealand Computer Science Research Student Conference (NZCSRSC2008), Christchurch, New Zealand 2008.
24. Huang L., Guo Y., Porter A.L., Youtie J., Robinson D.K. Visualising potential innovation pathways in a workshop setting: the case of nano-enabled biosensors. Tech. Anal. Strat. Manag. 2012, 24(5):527-542.
25. Huang L., Zhang Y., Guo Y., Zhu D., Porter A.L. Four dimensional science and technology planning: a new approach based on bibliometrics and technology roadmapping. Technol. Forecast. Soc. Chang. 2014, 81:39-48.
26. Jain A.K. Data clustering: 50 years beyond K-means. Pattern Recogn. Lett. 2010, 31(8):651-666.
27. Jeong Y., Yoon B. Development of patent roadmap based on technology roadmap by analyzing patterns of patent development. Technovation 2015, 39:37-52.
28. Kontostathis A., Galitsky L.M., Pottenger W.M., Roy S., Phelps D.J. A Survey of Emerging Trend Detection in Textual Data Mining Survey of Text Mining 2004, 185-224. Springer.
29. Kostoff R.N., Toothman D.R., Eberhart H.J., Humenik J.A. Text mining using database tomography and bibliometrics: a review. Technol. Forecast. Soc. Chang. 2001, 68(3):223-253.
30. Lee S., Lee S., Seol H., Park Y. Using patent information for designing new product and technology: keyword based technology roadmapping. R&D Manag. 2008, 38(2):169-188.
31. Lee S., Yoon B., Lee C., Park J. Business planning based on technological capabilities: patent analysis for technology-driven roadmapping. Technol. Forecast. Soc. Chang. 2009, 76(6):769-786.
32. Lee S., Yoon B., Park Y. An approach to discovering new technology opportunities: keyword-based patent map approach. Technovation 2009, 29(6):481-497.
33. Lu N., Zhang G., Lu J. Concept drift detection via competence models. Artif. Intell. 2014, 209:11-28.
34. McAfee A., Brynjolfsson E., Davenport T.H., Patil D., Barton D. Big data: the management revolution. Harv. Bus. Rev. 2012, 90(10):61-67.
35. Newman N.C., Porter A.L., Newman D., Trumbach C.C., Bolan S.D. Comparing methods to extract technical content for technological intelligence. J. Eng. Technol. Manag. 2014, 32:97-109.
36. Nichols L.G. A topic model approach to measuring interdisciplinarity at the National Science Foundation. Scientometrics 2014, 100(3):741-754.
37. Phaal R., Farrukh C.J., Probert D.R. Technology roadmapping-a planning framework for evolution and revolution. Technol. Forecast. Soc. Chang. 2004, 71(1):5-26.
38. Phaal R., Farrukh C.J., Probert D.R. Technology management tools: concept, development and application. Technovation 2006, 26(3):336-344.
39. Porter A.L., Cunningham S.W. Tech Mining: Exploiting New Technologies for Competitive Advantage 2004, vol. 29. John Wiley & Sons.
40. Porter A.L., Detampel M.J. Technology opportunities analysis. Technol. Forecast. Soc. Chang. 1995, 49(3):237-255.
41. Porter A.L., Guo Y., Huang L., Robinson D.K. Forecasting innovation pathways: the case of nano-enhanced solar cells. Paper Presented at the International Conference on Technological Innovation and Competitive Technical Intelligence 2010.
42. Porter A.L., Cunningham S.W., Sanz A. Extending the FIP (Forecasting Innovation Pathways) approach through an automotive case analysis. Paper Presented at the Technology Management in the IT-Driven Services (PICMET), 2013 Proceedings of PICMET'13 2013.
43. Robinson D.K., Propp T. Multi-path mapping for alignment strategies in emerging science and technologies. Technol. Forecast. Soc. Chang. 2008, 75(4):517-538.
44. Robinson D.K., Huang L., Guo Y., Porter A.L. Forecasting Innovation Pathways (FIP) for new and emerging science and technologies. Technol. Forecast. Soc. Chang. 2013, 80(2):267-285.
45. Salton G., Buckley C. Term-weighting approaches in automatic text retrieval. Inf. Process. Manag. 1988, 24(5):513-523.
46. Small H., Boyack K.W., Klavans R. Identifying emerging topics in science and technology. Res. Policy 2014, 43(8):1450-1467.
47. The While House Big Data: seizing opportunities preserving values. Retrieved October 24, 2014, from. http://www.whitehouse.gov/sites/default/files/docs/big_data_privacy_report_may_1_2014.pdf.
48. The White House Big data is a big deal Retrieved October 12, 2014, from. http://www.whitehouse.gov/blog/2012/03/29/big-data-big-deal.
49. Tran T.A., Daim T. A taxonomic review of methods and tools applied in technology assessment. Technol. Forecast. Soc. Chang. 2008, 75(9):1396-1405.
50. United States National Science Foundation United States National Science Foundation Retrieved October 12, 2014, from. http://www.nsf.gov/.
51. VantagePoint. (2015). VantagePoint. Retrieved April 10, 2015, from www.theVantagePoint.com.
52. Voorhees E.M. Implementing agglomerative hierarchic clustering algorithms for use in document retrieval. Inf. Process. Manag. 1986, 22(6):465-476.
53. Walsh S.T. Roadmapping a disruptive technology: a case study: the emerging microsystems and top-down nanosystems industry. Technol. Forecast. Soc. Chang. 2004, 71(1):161-185.
54. Waltman L., van Eck N.J., Noyons E.C. A unified approach to mapping and clustering of bibliometric networks. J. Inf. 2010, 4(4):629-635.
55. Wen J. Let science and technology lead China's sustainable development Retrieved October 14, 2014, from. http://www.chinanews.com/gn/news/2009/11-23/1979809.shtml.
56. Winebrake J.J. Alternate Energy: Assessment and Implementation Reference Book: The Fairmont Press, Inc 2004.
57. Wu H.C., Luk R.W.P., Wong K.F., Kwok K.L. Interpreting tf-idf term weights as making relevance decisions. ACM Trans. Inf. Syst. 2008, 26(3):13.
58. Yang L., Qiu M., Gottipati S., Zhu F., Jiang J., Sun H., Chen Z. Cqarank: jointly model topics and expertise in community question answering. Paper Presented at the Proceedings of the 22nd ACM International Conference on Conference on Information & Knowledge Management 2013.
59. Yau C.-K., Porter A., Newman N., Suominen A. Clustering scientific documents with topic modeling. Scientometrics 2014, 100(3):767-786.
60. Yoon B., Park Y. A systematic approach for identifying technology opportunities: keyword-based morphology analysis. Technol. Forecast. Soc. Chang. 2005, 72(2):145-160.
61. Zhang Y., Guo Y., Wang X., Zhu D., Porter A.L. A hybrid visualisation model for technology roadmapping: bibliometrics, qualitative methodology and empirical study. Tech. Anal. Strat. Manag. 2013, 25(6):707-724.
62. Zhang Y., Porter A.L., Hu Z., Guo Y., Newman N.C. "Term clumping" for technical intelligence: a case study on dye-sensitized solar cells. Technol. Forecast. Soc. Chang. 2014, 85:26-39.
63. Zhang Y., Zhou X., Porter A.L., Gomila J.M.V. How to combine term clumping and technology roadmapping for newly emerging science & technology competitive intelligence:"problem & solution" pattern based semantic TRIZ tool and case study. Scientometrics 2014, 101(2):1375-1389.
64. Zhang Y., Zhou X., Porter A.L., Gomila J.M.V., Yan A. Triple helix innovation in China's dye-sensitized solar cell industry: hybrid methods with semantic TRIZ and technology roadmapping. Scientometrics 2014, 99(1):55-75.
65. Zhang Y., Robinson D., Porter A.L., Zhu D., Zhang G., Lu J. Technology roadmapping for competitive technical Intelligence. Technol. Forecast. Soc. Chang. 2015, 10.1016/j.techfore.2015.11.029.
66. Zhu D., Porter A.L. Automated extraction and visualization of information for technological intelligence and forecasting. Technol. Forecast. Soc. Chang. 2002, 69(5):495-506.