CRIE: An automated analyzer for Chinese texts

Behavior Research Methods

Volumn 48, Issue 4, 2016, Pages 1238-1251

  Sung, Yao Ting ^a   Chang, Tao Hsing ^b   Lin, Wei Chun ^a   Hsieh, Kuan Sheng ^a   Chang, Kuo En ^a  

^a NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

^b NATIONAL KAOHSIUNG UNIVERSITY OF APPLIED SCIENCES   (Taiwan)

Author keywords

Chinese text analysis; CRIE; Linguistic feature; Readability

Indexed keywords

ASIAN CONTINENTAL ANCESTRY GROUP; COMPREHENSION; HUMAN; LINGUISTICS; SOFTWARE;

ASIAN CONTINENTAL ANCESTRY GROUP; COMPREHENSION; HUMANS; LINGUISTICS; SOFTWARE;

EID: 84944704384     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-015-0649-1     Document Type: Article

References (57)

1. Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® V. 2. Journal of Technology, Learning and Assessment, 4(3), 1–31.
2. Bååth, R. (2010). ChildFreq: An online tool to explore word frequencies in child language. LUCS Minor, 16, 1–6.
3. Balota, D. A., & Chumbley, J. J. (1984). Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. Journal of Experimental Psychology: Human Perception and Performance, 10, 340–357.
4. Bassiou, N., & Kotropoulos, C. (2011). Long distance bigram models applied to word clustering. Pattern Recognition, 44(1), 145–158.
5. Benjamin, R. (2012). Reconstructing readability: Recent developments and recommendations in the analysis of text difficulty. Educational Psychology Review, 24(1), 63–88.
6. Burstein, J. (2003). The e-rater scoring engine: Automated essay scoring with natural language processing. In M. D. Shermis & J. Burstein (Eds.), Automated essay scoring: A cross-disciplinary perspective (pp. 113–121). Mahwah: Lawrence Erlbaum Associate, Inc.
7. Carpenter, P. A., & Just, M. A. (1983). What your eyes do while your mind is reading. In K. Rayner (Ed.), Eye movements in reading: Perceptual and language processes (pp. 275–307). New York: Academic Press.
8. Cha, J. H., Chen, J. L., Chang, T. H, & Sung, Y. T. (2013). The development of an automated analyzer for Chinese text. Paper presented at the 23rd meeting of Society of Computers in Psychology (SCiP 2013), Toronto, Canada.
9. Chall, J. S., & Dale, E. (1995). Readability revisited and the New Dale-Chall Readability Formula. Cambridge: Brookline Books.
10. Chang, L. P. (2012). The study of the vocabulary size at the CEFR levels for CFL/CSL learners. Journal of Chinese Language Teaching, 9(2), 77–96.
11. Chang, T. H., Sung, Y. T., & Lee, Y. T. (2012). A Chinese word segmentation and POS tagging system for readability research. Paper presented at 42nd annual meeting of the Society for Computers in Psychology (SCiP 2012), Minneapolis, MN.
12. st annual meeting of the International Association of Chinese Linguistics, Taipei, Taiwan.
13. Chang, T. H., Sung, Y. T., & Lee, Y. T. (2013b). Evaluating the difficulty of concepts on domain knowledge using latent semantic analysis. In G. Fu, H. Qi, M. Dong, M. Zhang, & Y. Aibaidula (Eds.), Proceedings of the 2013 International Conference on Asian Language Processing (IALP 2013) (pp. 193–196). Los Alamitos: IEEE.
14. Chen, F. Y., Tsai, P. F., Chen, K. J., & Huang, C. R. (1999). Sinica Treebank. Computational Linguistics and Chinese Language Processing (CLCLP), 4(2), 87–104.
15. CKIP (1993). Chinese Electronic Dictionary. Technical Report, No. 93-05, Taiwan: Academia Sinica.
16. CKIP (1998). Accumulated word frequency in CKIP corpus. Technical Report, No. 98–02. Taipei, Taiwan: The Association for Computational Linguistics and Chinese Language Processing.
17. Council of Europe (2001). Common European Framework of Reference for Language: Learning, teaching and assessment. Cambridge: Cambridge University Press. Retrieved from http://www.coe.int/t/dg4/linguistic/Source/Framework_EN.pdf
18. Crossley, S. A., Greenfield, J., & McNamara, D. S. (2008). Assessing text readability using cognitively based indices. TESOL Quarterly, 42(3), 475–493.
19. Cui, X. (1995). Some syntactic and semantic puzzles concerning the Ba-construction. Chinese Teaching in the World, 33(3), 12–21.
20. Duchon, A., Perea, M., Sebastián-Gallés, N., Martí, A., & Carreiras, M. (2013). EsPal: One-stop shopping for Spanish word properties. Behavior Research Methods, 45(4), 1–13.
21. Foltz, P. W., Laham, D., & Landauer, T. K. (1999). The intelligent essay assessor: Applications to educational technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning, 1(2), 939–944.
22. Forster, K. I., & Chambers, S. M. (1973). Lexical access and naming time. Journal of Verbal Learning and Verbal Behavior, 12, 627–635.
23. Friedman, D. B., & Hoffman-Goetz, L. (2006). A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Education & Behavior, 33(3), 352–373.
24. Fry, E. B., Kress, J. E., & Fountoukidis, D. L. (1993). The reading teacher’s book of lists (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
25. Graddol, D. (2004). The future of language. Science, 303, 1329–1331.
26. Hsieh, K. S., Lin, W. C., Dyson, S. B., Liu, P. C., & Sung, Y. T. (2014). Leveling L2 texts through readability: Combining multilevel linguistic features with CEFR. Paper presented at the 4th Annual Asian Conference on Technology in the Classroom (ACTC 2014), Osaka, Japan.
27. Huang, C. R. (2009). Tagged Chinese Gigaword Version 2.0 LDC2009T14. Philadelphia: Linguistic Data Consortium.
28. Huang, C. R., Chen, K. J., Chen, F. Y., Wei, W. J., & Chang, L. L. (1997). Design criteria and content of segmentation standard for Chinese information processing. Applied Linguistics, 1, 92–100.
29. Huang, C. L., Chung, C. K., Hui, N., Lin, Y. C., Seih, Y. T., Lam, B. C. P., … Pennebaker, J. W. (2012). The development of the Chinese Linguistic Inquiry and Word Count dictionary. Chinese Journal of Psychology, 54(2), 185–201.
30. Johnson, M. (1998). PCFG models of linguistic tree representations. Computational Linguistics, 24(4), 613–632.
31. Just, M. A., & Carpenter, P. A. (1987). Orthography: Its structure and effects on reading. In M. A. Just & P. A. Carpenter (Eds.), The psychology of reading and language processing (pp. 287–325). Newton: Allyn and Bacon.
32. Lafferty, J., McCallum, A., & Pereira, F. C. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In C. E. Brodley & A. P. Danyluk (Eds.), Proceedings of the Eighteenth International Conference on Machine Learning (pp. 282–289). San Francisco: Morgan Kaufmann.
33. Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211–240.
34. Lehnert, W. G., & Ringle, M. H. (1982). Strategies for natural language processing. Hillsdale: Lawrence Erlbaum Associates.
35. Lewis, M. P. (2009). Ethnologue: Languages of the world (sixteenthth ed.). Dallas: SIL International.
36. Lin, K. P., & Chen, M. S. (2011). On the design and analysis of the privacy-preserving SVM classifier. IEEE Transactions on Knowledge and Data Engineering, I., 23(11), 1704–1717.
37. Manning, C., & Klein, D. (2002). Fast exact inference with a factored model for natural language parsing. In S. Becker, S. Thrun, & K. Obermayer (Eds.), Proceedings of Advances in Neural Information Processing Systems 15 (NIPS 2002) (pp. 3–10). Vancouver: Neural Information Processing Systems Foundation.
38. Marsden, E., Myles, F., Rule, S., & Mitchell, R. (2003). Using CHILDES tools for researching second language acquisition. British Studies in Applied Linguistics, 18, 98–113.
39. McCusker, L. M. (1977). Some determinants of word recognition: Frequency. Paper presented at the 24th Annual Convention of the Southwestern Psychological Association, Fort Worth, TX.
40. McNamara, D. S., Louwerse, M. M., McCarthy, P. M., & Graesser, A. C. (2010). Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes, 47(4), 292–330.
41. McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014). Automated evaluation of text and discourse with Coh-Metrix. New York: Cambridge University Press.
42. Miltsakaki, E. (2009). Matching readers’ preferences and reading skills with appropriate web texts. Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations session, Greece, 12, 49–52. doi:10.3115/1609049.1609054.
43. Ney, H. (1991). Dynamic programming parsing for context-free grammars in continuous speech recognition. IEEE Transactions on Signal Processing, 39(2), 336–340.
44. Pal, M., & Foody, G. M. (2010). Feature selection for classification of hyperspectral data by SVM. IEEE Transactions on Geoscience and Remote Sensing, 48(5), 2297–2307.
45. Petrov, S., Barrett, L., Thibaux, R., & Klein, D. (2006). Learning accurate, compact and interpretable tree annotation. In Proceedings of the 21st COLING and the 44th Annual Meeting of the Association for Computational Linguistics (pp. 433–440). Sydney, Australia: Association for Computational Linguistics.
46. Rudner, L. M., & Liang, T. (2002). Automated essay scoring using Bayes' theorem. The Journal of Technology, Learning and Assessment, 1(2), 1–22.
47. Smolkin, L. B., McTigue, E. M., & Yeh, Y.-F. (2013). Searching for explanations in science trade books: What can we learn from Coh-metrix. International Journal of Science Education, 35, 1367–1384.
48. Su, Y. F., & Samuels, S. J. (2010). Developmental changes in character-complexity and word-length effects when reading Chinese script. Reading and Writing: An Interdisciplinary Journal, 23, 1085–1108.
49. Sung, Y. T., Chen, J. L., Lee, Y. S., Cha, J. H., Tseng, H. C., Lin, W. C., & Chang, K. E. (2013). Investigating chinese text readability: Linguistic features, modeling, validation. Chinese Journal of Psychology, 55(1), 75–106.
50. Sung, Y. T., Lin, W. C, & Tseng, H. C. (2014). Analyzing the readability of textbooks at different learning stages. Paper presented at the 2014 International Workshop on Linguistic Features Analysis, Taipei, Taiwan.
51. Sung, Y. T., Chen, J. L., Cha, J. H., Tseng, H. C., Chang, T. H., & Chang, K. E. (2015). Constructing and validating readability models: the method of integrating multilevel linguistic features with machine learning. Behavior Research Methods, 47(2), 340–354.
52. Tsai, Y. F., & Chen, K. J. (2004). Reliable and Cost-Effective PoS-Tagging. International Journal of Computational Linguistics and Chinese Language Processing, 9(1), 83–96.
53. Tseng, H. C., Chang, T. H., Chen, B. L. & Sung, Y. T. (2014). Analyzing textbooks by a readability model based on concepts and support vector machine. Paper presented at the Asian Conference on Language Learning (ACLL 2014), Osaka, Japan.
54. Vapnik, V. N., & Chervonenkis, A. Y. (1974). Teoriya raspoznavaniya obrazov: Statisticheskie problemy obucheniya [Theory of pattern recognition: Statistical problems of learning]. Moscow: Nauka.
55. Whaley, C. P. (1978). Word-nonword classification time. Journal of Verbal Learning and Verbal Behavior, 17(2), 143–154.
56. Xue, N. (2003). Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8(1), 29–48.
57. Zhao, Y. (2011). Review article: A tree in the wood: A review of research on L2 Chinese acquisition. Second Language Research, 27(4), 559–572.