Understanding differences in perceived peer-review helpfulness using natural language processing

Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2011 at the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-HLT 2011

Volumn , Issue , 2011, Pages 10-19

  Xiong, Wenting ^a   Litman, Diane ^a  

^a Learning Research and Development Ctr   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

ANALYSIS TECHNIQUES; AUTOMATIC PREDICTION; FEATURES SELECTION; LINGUISTIC FEATURES; PEER REVIEW; PRODUCT REVIEW ANALYSIS; QUALITY OF FEEDBACKS; STANDARD PRODUCTS;

STUDENTS;

EID: 84963505043     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Yigal Attali and Jill Burstein. 2006. Automated essay scoring with e-rater v.2. The Journal of Technology, Learning and Assessment (JTLA), 4(3), February.
2. Kwangsu Cho and Christian D. Schunn. 2007. Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system. Computers and Education, 48:409-426.
3. Kwangsu Cho. 2008. Machine classification of peer comments in physics. In Proceedings of the First International Conference on Educational Data Mining (EDM2008), pages 192-196.
4. Cristian Danescu-Niculescu-Mizil, Gueorgi Kossinets, Jon Kleinberg, and Lillian Lee. 2009. How opinions are received by online communities: A case study on Amazon.com helpfulness votes. In Proceedings of WWW, pages 141-150.
5. Raquel M. Crespo Garcia. 2010. Exploring document clustering techniques for personalized peer assessment in exploratory courses. In Proceedings of Computer-Supported Peer Review in Education (CSPRED) Workshop in the Tenth International Conference on Intelligent Tutoring Systems (ITS 2010).
6. Anindya Ghose and Panagiotis G. Ipeirotis. 2010. Estimating the helpfunless and economic impact of product reviews: Mining text and reviewer characteristics. IEEE Transactions on Knowledge and Data Engineering, 99.
7. Soo-Min Kim, Patrick Pantel, Tim Chklovski, and Marco Pennacchiotti. 2006. Automatically assessing review helpfulness. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP2006), pages 423-430, Sydney, Australia, July.
8. Kenji Kira and Larry A. Rendell. 1992. A practical approach to feature selection. In Derek H. Sleeman and Peter Edwards, editors, ML92: Proceedings of the Ninth International Conference on Machine Learning, pages 249-256, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
9. J. R. Landis and G. G. Koch. 1977. The measurement of observer agreement for categorical data. Biometrics, 33:159-174.
10. Chin-Yew Lin and Eduard Hovy. 2000. The automated acquisition of topic signatures for text summarization. In Proceedings of the 18th conference on Computational linguistics, volume 1 of COLING'00, pages 495-501, Stroudsburg, PA, USA. Association for Computational Linguistics.
11. Yang Liu, Xiangji Guang, Aijun An, and Xiaohui Yu. 2008. Modeling and predicting the helpfulness of online reviews. In Proceedings of the Eighth IEEE International Conference on Data Mining, pages 443-452, Los Alamitos, CA, USA.
12. Ryan McDonald, Koby Crammer, and Fernando Pereira. 2005. Online large-margin training of dependency parsers. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL'05, pages 91-98, Stroudsburg, PA, USA. Association for Computational Linguistics.
13. Melissa M. Nelson and Christian D. Schunn. 2009. The nature of feedback: how different types of peer feedback affect writing performance. Instructional Science, 37(4):375-401.
14. Melissa M. Patchan, Davida Charney, and Christian D. Schunn. 2009. A validation study of students' end comments: Comparing comments by students, a writing instructor, and a content instructor. Journal of Writing Research, 1(2):124-152.
15. Agnes Sandor and Angela Vorndran. 2009. Detecting key sentences for automatic assistance in peer-reviewing research articles in educational sciences. In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP), pages 36-44.
16. Oren Tsur and Ari Rappoport. 2009. Revrank: A fully unsupervised algorithm for selecting the most helpful book reviews. In Proceedings of the Third International AAAI Conference on Weblogs and Social Media (ICWSM2009), pages 36-44.
17. IH Witten and E. Frank. 2005. Data Mining: Practical Machine Learning Tools and Techniques, Second Edition. Morgan Kaufmann, San Francisco, CA.
18. Wenting Xiong and Diane Litman. 2010. Identifying problem localization in peer-review feedback. In Proceedings of Tenth International Conference on Intelligent Tutoring Systems (ITS2010), volume 6095, pages 429-431.
19. Wenting Xiong and Diane Litman. 2011. Automatically predicting peer-review helpfulness. In Proceedings 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL/HLT), Portland, Oregon, June.