Development and use of a gold-standard data set for subjectivity classifications

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 1999-June, Issue , 1999, Pages 246-253

  Wiebe, Janyce M ^a   Bruce, Rebecca F ^b   O'Hara, Thomas P ^a  

^a New Mexico State University   (United States)

^b UNIVERSITY OF NORTH CAROLINA AT ASHEVILLE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

AUTOMATIC CLASSIFIERS; CASE-STUDIES; DATA SET; GOLD STANDARDS; STATISTICAL TECHNIQUES; SUBJECTIVITY CLASSIFICATIONS;

CLASSIFICATION (OF INFORMATION);

EID: 85130750145     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. J. Badsberg. 1995. An Environment for Graphical Models. Ph.D. thesis, Aalborg University.
2. R. F. Bales. 1950. Interaction Process Analysis. University of Chicago Press, Chicago, ILL.
3. Ann Banfield. 1982. Unspeakable Sentences: Narration and Representation in the Language of Fiction. Routledge & Kegan Paul, Boston.
4. S. Bergler. 1992. Evidential Analysis o.f Reported Speech. Ph.D. thesis, Brandeis University.
5. Y.M. Bishop, S. Fienberg, and P. Holland. 1975. Discrete Multivariate Analysis: Theory and Practice. The MIT Press, Cambridge.
6. R. Bruce and J. Wiebe. 1998. Word sense distinguishability and inter-coder agreement. In Proc. 3rd Conference on Empirical Methods in Natural Language Processing (EMNLP-98), pages 53-60, Granada, Spain, June. ACL SIGDAT.
7. R. Bruce and J. Wiebe. 1999. Decomposable modelingin natural language processing. Computational Linguistics, 25(2).
8. R. Bruce and J. Wiebe. to appear. Recognizing subjectivity: A case study of manual tagging. Natural Language Engineering.
9. J. Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2):249-254.
10. W. Chafe. 1986. Evidentiality in English conversation and academic writing. In Wallace Chafe and Johanna Nichols, editors, Evidentiality: The Linguistic Coding of Epistemology, pages 261-272. Ablex, Norwood, NJ.
11. P. Cheeseman and J. Stutz. 1996. Bayesian classification (AutoClass): Theory and results. In Fayyad, Piatetsky-Shapiro, Smyth, and Uthurusamy, editors, Advances in Knowledge Discovery and Data Mining. AAAI Press/MIT Press.
12. J. Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Meas., 20:37-46.
13. A. P. Dawid and A. M. Skene. 1979. Maximum likelihood estimation of observer error-rates using the EM algorithm. Applied Statistics, 28:20-28.
14. A. Dempster, N. Laird, and D. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39 (Series B):1-38.
15. T. Dunning. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):75-102.
16. L. Goodman. 1974. Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 61:2:215-231.
17. V. Hatzivassiloglou and K. McKeown. 1997. Predicting the semantic orientation of adjectives. In ACL-EACL 1997, pages 174-181, Madrid, Spain, July.
18. Eduard Hovy. 1987. Generating Natural Language under Pragmatic Constraints. Ph.D. thesis, Yale University.
19. D. Jurafsky, E. Shriberg, and D. Biasca. 1997. Switchboard SWBD-DAMSL shallow-discourse-functionannotation coders manual, draft 13. Technical Report 97-01, University of Colorado Institute of Cognitive Science.
20. M.-Y. Kan, J. L. Klavans, and K. R. McKeown. 1998. Linear segmentation and segment significance. In Proc. 6th Workshop on Very Large Corpora (WVLC-98), pages 197-205, Montreal, Canada, August. ACL SIGDAT.
21. K. Krippendorf. 1980. Content Analysis: An Introduction to its Methodology. Sage Publications, Beverly Hills.
22. P. Lazarsfeld. 1966. Latent structure analysis. In S. A. Stouffer, L. Guttman, E. Such-man, P.Lazarfeld, S. Star, and J. Claussen, editors, Measurement and Prediction. Wiley, New York.
23. D. Litman. 1996. Cue phrase classification using machine learning. Journal of Artificial Intelligence Research, 5:53-94.
24. M.
25. Marcus, Santorini, B., and M. Marcinkiewicz. 1993. Building a large annotated corpus of English: The penn treebank. Computational Linguistics, 19(2):313-330.
26. Ted Pedersen and Rebecca Bruce. 1998. Knowledge lean word-sense disambiguation. In Proc. of the 15th National Conference on Artificial Intelligence (AAAI-98), Madison, Wisconsin, July.
27. R. Quirk, S. Greenbaum, G. Leech, and J. Svartvik. 1985. A Comprehensive Grammar of the English Language. Longman, New York.
28. T. Read and N. Cressie. 1988. Goodness-of-fit Statistics for Discrete Multivariate Data. Springer-Verlag Inc., New York, NY.
29. K. Samuel, S. Carberry, and K. Vijay-Shanker. 1998. Dialogue act tagging with transformation-based learning. In Proc. COLING-ACL 1998, pages 1150-1156, Montreal, Canada, August.
30. T.A. van Dijk. 1988. News as Discourse. Lawrence Erlbaum, Hillsdale, NJ.
31. J. Wiebe, R. Bruce, and L. Duan. 1997. Probabilistic event categorization. In Proc. Recent Advances in Natural Language Processing (RANLP-97), pages 163-170, Tsigov Chark, Bulgaria, September.
32. J. Wiebe, K. McKeever, and R. Bruce. 1998. Mapping collocational properties into machine learning features. In Proc. 6th Workshop on Very Large Corpora (WVLC-98), pages 225-233, Montreal, Canada, August. ACL SIGDAT.
33. J. Wiebe, J. Klavans, and M.Y. Kan. in preparation. Verb profiles for subjectivity judgments and text classification.
34. J. Wiebe. 1 9 9 4. Tracking point of view in narrative. Computational Linguistics, 20(2):233-287.