Reducing noise in labels and features for a real world dataset: Application of NLP corpus annotation methods

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5449 LNCS, Issue , 2009, Pages 86-97

  Passonneau, Rebecca J ^a   Rudin, Cynthia ^a   Radeva, Axinia ^a   Liu, Zhi An ^a  

^a Howard Hughes Medical Institute   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANNOTATION METHODS; DATA SETS; DOCUMENT CLASSIFICATION; DOMAIN EXPERTS; ELECTRICAL GRIDS; FEATURE REPRESENTATION; INFORMATION EXTRACTION; KNOWLEDGE TRANSFER; MACHINE-LEARNING; MANHATTANS; OPERATIONAL DEFINITION; REDUCING NOISE; RULE BASED;

COMPUTATIONAL LINGUISTICS; KNOWLEDGE MANAGEMENT; LABELS; NATURAL LANGUAGE PROCESSING SYSTEMS; ROBOT LEARNING; TEXT PROCESSING; WORD PROCESSING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 67650535515     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-00382-0_7     Document Type: Conference Paper

References (14)

1. Gross, P., Boulanger, A., Arias, M., Waltz, D.L., Long, P.M., Lawson, C., Anderson, R., Koenig, M., Mastrocinque, M., Fairechio, W., Johnson, J.A., Lee, S., Doherty, F., Kressner, A.: Predicting electricity distribution feeder failures using machine learning susceptibility analysis. In: The 18th Conference on Innovative Applications of Artificial Intelligence IAAI 2006, Boston, Massachusetts (2006)
2. Liddy, E.D., Symonenko, S., Rowe, S.: Sublanguage analysis applied to trouble tickets. In: Proceedings of the Florida Artificial Intelligence Research Society Conference, pp. 752-757 (2006)
3. Devaney, M., Ram, A.: Preventing failures by mining maintenance logs with casebased reasoning. In: Proceedings of the 59th Meeting of the Society for Machinery Failure Prevention Technology (MFPT-59) (2005)
4. Hirschman, L., Palmer, M., Dowding, J., Dahl, D., Linebarger, M., Passonneau, R., Land, F., Ball, C., Weir, C.: The PUNDIT natural-language processing system. In: Proceedings of the Annual AI Systems in Government Conference, pp. 234-243 (1989)
5. Oza, N., Castle, J.P., Stutz, J.: Classification of aeronautics system health and safety documents. IEEE Transactions on Systems, Man and Cybernetics, Part C (accepted for publication)
6. Rudin, C., Passonneau, R.J., Radeva, A., Dutta, H., Ierome, S., Isaac, D.: Predicting vulnerability to serious manhole events in manhattan: A preliminary machine learning approach (submitted for publication)
7. Freund, Y., Iyer, R., Schapire, R.E., Singer, Y.: An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research 4, 933-969 (2003)
8. Rudin, C.: The P-Norm Push: A simple convex ranking algorithm that concentrates at the top of the list. Journal of Machine Learning Research (accepted, 2008)
9. Joachims, T.: A support vector method for multivariate performance measures. In: Proceedings of the Internat'l. Conf. on Machine Learning (ICML), pp. 377-384 (2005)
10. Artstein, R., Poesio, M.: Inter-coder agreement for computational linguistics. computational linguistics (to appear)
11. Cohen, J.: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37-46 (1960)
12. Krippendorff, K.: Content analysis: An introduction to its methodology. Sage Publications, Beverly Hills (1980)
13. Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159-174 (1977)
14. Jaccard, P.: Nouvelles recherches sur la distribution florale. Bulletin de la Societe Vaudoise des Sciences Naturelles 44, 223-270 (1908)