Towards data submissions for shared tasks: First experiences for the task of text alignment

CEUR Workshop Proceedings

Volumn 1391, Issue , 2015, Pages

  Potthast, Martin ^a   Göring, Steve ^a   Rosso, Paolo ^b   Stein, Benno ^a  

^a BAUHAUS UNIVERSITY WEIMAR   (Germany)

^b UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SUBMISSION; PARTICIPATING TEAMS; PREVIOUS YEAR; SERVICE PLATFORMS; TEXT ALIGNMENTS;

ALIGNMENT;

EID: 84980488443     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (67)

1. Proceedings of the Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation, Position Papers, April 20-21, 2007. The Ohio State University, Arlington, Virginia, USA (2007)
2. Abnar, S., Dehghani, M., Zamani, H., Shakery, A.: Expanded N-Grams for Semantic Text Alignment-Notebook for PAN at CLEF 2014. In: [7]
3. Alvi, F., Stevenson, M., Clough, P.: Hashing and Merging Heuristics for Text Reuse Detection-Notebook for PAN at CLEF 2014. In: [7]
4. Alvi, F., Stevenson, M., Clough, P.: The Short Stories Corpus-Notebook for PAN at CLEF 2015. In: [8]
5. Asghari, H., Khoshnavataher, K., Fatemi, O., Faili, H.: Developing Bilingual Plagiarism Detection Corpus Using Sentence Aligned Parallel Corpus-Notebook for PAN at CLEF 2015. In: [8]
6. Burrows, S., Potthast, M., Stein, B.: Paraphrase Acquisition via Crowdsourcing and Machine Learning. Transactions on Intelligent Systems and Technology (ACM TIST) 4(3), 43:1-43:21 (Jun 2013), http://dl.acm.org/citation.cfm?id=2483676
7. Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.): CLEF 2014 Evaluation Labs and Workshop-Working Notes Papers, 15-18 September, Sheffield, UK. CEUR Workshop Proceedings, CEUR-WS.org (2014), http://www.clef-initiative.eu/publication/working-notes
8. Cappellato, L., Ferro, N., Jones, G., San Juan, E. (eds.): CLEF 2015 Evaluation Labs and Workshop-Working Notes Papers, 8-11 September, Toulouse, France. CEUR Workshop Proceedings, CEUR-WS.org (2015), http://www.clef-initiative.eu/publication/working-notes
9. Cheema, W., Najib, F., Ahmed, S., Bukhari, S., Sittar, A., Nawab, R.: A Corpus for Analyzing Text Reuse by People of Different Groups-Notebook for PAN at CLEF 2015. In: [8]
10. Forner, P., Karlgren, J., Womser-Hacker, C. (eds.): CLEF 2012 Evaluation Labs and Workshop-Working Notes Papers, 17-20 September, Rome, Italy (2012), http://www.clef-initiative.eu/publication/working-notes
11. Forner, P., Navigli, R., Tufis, D. (eds.): CLEF 2013 Evaluation Labs and Workshop-Working Notes Papers, 23-26 September, Valencia, Spain (2013), http://www.clef-initiative.eu/publication/working-notes
12. Franco-Salvador, M., Bensalem, I., Flores, E., Gupta, P., Rosso, P.: PAN 2015 Shared Task on Plagiarism Detection: Evaluation of Corpora for Text Alignment-Notebook for PAN at CLEF 2015. In: [8]
13. Gillam, L.: Guess Again and See if They Line Up: Surrey's Runs at Plagiarism Detection-Notebook for PAN at CLEF 2013. In: [11]
14. Gillam, L., Newbold, N., Cooke, N.: Educated Guesses and Equality Judgements: Using Search Engines and Pairwise Match for External Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
15. Gillam, L., Notley, S.: Evaluating Robustness for 'IPCRESS': Surrey's Text Alignment for Plagiarism Detection-Notebook for PAN at CLEF 2014. In: [7]
16. Glinos, D.: A Hybrid Architecture for Plagiarism Detection-Notebook for PAN at CLEF 2014. In: [7]
17. Gollub, T., Potthast, M., Beyer, A., Busse, M., Rangel, F., Rosso, P., Stamatatos, E., Stein, B.: Recent Trends in Digital Text Forensics and its Evaluation. In: Forner, P., Müller, H., Paredes, R., Rosso, P., Stein, B. (eds.) Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. 4th International Conference of the CLEF Initiative (CLEF 13). pp. 282-302. Springer, Berlin Heidelberg New York (Sep 2013)
18. Gollub, T., Stein, B., Burrows, S.: Ousting Ivory Tower Research: Towards a Web Framework for Providing Experiments as a Service. In: Hersh, B., Callan, J., Maarek, Y., Sanderson, M. (eds.) 35th International ACM Conference on Research and Development in Information Retrieval (SIGIR 12). pp. 1125-1126. ACM (Aug 2012)
19. Gross, P., Modaresi, P.: Plagiarism Alignment Detection by Merging Context Seeds-Notebook for PAN at CLEF 2014. In: [7]
20. Hagen, M., Potthast, M., Stein, B.: Source Retrieval for Plagiarism Detection from Large Web Corpora: Recent Approaches. In: Working Notes Papers of the CLEF 2015 Evaluation Labs. CEUR Workshop Proceedings, CLEF and CEUR-WS.org (Sep 2015), http://www.clef-initiative.eu/publication/working-notes
21. Hanif, I., Nawab, A., Arbab, A., Jamshed, H., Riaz, S., Munir, E.: Cross-Language Urdu-English (CLUE) Text Alignment Corpus-Notebook for PAN at CLEF 2015. In: [8]
22. Hopfgartner, F., Hanbury, A., Müller, H., Kando, N., Mercer, S., Kalpathy-Cramer, J., Potthast, M., Gollub, T., Krithara, A., Lin, J., Balog, K., Eggel, I.: Report on the Evaluation-as-a-Service (EaaS) Expert Workshop. SIGIR Forum 49(1), 57-65 (Jun 2015), http://sigir.org/forum/issues/june-2015/
23. Jayapal, A.: Similarity Overlap Metric and Greedy String Tiling at PAN 2012: Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
24. Jayapal, A., Goswami, B.: Submission to the 5th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-13 (2013), http://www.clef-initiative.eu/publication/working-notes, From Nuance Communications, USA
25. Khoshnavataher, K., Zarrabi, V., Mohtaj, S., Asghari, H.: Developing Monolingual Persian Corpus for Extrinsic Plagiarism Detection Using Artificial Obfuscation-Notebook for PAN at CLEF 2015. In: [8]
26. Kong, L., Han, Y., Han, Z., Yu, H., Wang, Q., Zhang, T., Qi, H.: Source Retrieval Based on Learning to Rank and Text Alignment Based on Plagiarism Type Recognition for Plagiarism Detection-Notebook for PAN at CLEF 2014. In: [7]
27. Kong, L., Lu, Z., Han, Y., Qi, H., Han, Z., Wang, Q., Hao, Z., Zhang, J.: Source Retrieval and Text Alignment Corpus Construction for Plagiarism Detection-Notebook for PAN at CLEF 2015. In: [8]
28. Kong, L., Qi, H., Du, C., Wang, M., Han, Z.: Approaches for Source Retrieval and Text Alignment of Plagiarism Detection-Notebook for PAN at CLEF 2013. In: [11]
29. Kong, L., Qi, H., Wang, S., Du, C., Wang, S., Han, Y.: Approaches for Candidate Document Retrieval and Detailed Comparison of Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
30. Küppers, R., Conrad, S.: A Set-Based Approach to Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
31. Meyer zu Eißen, S., Stein, B.: Intrinsic Plagiarism Detection. In: Lalmas, M., MacFarlane, A., Rüger, S., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds.) Advances in Information Retrieval. 28th European Conference on IR Research (ECIR 06). Lecture Notes in Computer Science, vol. 3936 LNCS, pp. 565-569. Springer, Berlin Heidelberg New York (2006)
32. Mohtaj, S., Asghari, H., Zarrabi, V.: Developing Monolingual English Corpus for Plagiarism Detection using Human Annotated Paraphrase Corpus-Notebook for PAN at CLEF 2015. In: [8]
33. Nourian, A.: Submission to the 5th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-13 (2013), http://www.clef-initiative.eu/publication/working-notes, From the Iran University of Science and Technology
34. Oberreuter, G., Carrillo-Cisneros, D., Scherson, I., Velásquez, J.: Submission to the 4th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-12 (2012), http://www.clef-initiative.eu/publication/working-notes, From the University of Chile, Chile, and the University of California, USA
35. Oberreuter, G., Eiselt, A.: Submission to the 6th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-14 (2014), http://www.clef-initiative.eu/publication/working-notes, From Innovand.io, Chile
36. Palkovskii, Y., Belov, A.: Submission to the 7th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-15 (2015), http://www.clef-initiative.eu/publication/working-notes, From the Zhytomyr State University and SkyLine LLC
37. Palkovskii, Y.: "Counter Plagiarism Detection Software" and "Counter Counter Plagiarism Detection" Methods. In: Stein, B., Rosso, P., Stamatatos, E., Koppel, M., Agirre, E. (eds.) SEPLN 2009 Workshop on Uncovering Plagiarism, Authorship, and Social Software Misuse (PAN 09). pp. 67-68. Universidad Politécnica de Valencia and CEUR-WS.org (Sep 2009), http://ceur-ws.org/Vol-502
38. Palkovskii, Y., Belov, A.: Applying Specific Clusterization and Fingerprint Density Distribution with Genetic Algorithm Overall Tuning in External Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
39. Palkovskii, Y., Belov, A.: Using Hybrid Similarity Methods for Plagiarism Detection-Notebook for PAN at CLEF 2013. In: [11]
40. Palkovskii, Y., Belov, A.: Developing High-Resolution Universal Multi-Type N-Gram Plagiarism Detector-Notebook for PAN at CLEF 2014. In: [7]
41. Potthast, M., Barrón-Cedeño, A., Eiselt, A., Stein, B., Rosso, P.: Overview of the 2nd International Competition on Plagiarism Detection. In: Braschler, M., Harman, D., Pianta, E. (eds.) Working Notes Papers of the CLEF 2010 Evaluation Labs (Sep 2010), http://www.clef-initiative.eu/publication/working-notes
42. Potthast, M., Barrón-Cedeño, A., Stein, B., Rosso, P.: Cross-Language Plagiarism Detection. Language Resources and Evaluation (LREV) 45(1), 45-62 (Mar 2011)
43. Potthast, M., Eiselt, A., Barrón-Cedeño, A., Stein, B., Rosso, P.: Overview of the 3rd International Competition on Plagiarism Detection. In: Petras, V., Forner, P., Clough, P. (eds.) Working Notes Papers of the CLEF 2011 Evaluation Labs (Sep 2011), http://www.clef-initiative.eu/publication/working-notes
44. Potthast, M., Gollub, T., Hagen, M., Graßegger, J., Kiesel, J., Michel, M., Oberländer, A., Tippmann, M., Barrón-Cedeño, A., Gupta, P., Rosso, P., Stein, B.: Overview of the 4th International Competition on Plagiarism Detection. In: Forner, P., Karlgren, J., Womser-Hacker, C. (eds.) Working Notes Papers of the CLEF 2012 Evaluation Labs (Sep 2012), http://www.clef-initiative.eu/publication/working-notes
45. Potthast, M., Gollub, T., Hagen, M., Tippmann, M., Kiesel, J., Rosso, P., Stamatatos, E., Stein, B.: Overview of the 5th International Competition on Plagiarism Detection. In: Forner, P., Navigli, R., Tufis, D. (eds.) Working Notes Papers of the CLEF 2013 Evaluation Labs (Sep 2013), http://www.clef-initiative.eu/publication/working-notes
46. Potthast, M., Gollub, T., Rangel, F., Rosso, P., Stamatatos, E., Stein, B.: Improving the Reproducibility of PAN's Shared Tasks: Plagiarism Detection, Author Identification, and Author Profiling. In: Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., Toms, E. (eds.) Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. 5th International Conference of the CLEF Initiative (CLEF 14). pp. 268-299. Springer, Berlin Heidelberg New York (Sep 2014)
47. Potthast, M., Hagen, M., Beyer, A., Busse, M., Tippmann, M., Rosso, P., Stein, B.: Overview of the 6th International Competition on Plagiarism Detection. In: Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.) Working Notes Papers of the CLEF 2014 Evaluation Labs. CEUR Workshop Proceedings, CLEF and CEUR-WS.org (Sep 2014), http://www.clef-initiative.eu/publication/working-notes
48. Potthast, M., Hagen, M., Stein, B., Graßegger, J., Michel, M., Tippmann, M., Welsch, C.: ChatNoir: A Search Engine for the ClueWeb09 Corpus. In: Hersh, B., Callan, J., Maarek, Y., Sanderson, M. (eds.) 35th International ACM Conference on Research and Development in Information Retrieval (SIGIR 12). p. 1004. ACM (Aug 2012)
49. Potthast, M., Hagen, M., Völske, M., Stein, B.: Crowdsourcing Interaction Logs to Understand Text Reuse from the Web. In: Fung, P., Poesio, M. (eds.) Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL 13). pp. 1212-1221. Association for Computational Linguistics (Aug 2013), http://www.aclweb.org/anthology/P13-1119
50. Potthast, M., Stein, B., Barrón-Cedeño, A., Rosso, P.: An Evaluation Framework for Plagiarism Detection. In: Huang, C.R., Jurafsky, D. (eds.) 23rd International Conference on Computational Linguistics (COLING 10). pp. 997-1005. Association for Computational Linguistics, Stroudsburg, Pennsylvania (Aug 2010)
51. Potthast, M., Stein, B., Eiselt, A., Barrón-Cedeño, A., Rosso, P.: Overview of the 1st International Competition on Plagiarism Detection. In: Stein, B., Rosso, P., Stamatatos, E., Koppel, M., Agirre, E. (eds.) SEPLN 09 Workshop on Uncovering Plagiarism, Authorship, and Social Software Misuse (PAN 09). pp. 1-9. CEUR-WS.org (Sep 2009), http://ceur-ws.org/Vol-502
52. Rodríguez Torrejón, D., Martín Ramos, J.: Detailed Comparison Module In CoReMo 1.9 Plagiarism Detector-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
53. Rodríguez Torrejón, D., Martín Ramos, J.: Text Alignment Module in CoReMo 2.1 Plagiarism Detector-Notebook for PAN at CLEF 2013. In: [11]
54. Rodríguez Torrejón, D., Martín Ramos, J.: CoReMo 2.3 Plagiarism Detector Text Alignment Module-Notebook for PAN at CLEF 2014. In: [7]
55. Rosvall, M., Bergstrom, C.: Maps of Random Walks on Complex Networks Reveal Community Structure. Proceedings of the National Academy of Sciences 105(4), 1118-1123 (2008)
56. Sanchez-Perez, M., Gelbukh, A., Sidorov, G.: Dynamically Adjustable Approach through Obfuscation Type Recognition-Notebook for PAN at CLEF 2015. In: [8]
57. Sanchez-Perez, M., Sidorov, G., Gelbukh, A.: A Winning Approach to Text Alignment for Text Reuse Detection at PAN 2014-Notebook for PAN at CLEF 2014. In: [7]
58. Sánchez-Vega, F., y Gómez, M.M., Villaseñor-Pineda, L.: Optimized Fuzzy Text Alignment for Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
59. Saremi, M., Yaghmaee, F.: Submission to the 5th International Competition on Plagiarism Detection. http://www.uni-weimar.de/medien/webis/events/pan-13 (2013), http://www.clef-initiative.eu/publication/working-notes, From Semnan University, Iran
60. Shrestha, P., Maharjan, S., Solorio, T.: Machine Translation Evaluation Metric for Text Alignment-Notebook for PAN at CLEF 2014. In: [7]
61. Shrestha, P., Solorio, T.: Using a Variety of n-Grams for the Detection of Different Kinds of Plagiarism-Notebook for PAN at CLEF 2013. In: [11]
62. Stamatatos, E., Potthast, M., Rangel, F., Rosso, P., Stein, B.: Overview of the PAN/CLEF 2015 Evaluation Lab. In: Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. 6th International Conference of the CLEF Initiative (CLEF 15). Springer, Berlin Heidelberg New York (Sep 2015)
63. Stein, B., Lipka, N., Prettenhofer, P.: Intrinsic Plagiarism Analysis. Language Resources and Evaluation (LRE) 45(1), 63-82 (Mar 2011)
64. Stein, B., Meyer zu Eißen, S.: Near Similarity Search and Plagiarism Analysis. In: Spiliopoulou, M., Kruse, R., Borgelt, C., Nürnberger, A., Gaul, W. (eds.) From Data and Information Analysis to Knowledge Engineering. Selected papers from the 29th Annual Conference of the German Classification Society (GFKL 05). pp. 430-437. Studies in Classification, Data Analysis, and Knowledge Organization, Springer, Berlin Heidelberg New York (2006)
65. Suchomel, Šimon., Kasprzak, J., Brandejs, M.: Three Way Search Engine Queries with Multi-feature Document Comparison for Plagiarism Detection-Notebook for PAN at CLEF 2012. In: [10], http://www.clef-initiative.eu/publication/working-notes
66. Suchomel, Šimon., Kasprzak, J., Brandejs, M.: Diverse Queries and Feature Type Selection for Plagiarism Discovery-Notebook for PAN at CLEF 2013. In: [11]
67. Zarrabi, V., Rafiei, J., Khoshnava, K., Asghari, H., Mohtaj, S.: Evaluation of Text Reuse Corpora for Text Alignment Task of Plagiarism Detection-Notebook for PAN at CLEF 2015. In: [8]