Event log imperfection patterns for process mining: Towards a systematic approach to cleaning event logs

Information Systems

Volumn 64, Issue , 2017, Pages 132-150

  Suriadi, S ^a   Andrews, R ^a   ter Hofstede, A H M ^a,b   Wynn, M T ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Data mining; Data quality; Event log preparation; Event log quality; Patterns; Process mining; Systematic data pre processing

Indexed keywords

DATA HANDLING; DATA MINING; THIN WALLED STRUCTURES;

DATA PREPROCESSING; DATA QUALITY; EVENT LOG PREPARATION; LOG QUALITY; PATTERNS; PROCESS MINING;

QUALITY CONTROL;

EID: 84995489547     PISSN: 03064379     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.is.2016.07.011     Document Type: Article

References (52)

1. [1] ISO/IEC 25010:2011: Systems and software engineering – Systems and software product Quality Requirements and Evaluation (SQuaRE) – System and software quality models, 2011.
2. [2] Alexander, C., The Timeless Way of Building. 1979, Oxford University Press.
3. [3] Alexander, C., Ishikawa, S., Silverstein, M., A Pattern Language: Towns, Buildings, Constructions. 1977, Oxford University Press.
4. [4] Alur, D., Malks, D., Crupi, J., Core J2EE Patterns (Core Design Series): Best Practices and Design Strategies. 2003, Sun Microsystems Inc.
5. [5] Batini, C., Scannapieco, M., Data Quality: Concepts, Methodologies and Techniques. 2006, Springer.
6. [6] J.C. Bose, R.S. Mans, W.M.P. van der Aalst, Wanna improve process mining results? It's high time we consider data quality issues seriously, in: Proceedings of the IEEE CIDM. Singapore, IEEE, 2013, pp. 127–134.
7. [7] J.C. Bose, R.S. Mans, W.M.P. van der Aalst, Wanna improve process mining results? It's high time we consider data quality issues seriously, Technical Report BPM-13-02, BPM Center Report, 〈 http://bpmcenter.org/wp-content/uploads/reports/2013/BPM-13-02.pdf〉, 2013.
8. [8] F. Buschmann, R. Meunier, H. Rohnert, P. Sommerlad, M. Stal, Pattern-oriented software architecture: a system of patterns Vol 1. Wiley, 1996.
9. [9] R. Conforti, G. Fortini, M. La Rosa, A.H.M. ter Hofstede, Noise filtering of process execution logs based on outliers detection, Trans. Knowl. Data Eng. PP (99), 2016, 1-1.
10. [10] M. Ehrig, A. Koschmider, A. Oberweis, Measuring similarity between semantic business process models, in: Proceedings of the Fourth APCCM, vol. 67 of APCCM '07, ACS, 2007, pp. 71–80.
11. [11] Elmagarmid, A.K., Ipeirotis, P.G., Verykios, V.S., Duplicate record detection: a survey. Trans. Knowl. Data Eng. 19:1 (2007), 1–16.
12. [12] Fellegi, I.P., Sunter, A.B., A theory for record linkage. J. Am. Stat. Assoc. 64:328 (1969), 1183–1210.
13. [13] Fowler, M., Analysis Patterns: Reusable Object Models. 1997, Addison-Wesley, Reading, Massachusetts.
14. [14] Fowler, M., Patterns of Enterprise Application Architecture. 2002, Addison-Wesley.
15. [15] Gamma, E., Helm, R., Johnson, R., Vlissides, J., Design Patterns: Elements of Object-Oriented Software. 1994, Addison-Wesley.
16. [16] L. Ghionna, G. Greco, A. Guzzo, L. Pontieri, Outlier detection techniques for process mining, in ISMIS, volume 4994 of LNCS, Springer, 2008, pp. 150–159.
17. [17] T. Gschwandtner, J. Gärtner, W. Aigner, S. Miksch, A taxonomy of dirty time-oriented data, in Multidisciplinary Research and Practice for Information Systems, volume 7465 of LNCS, Springer, 2012, pp. 58–72.
18. [18] C.W. Günther, Process Mining in Flexible Environments (Ph.D thesis), Technische Universiteit Eindhoven, 2009.
19. [19] Hohpe, G., Woolf, B., Enterprise Integration Patterns: Designing, Building and Deploying Messaging Solutions. 2003, Addison-Wesley.
20. [20] Kim, W., Choi, B., Hong, E., Kim, S., Lee, D., A taxonomy of dirty data. Data Min. Knowl. Discov. 7:1 (2003), 81–99.
21. [21] C. Klinkmüller, I. Weber, J. Mendling, H. Leopold, A. Ludwig, Increasing recall of process model matching by improved activity label matching, in: Proceedings of BPM, volume 8094 of LNCS, Springer, 2013, pp. 211–218.
22. [22] M. Laverdiere, A. Mourad, A. Hanna, M. Debbabi, Security design patterns: survey and evaluation, in: IEEE Canadian Conference on Electrical and Computer Engineering, 2006, pp. 1605–1608.
23. [23] Levenshtein, V.I., Binary codes capable of correcting deletions, insertions and reversals. Dokl. Akad. Nauk SSSR 163:4 (1965), 845–848.
24. [24] R.S. Mans, W.M.P. van der Aalst, R.J.B. Vanwersch, Process mining in healthcare – opportunities beyond the ordinary, Technical Report BPM-13-26, Eindhoven University of Technology, 〈 http://bpmcenter.org/wp-content/uploads/reports/2013/BPM-13-26.pdf〉, 2013.
25. [25] R.S. Mans, W.M.P. van der Aalst, R.J.B. Vanwersch, A.J. Moleman, Process mining in healthcare: Data challenges when answering frequently posed questions, in: Process Support and Knowledge Representation in Health Care, volume 7738 of LNCS, Springer, 2012, pp. 140–153.
26. [26] Marsan, M.A., Conte, G., Balbo, G., A class of generalized stochastic petri nets for the performance evaluation of multiprocessor systems. ACM Trans. Comput. Syst. 2:2 (1984), 93–122.
27. [27] Maruster, L., Weijters, A.J.M.M., van der Aalst, W.M.P., van den Bosch, A., A rule-based approach for process discovery: dealing with noise and imbalance in process logs. Data Min. Knowl. Discov. 13 (2006), 67–87.
28. [28] A. Moore, M. Collins, D. Mundie, R. Ruefle, D. McIntire, Pattern-based design of insider threat programs, Technical Report CMU/SEI-2014-TN-024, Software Engineering Institute, 2014.
29. [29] A. Moore, D. McIntire, D. Mundie, The justification of a pattern for detecting intellectual property theft by departing insiders, Technical Report 732, Software Engineering Institute, 2013.
30. [30] A. Moore, M. Hanley, D. Mundie, A pattern for increased monitoring for intellectual property theft by departing insiders, in: Proceedings of the Conference on Pattern Languages of Programs, 2011, pp. 1–17.
31. [31] H. Müller, Problems, methods, and challenges in comprehensive data cleansing, Informatik-Berichte. Professoren des Inst. Für Informatik, 2005.
32. [32] Neapolitan, R.E., Learning Bayesian Networks. 2003, Prentice-Hall Inc., Upper Saddle River, NJ, USA.
33. [33] Newcombe, H.B., Kennedy, J.M., Axford, S.J., James, A.P., Automatic linkage of vital records. Science 130:3381 (1959), 954–959.
34. [34] P. Oliveira, F. Rodrigues, P. Henriques, A formal definition of data quality problems, in: Proceedings of the MIT IQ Conference. MIT, 2005.
35. [35] Partington, A., Wynn, M.T., Suriadi, S., Ouyang, C., Karnon, J., Process mining for clinical processes: a comparative analysis of four Australian hospitals. ACM Trans. Manag. Inf. Syst. 5:4 (2015), 19:1–19:18.
36. [36] Prasad, M.V.S., Prasad, C.K., Rambabu, B., Appraisal of efficient techniques for online record linkage and deduplication using q-gram based indexing. Int. J. Comput. Sci. Mob. Comput. 3:5 (2014), 404–414.
37. [37] Rahm, E., Do, H., Data cleaning: problems and current approaches. IEEE Bull. Tech. Comm. Data Eng. 23:4 (2000), 3–13.
38. [38] Riehle, D., Zűllighoven, H., Understanding and using patterns in software development. Theory Pract. Object Syst. 2:1 (1996), 3–13.
39. [39] A. Rogge-Solti, R.S. Mans, W.M.P. van der Aalst, M. Weske, Repairing event logs using timed process models, in: OTM 2013 Workshops, volume 8186 of LNCS, Springer, 2013, pp. 705–708.
40. [40] S. Suriadi, R.S. Mans, M.T. Wynn, A. Partington, J. Karnon, Measuring patient flow variations: A cross-organisational process mining approach, in: AP-BPM, LNBIP, Springer, 2014, pp. 43–58.
41. [41] S. Suriadi, M.T. Wynn, C. Ouyang, A.H.M. ter Hofstede, N. van Dijk, Understanding process behaviours in a large insurance company in Australia: A case study, in: CAiSE, volume 7908 of LNCS, 2013, pp. 449–464.
42. [42] Taibi, T., Ngo, D., Formal specification of design patterns – a balanced approach. J. Object Technol. 2:4 (2003), 127–140.
43. [43] P. van Bommel, A.H.M. ter Hofstede, T.P. van der Weide, Semantics and verification of object-role models, Information Systems, 16(5), 1991, pp. 471–495.
44. [44] W.M.P. van der Aalst, Process Mining – Discovery, Conformance and Enhancement of Business Processes, Springer, 2011.
45. [45] W.M.P. van der Aalst et al. Process mining manifesto, in: Florian Daniel et al. (ed.), BPM 2011 Workshops (1), volume 99 of LNBIP, Springer-Verlag, 2011, pp. 169–194.
46. [46] van der Aalst, W.M.P., ter Hofstede, A.H.M., Workflow patterns put into context. Softw. Syst. Model. 11 (2012), 319–323.
47. [47] van der Aalst, W.M.P., ter Hofstede, A.H.M., Kiepuszewski, B., Barros, A.P., Workflow patterns. Distrib. Parallel Databases 14:3 (2003), 5–51.
48. [48] Wand, Y., Wang, R., Anchoring data quality dimensions in ontological foundations. Commun. ACM 39:11 (1996), 86–95.
49. [49] Wang, R., Storey, V.C., Firth, C.P., A framework for analysis of data quality research. IEEE Trans. Knowl. Data Eng. 7:4 (1995), 623–640.
50. [50] Wang, R.Y., Strong, D.M., Beyond accuracy: what data quality means to data consumers. J. Manag. Inf. Syst. 12:4 (1996), 5–33.
51. [51] Weitjers, A.J.M.M., van der Aalst, W.M.P., Rediscovering workflow models from event-based data using little thumb. Integr. Comput.-Aided Eng. 10:2 (2003), 151–162.
52. [52] Yacoub, S., Ammar, H., Pattern-Oriented Analysis and Design: Composing Patterns to Design Software Systems. 2004, Addison-Wesley Profession, United States.