Quantifying the correctness, computational complexity, and security of privacy-preserving string comparators for record linkage

Information Fusion

Volumn 13, Issue 4, 2012, Pages 245-259

  Durham, Elizabeth ^a   Xue, Yuan ^b   Kantarcioglu, Murat ^c   Malin, Bradley ^a,b  

^a VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c The University of Texas at Dallas   (United States)

Author keywords

Approximate matching; Privacy; Record linkage; String comparison

Indexed keywords

APPROXIMATE MATCHING; COMPREHENSIVE EVALUATION; DATA QUALITY; DATA SETS; DATA SOURCE; INTEGRAL COMPONENTS; MULTIPLE SOURCE; NORTH CAROLINA; PRIVACY PRESERVING; RECORD LINKAGE; REDUCED DIMENSIONAL SPACE; STRING COMPARISON;

COMMERCE; COMPARATORS (OPTICAL); COMPUTATIONAL COMPLEXITY; DATA PRIVACY; HEALTH CARE;

DATA HANDLING;

EID: 84861588233     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2011.04.004     Document Type: Article

References (66)

1. V. Torra Information fusion: methods and aggregation operators Data Mining and Knowledge Discovery Handbook 2005 Springer 1005 1016
2. T. Herzog, F. Scheueren, and W. Winkler Data Quality and Record Linkage Techniques 2007 Springer
3. US General Accounting Office, Record linkage and privacy: issues in creating new federal research and statistical information, Technical Report GAO-01-126SP, US General Accounting Office, 2001.
4. C. Clifton, M. Kantarcioglu, A. Doan, G. Schadow, J. Vaidya, A. Elmagarmid, D. Suciu, Privacy-preserving data integration and sharing, in: Proceedings of the 9th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, 2004, pp. 19-26.
5. C. Safran, M. Bloomrosen, W.E. Hammond, S. Labkoff, S. Markel-Fox, P.C. Tang, and D.E. Detmer Toward a national framework for the secondary use of health data: an American Medical Informatics Association white paper Journal of the American Medical Informatics Association 14 2007 1 9 (Pubitemid 44909487)
6. US National Institutes of Health, Policy for sharing of data obtained in NIH supported or conducted genome-wide association studies, NOT-OD-07-088, 2007.
7. B. Malin, and L. Sweeney How (not) to protect genomic data privacy in a distributed network: using trail re-identification to evaluate and design anonymity protection systems Journal of Biomedical Informatics 37 2004 179 192 (Pubitemid 38757792)
8. M. D'Orazio, M.D. Zio, and M. Scanu Statistical Matching: Theory and Practice (Wiley Series in Survey Methodology) 2006 John Wiley & Sons
9. Committee on Technical and Privacy Dimensions of Information for Terrorism Prevention and Other National Goals, National Research Council, Protecting Individual Privacy in the Struggle Against Terrorists, The National Academies Press, Washington, DC, 2008.
10. W. Krouse, B. Elias, Terrorist watchlist checks and air passenger prescreening, Technical Report RL33645, Congressional Research Service, 2009.
11. S. Fulton, EU seeks privacy enforcement rights in US courts through diplomatic agreement, International Business Times, 2010.
12. D. Kushner Vegas 911 IEEE Spectrum 43 2006 4 49
13. C. Quantin, H. Bouzelat, F. Allaert, A. Benhamiche, J. Faivre, and L. Dusserre Automatic record hash coding and linkage for epidemiological follow-up data confidentiality Methods of Information in Medicine 1998 271 277 (Pubitemid 28450065)
14. J.J. Berman Zero-check: a zero-knowledge protocol for reconciling patient identities across institutions Archives of Pathology & Laboratory Medicine 128 2004 344 346 (Pubitemid 38316086)
15. R. Agrawal, A. Evfimievski, R. Srikant, Information sharing across private databases, in: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, San Diego, CA, 2003, pp. 86-97.
16. E.V. Eycken, K. Haustermans, F. Buntinx, A. Ceuppens, J. Weyler, E. Wauters, H.V. Oyen, M.D. Schaever, D.V. den Berge, and M. Haelterman Evaluation of the encryption procedure and record linkage in the belgian national cancer registry Archives of Public Health 58 2000 281 294 (Pubitemid 32798834)
17. C. Quantin, H. Bouzelat, F. Allaert, A. Benhamiche, J. Faivre, and L. Dusserre How to ensure data security of an epidemiological follow-up: quality assessment of an anonymous record linkage procedure International Journal of Medical Informatics 49 1998 117 122 (Pubitemid 28353812)
18. R. Agrawal, D. Asonov, R. Srikant, Enabling sovereign information sharing using web services, in: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, 2004, pp. 873-877.
19. M.A. Hernández, and S.J. Stolfo Real-world data is dirty: data cleansing and the merge/purge problem Data Mining and Knowledge Discovery 2 1998 9 37 (Pubitemid 128696797)
20. W. Stallings, Cryptography and Network Security: Principles and Practice, fifth ed., Pearson Education, 2002, p. 86.
21. T. Churches, and P. Christen Some methods for blindfolded record linkage BMC Medical Informatics and Decision Making 4 2004 9
22. D.X. Song, D. Wagner, A. Perrig, Practical techniques for searches on encrypted data, in: Proceedings of the 2000 IEEE Symposium on Security and Privacy, b, Oakland, CA, 2000, p. 44.
23. E.H. Porter, W.E. Winkler, Approximate string comparison and its effect on an advanced record linkage system, Research Report RR97/02, US Census Bureau, 1997.
24. M. Tromp, J. Reitsma, A. Ravelli, N. Meray, G. Bonsel, Record linkage: making the most out of errors in linking variables, in: Proceedings of the American Medical Informatics Association Annual Symposium, 2006, pp. 779-783.
25. A. Elmagarmid, P. Ipeirotis, and V. Verykios Duplicate record detection: a survey IEEE Transactions on Knowledge and Data Engineering 19 2007 1 16 (Pubitemid 44955773)
26. S. Trepetin Privacy-preserving string comparisons in record linkage systems: a review Information Security Journal: A Global Perspective 17 2008 253 266
27. R. Hall, and S. Fienberg Privacy-preserving record linkage J. Domingo-Ferrer, E. Magkos, Privacy in Statistical Databases Lecture Notes in Computer Science vol. 6344 2011 Springer Berlin/Heidelberg 269 283
28. V.S. Verykios, A. Karakasidis, and V.K. Mitrogiannis Privacy preserving record linkage approaches International Journal of Data Mining and Modelling and Management 1 2009 206 221
29. S.V. Kaya, T.B. Pedersen, E. Savas,Y. Saygin, Efficient privacy preserving distributed clustering based on secret sharing, Lecture Notes in Computer Science, vol. 4819, Springer, pp. 280-291.
30. A. Inan, S. Kaya, Y. Saygin, E. Savas, A. Hintoglu, and A. Levi Privacy preserving clustering on horizontally partitioned data Data and Knowledge Engineering 63 2007 646 666 (Pubitemid 47418333)
31. P. Ravikumar, S.E. Fienberg, A secure protocol for computing string distance metrics, in: Proceedings of the IEEE Workshop on Privacy and Security Aspects of Data Mining, Brighton, England, 2004, pp. 40-46.
32. R. Schnell, T. Bachteler, and J. Reiher Privacy-preserving record linkage using Bloom filters BMC Medical Informatics and Decision Making 9 2009 41
33. J.A. Hylton, Identifying and Merging Related Bibliographic Records, Master's thesis, Massachusetts Institute of Technology, Cambridge, Massachusetts, 1996.
34. C. Pang, L. Gu, D. Hansen, and A. Maeder Privacy-preserving fuzzy matching using a public reference table Intelligent Patient Management vol. 189 2009 Springer Berlin/Heidelberg 71 89
35. M. Scannapieco, I. Figotin, E. Bertino, A. Elmagarmid, Privacy preserving schema and data matching, in: Proceedings of the ACM SIGMOD International Conference on Management of Data, Beijing, China, 2007, pp. 653-664. (Pubitemid 47630842)
36. M. Atallah, F. Kerschbaum, W. Du, Secure and private sequence comparisons, in: Proceedings of the ACM Workshop on Privacy in the Electronic Society, Washington, DC, 2003, pp. 39-44.
37. A. Karakasidis, V.S. Verykios, Privacy preserving record linkage using phonetic codes, in: Proceedings of the 4th Balkan Conference in Informatics, Thessaloniki, Greece, 2009, pp. 101-106.
38. J. Jonas, P.B. Pattak, and J.P. Litchko Using advanced information technology to combat insider threats Journal of Organizational Excellence 20 2001 19 27
39. W. Du, M.J. Atallah, Protocols for Secure Remote Database Access with Approximate Matching, Technical Report, CERIAS, Purdue University, 2001.
40. B.H. Bloom Space/time trade-offs in hash coding with allowable errors Communications of the ACM 13 1970 422 426
41. A. Broder, and M. Mitzenmacher Network applications of bloom filters: a survey Internet Mathematics 1 2002 636 646
42. N. Jain, Using bloom filters to refine web search results, in: Proceedings of the 7th International Workshop on Web Databases, Baltimore, MD, 2005, pp. 25-30.
43. G. Hjaltason, and H. Samet Properties of embedding methods for similarity searching in metric spaces IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2003 530 549
44. V.I. Levenshtein Binary codes capable of correcting deletions, insertions and reversals Soviet Physics Doklady 10 1966 707
45. A. Marzal, and E. Vidal Computation of normalized edit distance and applications IEEE Transactions on Pattern Analysis and Machine Intelligence 15 1993 926 932 (Pubitemid 23703604)
46. A. Binstock, and J. Rex Metaphone: a modern Soundex A. Binstock, J. Rex, Practical Algorithms for Programmers 1995 Addison Wesley
47. S.J. Grannis, J.M. Overhage, C.J. McDonald, Analysis of identifier performance using a deterministic linkage algorithm, in: Proceedings of the American Medical Informatics Association Annual Symposium, San Antonio, TX, 2002, pp. 305-309.
48. W.W. Cohen, P. Ravikumar, S.E. Fienberg, A comparison of string distance metrics for name-matching tasks, in: Proceedings of IJCAI-03 Workshop on Information Integration, Acapulco, Mexico, 2003, pp. 73-78.
49. S.J. Grannis, J.M. Overhage, C. McDonald, Real world performance of approximate string comparators for use in patient matching, in: Proceedings of Medinfo, San Francisco, CA, 2004, pp. 43-47.
50. S.J. Grannis, J.M. Overhage, S. Hui, C.J. McDonald, Analysis of a probabilistic record linkage technique without human review, in: Proceedings of the American Medical Informatics Association Annual Symposium, Washington, DC, 2003, pp. 259-263.
51. M.A. Jaro, UNIMATCH: A Record Linkage System, US Census Bureau, Washington, DC, 1978.
52. W.E. Winkler, Using the EM algorithm for weight computation in the Fellegi-Sunter model of record linkage, Research Report RR00/05, US Census Bureau, 2000.
53. V. Torra, and J. Domingo-Ferrer Record linkage methods for multidatabase data mining Information Fusion in Data Mining 2003 Springer 101 132
54. R. Lenz Measuring the disclosure protection of micro aggregated business microdata. An analysis taking as an example the german structure of costs survey Journal of Official Statistics 22 2006 681 710
55. North Carolina Voter Registration Database. < ftp://www.app.sboe. state.nc.us/data > (last accessed 02.06.10).
56. P. Christen, A. Pudjijono, Accurate synthetic generation of realistic personal information, in: Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, Bangkok, Thailand, 2009, pp. 507-514.
57. Massmind Nicknames Database. < http://techref.massmind.org/techref/ ecommerce/nicknames.htm > (last accessed 02.06.10).
58. US Census Bureau, Population Division. < http://www.census.gov/ genealogy/names/names-files.html > (last accessed 02.06.10).
59. S. Gomatam, R. Carter, M. Ariet, and G. Mitchell An empirical comparison of record linkage procedures Statistics in Medicine 21 2002 1485 1496 (Pubitemid 34495613)
60. B. Schneier Applied Cyptogography: Protocols, Algorithms and Source Code in C 1996 Wiley
61. E. Durham, Y. Xue, M. Kantarcioglu, B. Malin, Private medical record linkage with approximate matching, in: Proceedings of the American Medical Informatics Association Annual Symposium, 2010.
62. R. Baxter, P. Christen, T. Churches, A comparison of fast blocking methods for record linkage, in: Proceedings of the ACM SIGKDD Workshop on Data Cleaning, Record Linkage and Object Consolidation, Washington, DC, 2003, pp. 25 - 27.
63. A. Al-Lawati, D. Lee, P. McDaniel, Blocking-aware private record linkage, in: Proceedings of the International Workshop on Information Quality in Information Systems, Baltimore, MD, 2005, pp. 59-68.
64. M. Kantarcioglu, A. Inan, W. Jiang, and B. Malin Formal anonymity models for efficient privacy-preserving joins Data Knowledge Engineering 68 2009 1206 1223
65. A. Inan, M. Kantarcioglu, G. Ghinita, and E. Bertino Private record matching using differential privacy Proceedings of the 13th International Conference on Extending Database Technology, EDBT '10 2010 ACM New York, NY, USA 123 134
66. R. Lenz, D. Vorgrimler, Matching German turnover tax statistics, fdz-arbeitspapier nr. 4 edition, 2005.