Multimodal biometrics: State of the art in fusion techniques

International Journal of Biometrics

Volumn 1, Issue 4, 2009, Pages 393-417

  Joshi, Tejas ^a   Dey, Somnath ^a   Samanta, Debasis ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Biometrics; Fusion levels; Fusion rules; Multimodal biometrics

Indexed keywords

AUTHENTICATION SYSTEMS; BIOMETRIC TRAITS; DECISION LEVELS; FUSION RULE; FUSION TECHNIQUES; MULTI-MODAL BIOMETRICS; RECENT RESEARCHES; STATE OF THE ART;

BIOMETRICS;

EID: 70350107713     PISSN: 17558301     EISSN: 1755831X     Source Type: Journal    
DOI: 10.1504/IJBM.2009.027303     Document Type: Article

References (73)

1. Ailisto, H., Lindholm, M., Makela, S-M. and Vildjiounaite, E. (2004) 'Unobtrusive user identification with light biometrics', in Raisamo, R. (Ed.): Nordic Conference on Human- Computer Interaction, ACM, New York, pp.327-330
2. Alonso-Fernandez, F., Fierrez, J., Ortega-Garcia, J., Gonzalez-Rodriguez, J., Fronthaler, H., Kollreider, K. and Bigun, J. (2007) 'A comparative study of fingerprint image-quality estimation methods', IEEE Transactions on Information Forensics and Security, Vol.2, No.4, pp.734-743
3. Ben-Yacoub, S., Abdeljaoued, Y. and Mayoraz, E. (1999a) 'Fusion of face and speech data for person identity verification', IEEE Transactions on Neural Networks, Vol.20, No.5, pp.1065-1074
4. Ben-Yacoub, S., Luttin, J., Jonsson, K., Matas, J. and Kittler, J. (1999b) 'Audio-visual person verification', IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, Vol.1, p.585
5. Bertillon, A. (1890) Bertillionage system. Available online at: http://ctl.ncsc.dni.us/biomet%20web/BMBody.html (accessed on 15 June 2009).
6. Besbes, F., Trichili, H. and Solaiman, B. (2008) 'Multimodal biometric system based on fingerprint identification and iris recognition', 3rd International Conference on Information and Communication Technologies: From Theory to Applications (ICTTA 2008) pp.1-5
7. Bhatnagar, J., Kumar, A. and Saggar, N. (2007) 'A novel approach to improve biometric recognition using rank level fusion', IEEE Conference on Computer Vision and Pattern Recognition, 2007 (CVPR'07), pp.1-6
8. Bolle, R., Connell, J., Pankanti, S., Ratha, N. and Senior, A.W. (2003) Guide to Biometrics, Springer-Verlag, New York.
9. Bowyer, K.W., Chang, K.I., Flynn, P.J. and Chen, X. (2006) 'Face recognition using 2-D, 3-D, and infrared: is multimodal better than multisample?', Proceedings of the IEEE, Vol.94, pp.2000-2012
10. Chang, K.I., Bowyer, K.W. and Flynn, P.J. (2005) 'An evaluation of multimodal 2D+3D face biometrics', IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.27, No.4, pp.619-624
11. Chen, Y., Dass, S.C. and Jain, A.K. (2005) 'Fingerprint quality indices for predicting authentication performance', Proceedings of the AVBPA, Springer LNCS-3546, pp.160-170
12. Chen, Y., Dass, S.C. and Jain, A.K. (2006) 'Localized iris image quality using 2-D wavelets', International Conference on Biometric Authentication, pp.373-381
13. Chetty, G. and Wagner, M. (2005) 'Audio-visual multimodal fusion for biometric person authentication and liveness verification', in Chen, F. and Epps, J. (Eds): NICTA-HCS Net Multimodal User Interaction Workshop (MMUI 2005), ACS, Sydney, Australia, Vol.57 (CRPIT), pp.17-24
14. Cheung, M-C., Mak, M-W. and Kung, S-Y. (2004) 'Multi-sample data-dependent fusion of sorted score sequences for biometric verification', International Conference on Acoustics, Speech, and Signal Processing, 2004, Vol.5, pp.681-684
15. Dahel, S.K. and Xiao, Q. (2003) 'Accuracy performance analysis of multimodal biometrics', Proceedings of the 2003 IEEE Workshop on Information Assurance United States Military Academy, Information Assurance Workshop, 2003, IEEE Systems, Man and Cybernetics Society, pp.170-173
16. Dass, S.C., Nandakumar, K. and Jain, A.K. (2005) 'A principled approach to score level fusion in multimodal biometric systems', Proceedings of the 5th International Conference on Audio- and Video-Based Biometric Person Authentication, pp.1049-1058
17. Daugman, J. (2004) 'How iris recognition works', IEEE Transactions on Circuits and Systems for Video Technology, Vol.14, No.1, pp.21-30
18. DellXFRD630 (2008) Laptop with fingerprint reader. Available online at: http://www.dell.com/content/products/productdetails.aspx/latit-d630?c=us&1= en&s=biz&cs=555 (accessed on 15 June 2009)
19. Fujitsu-F-01A (2009) F-01A. Available online at: http://www.authentec. com/news-item. cfm?newsID=54
20. Gutschoven, B. and Verlinde, P. (2000) 'Multi-modal identity verification using support vector machines (SVM)', Proceedings of the 3rd International Conference on Information Fusion, 2000 (FUSION 2000), Vol.2, pp.THB3/3-THB3/8
21. Harmel, K. and Spadanuta, L. (2006) Disney World scans fingerprint details of park visitors. Available online at: http://www.boston.com/news/ nation/articles/2006/09/03/disney-world-scans-fingerprint-details-of-park- visitors/ (accessed on 15 June 2009)
22. Hong, T-P. and Lee, J-J. (1998) 'Parallel neural learning by iteratively adjusting error thresholds', Proceedings of International Conference on Parallel and Distributed Systems, 1998, pp.107-112
23. Humm, A., Hennebert, J. and Ingold, R. (2009) 'Combined handwriting and speech modalities for user authentication', IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, Vol.39, No.1, pp.25-35
24. IAFIS (1999) Integrated Automated Fingerprint Identification System. Available online at: http://www.fbi.gov/hq/cjisd/iafis.htm
25. Ichino, M., Sakano, H. and Komatsu, N. (2006) 'Multimodal biometrics of lip movements and voice using Kernel Fisher discriminant analysis', 9th International Conference on Control, Automation, Robotics and Vision (ICARCV'06), pp.1-6
26. Indovina, M., Uludag, U., Snelick, R., Mink, A. and Jain, A. (2003) 'Multimodal biometric authentication methods: A COTS approach', Proceedings of the MMUA 2003, Workshop on Multimodal User Authentication, pp.99-106
27. Jain, A.K. and Maltoni, D. (2003) Handbook of Fingerprint Recognition, Springer-Verlag New York, Inc., Secaucus, NJ.
28. Jain, A.K., Nandakumar, K. and Ross, A. (2005) 'Score normalization in multimodal biometric systems', Pattern Recognition, Vol.38, No.12, pp.2270-2285
29. Jain, A.K. and Ross, A. (2002a) 'Fingerprint mosaicking', IEEE International Conference on Acoustics, Speech, and Signal Processing, 2002, Proceedings (ICASSP'02), Vol.4, pp.IV-4064-IV-4067
30. Jain, A.K. and Ross, A. (2002b) 'Learning user-specific parameters in a multibiometric system', Proceedings of International Conference on Image Processing (ICIP'2002), Vol.1, Rochester, New York, pp.I: 57-60
31. Jain, A.K. and Uludag, U. (2003) 'Hiding biometric data', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.25, No.11, pp.1494-1498
32. Kittler, J., Hatef, M., Duin, R.P.W. and Matas, J. (1998) 'On combining classifiers', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.20, No.3, pp.226-239
33. Kittler, J., Matas, J., Jonsson, K. and Ramos Sanchez, M.U. (1997) 'Combining evidence in personal identity verification systems', Pattern Recognition Letters, Vol.18, No.9, pp.845-852 (Pubitemid 127411227)
34. Kollreider, K., Fronthaler, H. and Bigun, J. (2008) 'Verifying liveness by multiple experts in face biometrics', Biometrics, pp.1-6.
35. Kumar, A. and Zhang, D. (2006) 'Personal recognition using hand shape and texture', IEEE Transactions on Image Processing, Vol.15, No.8, pp.2454-2461 (Pubitemid 44089116)
36. Kung, S.Y. and Mak, M-W. (2006) 'On consistent fusion of multimodal biometrics', IEEE International Conference on Acoustics, Speech and Signal Processing, 2006 (ICASSP 2006), Vol.5, pp.V-1085-V-1088
37. Lee, H.C., Kim, E.S., Hur, G.T. and Choi, H.Y. (2005) 'Generation of 3D facial expressions using 2D facial image', ICIS'05: Proceedings of the Fourth Annual ACIS International Conference on Computer and Information Science, IEEE Computer Society, Washington, DC, pp.228-232
38. Lupu, C. and Lupu, V. (2007) 'Multimodal biometrics for access control in an intelligent car', International Symposium on Computational Intelligence and Intelligent Informatics (ISCIII'07), pp.261-267
39. MantraSoftech (2002) Mantra Softech Pvt Ltd. Available online at: http://www.mantratec.com/Biometrics%20Overview.html (accessed on 15 June 2009).
40. Maple, C. and Schetinin, V. (2006) 'Using a Bayesian averaging model for estimating the reliability of decisions in multimodal biometrics', The First International Conference on Availability, Reliability and Security (ARES 2006), IEEE Computer Society, Washington, DC, pp.929-935
41. MLP (1995) The multilayer perceptron classifier. Available online at: http://en.wikipedia.org/wiki/Multilayer-perceptron (accessed on 15 June 2009).
42. Monwar, M.M. and Gavrilova, M. (2008a) 'FES: a system for combining face, ear and signature biometrics using rank level fusion', Fifth International Conference on Information Technology: New Generations (ITNG 2008), pp.922-927
43. Monwar, M.M. and Gavrilova, M. (2008b) 'A robust authentication system using multiple biometrics', in Lee, R.Y. and Kim, H-K. (Eds): Computer and Information Science (Studies in Computational Intelligence), Springer, Vol.131, pp.189-201
44. Nakagawa, T., Nakanishi, I., Itoh, Y. and Fukui, Y. (2006) 'Multi-modal biometrics authentication using on-line signature and voice pitch', International Symposium on Intelligent Signal Processing and Communications (ISPACS 2006), pp.399-402
45. Nandakumar, K., Chen, Y., Dass, S.C. and Jain, A.K. (2008) 'Likelihood ratio-based biometric score fusion', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.30, No.2, pp.342-347
46. Nandakumar, K., Chen, Y. and Jain, A.K. (2006) 'Quality-based score level fusion in multibiometric systems', 18th International Conference on Pattern Recognition (ICPR 2006), Vol.4, pp.473-476
47. Ong, M.G.K., Connie, T., Jin, A.T.B. and Ling, D.N.C. (2003) 'A single-sensor hand geometry and palmprint verification system', WBMA'03: Proceedings of the 2003 ACM SIGMM Workshop on Biometrics Methods and Applications, ACM, New York, NY, pp.100-106
48. Poh, N. and Korczak, J. (2001) 'Hybrid biometric person authentication using face and voice features', Proceedings of the International Conference on Audio- and Video-Based Biometric Person Authentication, Halmstad, Sweden, pp.348-353
49. Privium, S. (2006) Schiphol Privium: irisscan. Available online at: http://www.schiphol.nl/web/ show/id=67508/langid=42
50. Rattani, A., Kisku, D.R., Bicego, M. and Tistarelli, M. (2007) 'Feature level fusion of face and fingerprint biometrics', First IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2007 (BTAS 2007), pp.1-6
51. Richard, G., Menguy, Y., Guis, I., Suaudeau, N., Boudy, J., Lockwood, P., Fernandez, C., Fernández, F., Kotropoulos, C., Tefas, A., Pitas, Heimgartner, R., Ryser, P., Beumier, C., Verlinde, P., Pigeon, S., Matas, G., Kittler, J., Bigün, J., Abdeljaoued, Y., Meurville, E., Besacier, L., Ansorge, M., Maitre, G., Luettin, J., Ben-Yacoub, S., Ruiz, B., Aldama, K. and Cortes, J. (1999) 'Multi modal verification for teleservices and security applications (M2VTS)' IEEE International Conference on Multimedia Computing and Systems, 1999, Vol.2, pp.1061-1064
52. Roli, F., Fumera, G. and Kittler, J. (2002) 'Fixed and trained combiners for fusion of unbalanced pattern classifiers', Proceedings of the Fifth International Conference on Information Fusion, 2002, Vol.1, pp.278-284
53. Ross, A. and Govindarajan, R. (2005) 'Feature level fusion using hand and face biometrics', Proceedings of SPIE Conference on Biometric Technology for Human Identification II, Vol.5779, pp.196-204
54. Ross, A. and Jain, A.K. (2003) 'Information fusion in biometrics', Pattern Recognition Letters, Vol.24, No.13, pp.2115-2125.
55. Ross, A.A., Nandakumar, K. and Jain, A.K. (2006) Handbook of Multibiometrics, Springer-Verlag New York, Inc., Secaucus, NJ.
56. Samad, S., Ramli, D.A. and Hussain, A. (2007) 'A multi-sample single-source model using spectrographic features for biometric authentication', 6th International Conference on Information Communications & Signal Processing, 2007, pp.1-5
57. Sansone, G. (1991) Orthogonal Functions, Dover Publications, New York.
58. Seung, S. (2002) Multilayer perceptrons and backpropagation learning. Available online at: http://hebb.mit.edu/courses/9.641/2002/lectures/lecture04. pdf (accessed on 15 June 2009)
59. Shu, C. and Ding, X. (2006) 'Multi-biometrics fusion for identity verification', 18th International Conference on Pattern Recognition (ICPR 2006), Vol.4, pp.493-1196
60. Snelick, R., Indovina, M., Yen, J. and Mink, A. (2003) 'Multimodal biometrics: issues in design and testing', in Oviatt, S.L., Darrell, T., Maybury, M.T. and Wahlster, W. (Eds): Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI'03), ACM, New York, pp.68-72
61. Snelick, R., Uludag, U., Mink, A., Indovina, M. and Jain, A.K. (2005) 'Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.27, No.3, pp.450-455
62. So, Y. (1995) A tutorial on logistic regression. Available online at: http://www.ats.ucla.edu/stat/sas/library/logistic.pdf
63. Toh, K-A., Jiang, X. and Yau, W-Y. (2004a) 'Exploiting global and local decisions for multimodal biometrics verification', IEEE Transactions on Signal Processing, Vol.52, No. 10, pp.3059-3072
64. Toh, K-A. and Yau, W-Y. (2004a) 'Combination of hyperbolic functions for multi-modal biometrics data fusion', IEEE Transactions on Systems, Man, and Cybernetics, Part B, Vol.34, No.2, pp.1196-1209
65. Toh, K-A. and Yau, W-Y. (2004b) 'Some learning issues in user-specific multimodal biometrics', 8th Control, Automation, Robotics and Vision Conference, 2004 (ICARCV 2004), Vol.2, pp.1268-1273
66. Toh, K-A., Yau, W.Y. and Jiang, X. (2004b) 'A reduced multivariate polynomial model for multimodal biometrics and classifiers fusion', IEEE Transactions on Circuits and Systems for Video Technology, Vol.14, No.2, pp.224-233
67. Ulery, B., Hicklin, A., Watson, C., Fellner, W. and Hallinan, P. (2006) Studies of Biometric Fusion, Technical Report, National Institute of Standards and Technology
68. US-VISIT (2006) U.S. Department of Homeland Security: US-VISIT privacy impact assessments. Available online at: http://www.dhs.gov/xinfoshare/ publications/editorial0511.shtm#13
69. Veeramachaneni, K., Osadciw, L. and Varshney, P.K. (2003) 'Adaptive multimodal biometric fusion algorithm using particle swarm', SPIE Aerosense, Orlando, Florida
70. Wang, R. and Bhanu, B. (2006) 'Performance prediction for multimodal biometrics', 18th International Conference on Pattern Recognition (ICPR'06).
71. Wang, Y., Mu, Z-C., Liu, K. and Feng, J. (2007) 'Multimodal recognition based on pose transformation of ear and face images', Proceedings of the 2007 International Conference on Wavelet Analysis and Pattern Recognition, Beijing, China
72. Xu, X. and Mu, Z. (2007) 'Feature fusion method based on KCCA for ear and profile face based multimodal recognition', IEEE International Conference on Automation and Logistics, 2007, pp.620-623
73. Zhang, W., Shan, S., Gao, W., Chang, Y., Cao, B. and Yang, P. (2004) 'Information fusion in face identification', Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004), Vol.3, pp.950-953