×

Personal identity verification by serial fusion of fingerprint and face matchers. (English) Zbl 1175.68380

Summary: The use of personal identity verification systems with multi-modal biometrics has been proposed in order to increase the performance and robustness against environmental variations and fraudulent attacks. Usually multi-modal fusion of biometrics is performed in parallel at the score-level by combining the individual matching scores. This parallel strategy exhibits some drawbacks: (i) all available biometrics are necessary to perform fusion, thus the verification time depends on the slowest system; (ii) some users could be easily recognizable using a certain biometric instead of another one and (iii) the system invasiveness increases. A system characterized by the serial combination of multiple biometrics can be a good trade-off between verification time, performance and acceptability. However, these systems have been poorly investigated, and no support for designing the processing chain has been given so far. In this paper, we propose a novel serial scheme and a simple mathematical model able to predict the performance of two serially combined matchers as function of the selected processing chain. Our model helps the designer in finding the processing chain allowing a trade-off, in particular, between performance and matching time. Experiments carried out on well-known benchmark data sets made up of face and fingerprint images support the usefulness of the proposed methodology and compare it with standard parallel fusion.

MSC:

68T10 Pattern recognition, speech recognition

Software:

AR face
Full Text: DOI

References:

[1] Hong, L.; Jain, A. K., Integrating faces and fingerprints for person identification, IEEE Trans. PAMI, 20, 12, 1295-1307 (1998)
[2] Ross, A.; Nandakumar, K.; Jain, A. K., Handbook of Multibiometrics (2006), Springer: Springer Berlin
[3] Takabashi, K.; Mimura, M.; Isobe, Y.; Seto, Y., A secure and user-friendly multi-modal biometric system, (Jain, A. K.; Ratha, N. K., Biometric Technology for Human Identification, Proceedings of SPIE, vol. 5404 (2004)), 12-19
[4] Wald, A., Sequential Analysis (1947), Wiley: Wiley New York · Zbl 0029.15805
[5] Prabhakar, S.; Jain, A. K., Decision-level fusion in fingerprint verification, Pattern Recognition, 35, 4, 861-874 (2002) · Zbl 0999.68579
[6] Nandakumar, K.; Chen, Y.; Dass, S. C.; Jain, A. K., Likelihood ratio based biometric score fusion, IEEE Trans. PAMI, 30, 2, 342-347 (2008)
[7] G.L. Marcialis, F. Roli, Serial fusion of fingerprint and face matchers, Proceedings of the Seventh International Workshop on Multiple Classifiers Systems MCS07, Lecture Notes in Computer Science, vol. 4472, Springer, Berlin, 2007, pp. 151-160.; G.L. Marcialis, F. Roli, Serial fusion of fingerprint and face matchers, Proceedings of the Seventh International Workshop on Multiple Classifiers Systems MCS07, Lecture Notes in Computer Science, vol. 4472, Springer, Berlin, 2007, pp. 151-160. · Zbl 1175.68380
[8] Duda, R.; Hart, P.; Stork, D., Pattern Classification (2001), Wiley Interscience · Zbl 0968.68140
[9] P. Pudil, J. Novovicova, S. Blaha, J. Kittler, Multistage pattern recognition with reject option, in: Proceedings of the 11th IAPR-ICPR International Conference, vol. 2, 1992, pp. 92-95.; P. Pudil, J. Novovicova, S. Blaha, J. Kittler, Multistage pattern recognition with reject option, in: Proceedings of the 11th IAPR-ICPR International Conference, vol. 2, 1992, pp. 92-95.
[10] Sansone, C.; Vento, M., Signature verification: increasing performance by a multi-stage system, Pattern Anal. Appl., 3, 169-181 (2000)
[11] Kittler, J.; Hatef, M.; Duin, R. P.W.; Matas, J., On combining classifiers, IEEE Trans. PAMI, 20, 3, 226-239 (1998)
[12] Y Suen, C.; Lam, L., Multiple classifier combination methodologies for different output levels, (Proceedings of the First International Workshop on Multiple Classifiers Systems (MCS2000), Lecture Notes in Computer Science, vol. 1857 (2000), Springer: Springer Berlin), 52-56
[13] Jain, A. K.; Nandakumar, K.; Ross, A., Score normalization in multimodal biometric systems, Pattern Recognition, 38, 12, 2270-2285 (2005)
[14] A. Martinez, R. Benavente, The AR face database, CVC Technical Report #24, 1998.; A. Martinez, R. Benavente, The AR face database, CVC Technical Report #24, 1998.
[15] Maio, D.; Maltoni, D.; Cappelli, R.; Wayman, J. L.; Jain, A. K., FVC-2000: fingerprint verification competition, IEEE Trans. PAMI, 24, 3, 402-441 (2002)
[16] Xia, X.; O’Gorman, L., Innovations in fingerprint capture devices, Pattern Recognition, 36, 2, 361-369 (2003)
[17] Belhumeur, P. N.; Hespanha, J. P.; Kriegman, D. J., Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Trans. PAMI, 19, 7, 711-720 (1997)
[18] Jain, A. K.; Hong, L.; Bolle, R., On-line fingerprint verification, IEEE Trans. PAMI, 19, 4, 302-314 (1997)
[19] \( \langle;\) http://www.equinoxsensors.com/products/HID.html \(\rangle;\).; \( \langle;\) http://www.equinoxsensors.com/products/HID.html \(\rangle;\).
[20] F. Alonso, F. Roli, G.L. Marcialis, J. Fierrez, J. Ortega, Performance of fingerprint quality measures depending on sensor technology, J. Electron. Imaging 17 (1) (2008) 011008.; F. Alonso, F. Roli, G.L. Marcialis, J. Fierrez, J. Ortega, Performance of fingerprint quality measures depending on sensor technology, J. Electron. Imaging 17 (1) (2008) 011008.
[21] Turk, M.; Pentland, A., Eigenfaces for face recognition, J. Cog. Neurosci., 3, 1, 71-86 (1991)
[22] Brunelli, R.; Falavigna, D., Person identification using multiple cues, IEEE Trans. PAMI, 17, 10, 955-966 (1995)
[23] \( \langle;\) http://www.itl.nist.gov/iad/894.03/biometricscores/\( \rangle;\).; \( \langle;\) http://www.itl.nist.gov/iad/894.03/biometricscores/\( \rangle;\).
[24] Face Recognition Vendor Test \(\langle;\) http://www.frvt.org \(\rangle;\).; Face Recognition Vendor Test \(\langle;\) http://www.frvt.org \(\rangle;\).
[25] Fingerprint Vendor Technology Evaluation \(\langle;\) http://fpvte.nist.gov/\( \rangle;\).; Fingerprint Vendor Technology Evaluation \(\langle;\) http://fpvte.nist.gov/\( \rangle;\).
[26] S.Z. Li, A.K. Jain, A.K. (Eds.), Handbook of Face Recognition, Springer, Berlin, 2005.; S.Z. Li, A.K. Jain, A.K. (Eds.), Handbook of Face Recognition, Springer, Berlin, 2005. · Zbl 1066.68115
[27] Maltoni, D.; Maio, D.; Jain, A. K.; Prabhakar, S., Handbook of Fingerprint Recognition (2003), Springer: Springer Berlin · Zbl 1027.68114
[28] Neyman, J.; Pearson, E., On the problem of the most efficient tests of statistical hypotheses, Philos. Trans. R. Soc. London Ser. A, 231, 289-337 (1933) · JFM 59.1163.02
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.