Orthogonal discriminant vector for face recognition across pose. (English) Zbl 1248.68446
Summary: Recognizing face images across pose is one of the challenging tasks for reliable face recognition. This paper presents a new method to tackle this challenge based on orthogonal discriminant vector (ODV). The result of our theoretical analysis shows that an individual’s probe image captured with a new pose can be represented by a linear combination of his/her gallery images. Based on this observation, in contrast to the conventional methods which model face images of different individuals on a single manifold, we propose to model face images of different individuals on different linear manifolds. The contribution of our approach includes: (1) to prove that the orthogonality to ODVs is a pose-invariant feature.; (2) to categorize each person with a set of ODVs, where his/her face images posses zero projections while other persons’ images are characterized by maximum projections; (3) to define a metric to measure the distance between a face image and an ODV, and classify the face images based on this metric. Our experimental results validate the feasibility of modeling the face images of different individuals on different linear manifolds. The proposed method achieves higher accuracy on face recognition and verification than the existing techniques.
MSC:
| 68T10 | Pattern recognition, speech recognition |
Keywords:
pattern classification; face recognition across pose; face manifold; orthogonal discriminant vectorReferences:
| [1] | Kotropoulos, C.; Tefas, A.; Pitas, I., Frontal face authentication using morphological elastic graph matching, IEEE Transactions on Image Processing, 9, 4, 555-560 (2000) · Zbl 1006.68844 |
| [2] | Lee, S.-W.; Park, J.; Lee, S.-W., Low resolution face recognition based on support vector data description, Pattern Recognition, 39, 9, 1809-1812 (2006) · Zbl 1096.68722 |
| [3] | Chen, L.; Man, H.; Nefian, A. V., Face recognition based on multi-class mapping of fisher scores, Pattern Recognition, 38, 6, 799-811 (2005) |
| [4] | Wright, J.; Yang, A. Y.; Ganesh, A.; Sastry, S. S.; Ma, Y., Robust face recognition via sparse representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 2, 210-227 (2009) |
| [5] | Belhumeur, P. N.; Hespanha, J. P.; Kriegman, D. J., Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 7, 711-720 (1997) |
| [6] | Gross, R.; Matthews, I.; Baker, S., Appearance-based face recognition and light- fields, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 4, 449-465 (2004) |
| [7] | He, X.; Yan, S.; Hu, Y.; Niyogi, P.; Zhang, H.-J., Face recognition using laplacianfaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 3, 328-340 (2005) |
| [8] | F.S. Samaria, A.C. Harter, Parameterization of a stochastic model for human face identification, in: Proceedings of the Second IEEE Workshop on Applications of Computer Vision, 1994, pp. 138-142.; F.S. Samaria, A.C. Harter, Parameterization of a stochastic model for human face identification, in: Proceedings of the Second IEEE Workshop on Applications of Computer Vision, 1994, pp. 138-142. |
| [9] | Xu, Y.; Song, F.; Feng, G.; Zhao, Y., A novel local preserving projection scheme for use with face recognition, Expert Systems with Applications, 37, 9, 6718-6721 (2010) |
| [10] | Yang, J.; Frangi, A. F.; Yang, J.-Y.; Zhang, D.; Jin, Z., KPCA plus LDA: a complete kernel fisher discriminant framework for feature extraction and recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 2, 230-244 (2005) |
| [11] | Cai, D.; He, X.; Hu, Y.; Han, J.; Huang, T., Learning a spatially smooth subspace for face recognition, IEEE Conference on Computer Vision and Pattern Recognition, 1-7 (2007) |
| [12] | Zhang, X.; Gao, Y., Face recognition across pose: a review, Pattern Recognition, 42, 11, 2876-2896 (2009) |
| [13] | Lee, S.-W.; Moon, S.-H.; Lee, S.-W., Face recognition under arbitrary illumination using illuminated exemplars, Pattern Recognition, 40, 5, 1605-1620 (2007) · Zbl 1107.68464 |
| [14] | Y. Chang, C. Hu, M. Turk, Manifold of facial expression, in: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, pp. 28-35.; Y. Chang, C. Hu, M. Turk, Manifold of facial expression, in: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, pp. 28-35. |
| [15] | K.-C. Lee, J. Ho, M.-H. Yang, D. Kriegman, Video-based face recognition using probabilistic appearance manifolds, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2003, pp. 313-320.; K.-C. Lee, J. Ho, M.-H. Yang, D. Kriegman, Video-based face recognition using probabilistic appearance manifolds, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2003, pp. 313-320. |
| [16] | Roweis, S. T.; Saul, L. K., Nonlinear dimensionality reduction by local linear embedding, Science, 290, 5500, 2323-2326 (2000) |
| [17] | A. Shashua, A. Levin, S. Avidan, Manifold pursuit: a new approach to appearance based recognition, in: Proceedings of 16th International Conference on Pattern Recognition, vol. 3, 2002, pp. 590-594.; A. Shashua, A. Levin, S. Avidan, Manifold pursuit: a new approach to appearance based recognition, in: Proceedings of 16th International Conference on Pattern Recognition, vol. 3, 2002, pp. 590-594. |
| [18] | Yan, S.; Xu, D.; Zhang, B.; Zhang, H.-J.; Yang, Q.; Lin, S., Graph embedding and extension: a general framework for dimensionality reduction, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 1, 40-51 (2007) |
| [19] | X. He, D. Cai, S. Yan, H.-J. Zhang, Neighborhood preserving embedding, in: Tenth IEEE International Conference on Computer Vision, vol. 2, 2005, pp. 1208-1213.; X. He, D. Cai, S. Yan, H.-J. Zhang, Neighborhood preserving embedding, in: Tenth IEEE International Conference on Computer Vision, vol. 2, 2005, pp. 1208-1213. |
| [20] | H.-T. Chen, H.-W. Chang, T.-L. Liu, Local discriminant embedding and its variants, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, 2005, pp. 846-853.; H.-T. Chen, H.-W. Chang, T.-L. Liu, Local discriminant embedding and its variants, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, 2005, pp. 846-853. |
| [21] | Cai, D.; He, X.; Han, J.; Zhang, H.-J., Orthogonal laplacianfaces for face recognition, IEEE Transactions on Image Processing, 15, 11, 3608-3614 (2006) |
| [22] | Wang, J.; Xu, Y.; Zhang, D.; You, J., An efficient method for computing orthogonal discriminant vectors, Neurocomputing, 73, 10-12, 2168-2176 (2010) |
| [23] | T. Xiong, J. Ye, and V. Cherkassky, kernel uncorrelated and orthogonal discriminant analysis: a unified approach, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2006, pp. 125-131.; T. Xiong, J. Ye, and V. Cherkassky, kernel uncorrelated and orthogonal discriminant analysis: a unified approach, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2006, pp. 125-131. |
| [24] | Y. Hamamoto, A. Ohama, T. Kanaoka, S. Tomita, Orthogonal discriminant analysis based on a modified Fisher criterion [Feature extraction], in: 11th IAPR International Conference on Pattern Recognition, vol. 2, 1992, pp. 363-366.; Y. Hamamoto, A. Ohama, T. Kanaoka, S. Tomita, Orthogonal discriminant analysis based on a modified Fisher criterion [Feature extraction], in: 11th IAPR International Conference on Pattern Recognition, vol. 2, 1992, pp. 363-366. |
| [25] | Chai, X.; Shan, S.; Chen, X.; Gao, W., Locally linear regression for pose-invariant face recognition, IEEE Transactions on Image Processing, 16, 7, 1716-1725 (2007) |
| [26] | D. Beymer, T. Poggio, Face recognition from one example view, in: 5th International Conference on Computer Vision, 1995, pp. 500-507.; D. Beymer, T. Poggio, Face recognition from one example view, in: 5th International Conference on Computer Vision, 1995, pp. 500-507. |
| [27] | Phillips, P. J.; Moon, H.; Rizvi, S. A.; Rauss, P. J., The FERET Evaluation methodology for face-recognition algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 10, 1090-1104 (2000) |
| [28] | Sim, T.; Baker, S.; Bsat, M., The CMU pose, illumination, and expression database, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 2, 1615-1618 (2003) |
| [29] | Georghiades, A. S.; Belhumeur, P. N.; Kriegman, D. J., From few to many: illumination cone models for face recognition under variable lighting and pose, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 6, 643-660 (2001) |
| [30] | A.M. Martinez, R. Benavente, The AR-face database, CVC Technical Report, 24, June, 1998.; A.M. Martinez, R. Benavente, The AR-face database, CVC Technical Report, 24, June, 1998. |
| [31] | Kirby, M.; Sirovich, L., Application of karhunen-loeve procedure for the characterization of human faces, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 1, 103-108 (1990) |
| [32] | Scholkopf, B.; Smola, A. J.; Muller, K. R., Nonlinear component analysis as a kernel eigenvalue problem, Neural Computation, 10, 5, 1299-1319 (1998) |
| [33] | Xu, Y.; Zhang, D.; Song, F.; Yang, J.-Y.; Zhong, J.; Li, M., A method for speeding up feature extraction based on KPCA, Neurocomputing, 70, 4-6, 1056-1061 (2007) |
| [34] | Teoh, A.; Goh, A.; Ngo, D., Random multispace quantization as an analytic mechanism for biohashing of biometric and random identity inputs, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 2, 1892-1901 (2006) |
| [35] | Feng, Y. C.; Yuen, P. C.; Jain, A. K., A hybrid approach for generating secure and discriminating face template, IEEE Transactions on Information Forensics and Security, 5, 1, 103-117 (2010) |
| [36] | Goh, Y. Z.; Teoh, A. B.J.; Goh, K. O.M., Wavelet-based illumination invariant preprocessing in face recognition, Journal of Electronic Imaging, 18, 2, 1-12 (2009) |
| [37] | S. Biswas, G. Aggarwal, P.J. Flynn, Pose-robust recognition of low-resolution face images, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), 2011, pp. 601-608.; S. Biswas, G. Aggarwal, P.J. Flynn, Pose-robust recognition of low-resolution face images, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), 2011, pp. 601-608. |
| [38] | G. Fanelli, J. Gall, L. Van Gool, Real time head pose estimation with randomregression forests, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), 2011, pp. 617-624.; G. Fanelli, J. Gall, L. Van Gool, Real time head pose estimation with randomregression forests, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), 2011, pp. 617-624. |
| [39] | S. Khaleghian, H.R. Rabiee, M.H. Rohban, Face recognition across large pose variations via boosted tied factor analysis, 2011 IEEE Workshop on Applications of Computer Vision (WACV), 2011, pp. 190-195.; S. Khaleghian, H.R. Rabiee, M.H. Rohban, Face recognition across large pose variations via boosted tied factor analysis, 2011 IEEE Workshop on Applications of Computer Vision (WACV), 2011, pp. 190-195. |
| [40] | I. Wijaya, Pose invariant face recognition using dominant frequency based holistic features and statistical classifier, Thesis, Kumamoto University, 2010 (available via Google).; I. Wijaya, Pose invariant face recognition using dominant frequency based holistic features and statistical classifier, Thesis, Kumamoto University, 2010 (available via Google). |
| [41] | L. Teijeiro-Mosquera, J.L. Alba-Castro, D. González-Jiménez, Face recognition across pose with automatic estimation of pose parameters through AAM-based landmarking, 2010 20th International Conference on Pattern Recognition (ICPR), 2010, pp. 1339-1342.; L. Teijeiro-Mosquera, J.L. Alba-Castro, D. González-Jiménez, Face recognition across pose with automatic estimation of pose parameters through AAM-based landmarking, 2010 20th International Conference on Pattern Recognition (ICPR), 2010, pp. 1339-1342. |
| [42] | Li, A.; Shan, S. G.; Gao, W., Coupled Bias-Variance trade off for cross-pose face recognition, IEEE Transactions on Image Processing, 21, 1, 305-315 (2012) · Zbl 1372.94147 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
