Conditional Deployable Biometrics: Matching Periocular and Face in Various Settings
Article Sidebar
Main Article Content
Abstract
In this paper, we introduce the concept of Conditional Deployable Biometrics (CDB), designed to deliver consistent performance across various biometric matching scenarios, including intra-modal, multimodal, and cross-modal applications. The CDB framework provides a versatile and deployable biometric authentication system that ensures reliable matching regardless of the biometric modality being used. To realize this framework, we have developed CDB-Net, a specialized deep neural network tailored for handling both periocular and face biometric modalities. CDB-Net is engineered to handle the unique challenges associated with these different modalities while maintaining high accuracy and robustness. Our extensive experimentation with CDB-Net across five diverse and challenging in-the-wild datasets illustrates its effectiveness in adhering to the CDB paradigm. These datasets encompass a wide range of real-world conditions, further validating the model’s capability to manage variations and complexities inherent in biometric data. The results confirm that CDB-Net not only meets but exceeds expectations in terms of performance, demonstrating its potential for practical deployment in various biometric authentication scenarios.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
A. K. Jain, D. Deb, and J. J. Engelsma, "Biometrics: Trust, but verify," IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 4, no. 3, pp. 303-323, 2021, doi: 10.1109/TBIOM.2021.3115465.
P. Kumari and K. R. Seeja, "A novel periocular biometrics solution for authentication during COVID-19 pandemic situation," Journal of Ambient Intelligence and Humanized Computing, vol. 12, pp. 10321-10337, 2021, doi: 10.1007/s12652-020-02814-1.
J. Xu, M. Cha, J. L. Heyman, S. Venugopalan, R. Abiantun, and M. Savvides, "Robust local binary pattern feature sets for periocular biometric identification," IEEE International Conference on Biometrics: Theory, Applications, and Systems (BTAS), pp. 1-8, 2010, doi: 10.1109/BTAS.2010.5634504.
Y. LeCun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hubbard, and L. Jackel, "Handwritten digit recognition with a back-propagation network," Advances in Neural Information Processing Systems, vol. 2, 1989.
T. S. Ng, C. Y. Low, J. C. L. Chai, and A. B. J. Teoh, "Conditional multimodal biometrics embedding learning for periocular and face in the wild," International Conference on Pattern Recognition (ICPR), pp. 812-818, 2022, doi: 10.1109/ICPR56361.2022.9956636.
S. Chen, Y. Liu, X. Gao, and Z. Han, "Mobilefacenets: Efficient CNNs for accurate real-time face verification on mobile devices," Chinese Conference on Biometric Recognition, pp. 428-438, 2018, doi: 10.1007/978-3-319-97909-0_46.
P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, 1997, doi: 10.1109/34.598228.
H. Wang et al., "Cosface: Large margin cosine loss for deep face recognition," IEEE Conference on Computer Vision and Pattern Recognition, pp. 5265-5274, 2018, doi: 10.48550/arXiv.1801.09414.
J. Deng, J. Guo, N. Xue, and S. Zafeiriou, "Arcface: Additive angular margin loss for deep face recognition," IEEE Conference on Computer Vision and Pattern Recognition, pp. 4690-4699, 2019. doi: 10.1109/CVPR.2019.00482.
G. B. Huang, M. Mattar, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, 2008. [Online]. Available: https://inria.hal.science/inria-00321923/
T. Zheng and W. Deng, "Cross-pose LFW: A database for studying cross-pose face recognition in unconstrained environments," Beijing University of Posts and Telecommunications Technical Report, vol. 5, no. 7, 2018. [Online]. Available: http://www.whdeng.cn/CPLFW/Cross-Pose-LFW.pdf
R. Jillela and A. Ross, "Mitigating effects of plastic surgery: Fusing face and ocular biometrics," IEEE International Conference on Biometrics: Theory, Applications, and Systems (BTAS), pp. 402-411, 2012, doi: 10.1109/BTAS.2012.6374607.
M. Karakaya, "Iris-ocular-periocular: Toward more accurate biometrics for off-angle images," Journal of Electronic Imaging, vol. 30, no. 3, pp. 033035-033035, 2021, doi: 10.1117/1.JEI.30.3.033035.
L. C. O. Tiong, S. T. Kim, and Y. M. Ro, "Implementation of multimodal biometric recognition via multi-feature deep learning networks and feature fusion," Multimedia Tools and Appications, vol. 78, pp. 22743-22772, 2019, doi: 10.1007/s11042-019-7618-0.
Y. G. Jung, C. Y. Low, J. Park, and A. B. J. Teoh, "Periocular recognition in the wild with generalized label smoothing regularization," IEEE Signal Processing Letters, vol. 27, pp. 1455-1459, 2020, doi: 10.1109/LSP.2020.3014472.
M. Wang and W. Deng, "Deep face recognition: A survey," Neurocomputing, vol. 429, pp. 215-244, 2021, doi: 10.1016/j.neucom.2020.10.081.
R. Sharma and A. Ross, "Periocular biometrics and its relevance to partially masked faces: A survey," Computer Vision and Image Understanding, vol. 226, p. 103583, 2023, doi: 10.1016/j.cviu.2022.103583.
L. C. O. Tiong, D. Sigmund, and A. B. J. Teoh, "Face-periocular cross-identification via contrastive hybrid attention vision transformer," IEEE Signal Processing Letters, vol. 30, pp. 254-258, 2023, doi: 10.1109/LSP.2023.3256320.
A. Dosovitskiy et al., "An image is worth 16x16 words: Transformers for image recognition at scale," arXiv preprint arXiv:2010.11929, 2020, doi: 10.48550/arXiv.2010.11929.
A. Vaswani et al., "Attention is all you need," Advances in Neural Information Processing Systems, 2017. [Online]. Available: https://user.phil.hhu.de/~cwurm/wp-content/uploads/2020/01/7181-attention-is-all-you-need.pdf
C. Szegedy et al., "Rethinking the inception architecture for computer vision," IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2818-2826, doi: 10.1109/CVPR.2016.308.
O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Deep face recognition," British Machine Vision Conference, 2015.
L. C. O. Tiong, A. B. J. Teoh, and Y. Lee, "Periocular recognition in the wild with orthogonal combination of local binary coded pattern in dual-stream convolutional neural network," 2019 Int. Conf. Biometrics (ICB), pp. 1-6, 2019, doi: 10.1109/ICB45273.2019.8987278.
N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, "Attribute and simile classifiers for face verification," IEEE International Conference on Computer Vision, pp. 365-372, 2009, doi: 10.1109/ICCV.2009.5459250.
H. W. Ng and S. Winkler, "A data-driven approach to cleaning large face datasets," IEEE International Conference on Image Processing, pp. 343-347, 2014 , doi: 10.1109/ICIP.2014.7025068.
R. Rothe, R. Timofte, and L. Van Gool, "Dex: Deep expectation of apparent age from a single image," International Conference on Computer Vision Workshops, 2015, pp. 252-257, doi: 10.1109/ICCVW.2015.41.
A. Martinez and R. Benavente, "The AR face database”, CVC technical report, vol. 24, 1998.
Q. Cao, L. Shen, W. Xie, O. M. Parkhi, and A. Zisserman, "VGGFace2: A dataset for recognising faces across pose and age," IEEE International Conference on Automatic Face and Gesture Recognition, pp. 67-74, 2018, doi: 10.1109/FG.2018.00020.
Y. Zhang and Q. Yang, "A survey on multi-task learning," IEEE Transactions on Knowledge and Data Engineering, vol. 34, no. 12, pp. 5586-5609, 2021, doi: 10.1109/TKDE.2021.3070203.