Face Recognition-Based Login Security System Using Deep Learning

Adi Sopian; Septiana Ningtyas; Usanto S

doi:10.35877/454RI.jinav4886

Authors

Adi Sopian Institut Teknologi dan Bisnis Swadharma
Septiana Ningtyas Institut Teknologi dan Bisnis Swadharma
Usanto S Institut Teknologi dan Bisnis Swadharma

DOI:

https://doi.org/10.35877/454RI.jinav4886

Keywords:

Face Recognition, Deep Learning, Login Security, CNN, Authentication System

Abstract

Password-based authentication remains the dominant access-control mechanism for digital systems, yet it suffers from well-documented weaknesses including weak or reused credentials, phishing, credential leakage, and the cognitive burden of password management. This study proposes and evaluates a face recognition-based login security system built on deep learning to address these limitations through a biometric factor that is intrinsic to the user. The system follows a verification pipeline consisting of webcam image acquisition, preprocessing, face detection, alignment, deep feature extraction, and similarity-based decision making. A convolutional neural network (CNN) of the FaceNet family maps each detected face to a compact 128-dimensional embedding, and authentication is performed by comparing the live embedding against an enrolled template using a Euclidean-distance threshold. A lightweight browser-based prototype was implemented with HTML, JavaScript, and the face-api.js library to demonstrate real-time, client-side operation without specialized hardware. Using a simulated single-identity evaluation across 300 login attempts spanning frontal, off-angle, low-light, eyewear, occlusion, and impostor scenarios, the system achieved an accuracy of 97.0%, precision of 97.96%, recall of 96.0%, and an F1-score of 96.97%, with a False Acceptance Rate of 2.0%, a False Rejection Rate of 4.0%, and an average login time of 1.28 seconds. The results indicate that deep-learning face recognition is a practical and accurate alternative to passwords, while highlighting residual challenges related to illumination, pose, and presentation (spoofing) attacks that motivate the integration of liveness detection and multi-factor authentication.

References

Abdalla, M., & Pointcheval, D. (2005). Simple Password-Based Encrypted Key Exchange Protocols. Lectures Notes in Computer Science, 3376, 191–208. https://doi.org/10.1007/978-3-540-30574-3_14

Ahmed, H. E. H., Kalash, H. M., & Farag Allah, O. S. (2007). Encryption efficiency analysis and security evaluation of RC6 block cipher for digital images. 2007 International Conference on Electrical Engineering, ICEE. https://doi.org/10.1109/ICEE.2007.4287293

Albdairi, A. J. A., Xiao, Z., Alkhayyat, A., Humaidi, A. J., Fadhel, M. A., Taher, B. H., Alzubaidi, L., Santamaría, J., & Al-shamma, O. (2022). Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification. Applied Sciences (Switzerland), 12(5). https://doi.org/10.3390/app12052605

Arvin S. Lat, J., Xavier R. Bondoc, R., & Atienza, K. C. V. (2013). SOUL System: secure online USB login system. Information Management & Computer Security, 21(2), 102–109. https://doi.org/10.1108/IMCS-08-2012-0042

Bendjillali, R., Beladgham, M., Merit, K., & Taleb-Ahmed, A. (2019). Improved Facial Expression Recognition Based on DWT Feature for Deep CNN. Electronics, 8(3), 324. https://doi.org/10.3390/electronics8030324

Bose, P., & Bandyopadhyay, S. K. (2020). Facial Spots Detection Using Convolution Neural Network. Asian Journal of Research in Computer Science, 5(3), 71–83. https://doi.org/10.9734/ajrcos/2020/v5i330146

Chuang, C. H., Chang, K. Y., Huang, C. S., & Jung, T. P. (2022). IC-U-Net: A U-Net-based Denoising Autoencoder Using Mixtures of Independent Components for Automatic EEG Artifact Removal. NeuroImage, 263, 119586. https://doi.org/10.1016/J.NEUROIMAGE.2022.119586

Dempsey, J. (2001). Internet Security and Privacy. International Journal of Computer Science and Information Technology Research, 2(3), 467–475. https://doi.org/10.1201/9781420000177.ch44

Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019). ArcFace: Additive Angular Margin Loss for Deep Face Recognition. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 4685–4694. https://doi.org/10.1109/CVPR.2019.00482

Elsheikh, R. A., Mohamed, M. A., Abou-Taleb, A. M., & Ata, M. M. (2024). Improved facial emotion recognition model based on a novel deep convolutional structure. Scientific Reports, 14(1), 1–31. https://doi.org/10.1038/s41598-024-79167-8

Gu, Q. (2008). Finding and Segmenting Human Faces. http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-89283

Hammoudeh, M. A. A., Alsaykhan, M., Alsalameh, R., & Althwaibi, N. (2022). Computer Vision: A Review of Detecting Objects in Videos – Challenges and Techniques. International Journal of Online and Biomedical Engineering, 18(1), 15–27. https://doi.org/10.3991/ijoe.v18i01.27577

Ibrahim, R. F., Yhiea, N. M., Mohammed, A. M., & Mohamed, A. M. (2023). Pleural Effusion Detection Using Machine Learning and Deep Learning Based on Computer Vision BT - Proceedings of the 8th International Conference on Advanced Intelligent Systems and Informatics 2022 (A. E. Hassanien, V. Snášel, M. Tang, T.-W. Sung, & K.-C. Chang, Eds.; pp. 199–210). Springer International Publishing.

Jain, A. K., Ross, A., & Prabhakar, S. (2004). An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1), 4–20. https://doi.org/10.1109/TCSVT.2003.818349

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539

Li, X., Yang, Z., & Wu, H. (2020). Face detection based on receptive field enhanced multi-task cascaded convolutional neural networks. IEEE Access, 8, 174922–174930. https://doi.org/10.1109/ACCESS.2020.3023782

Lou, A., Guan, S., & Loew, M. H. (2021). DC-UNet: rethinking the U-Net architecture with dual channel efficient CNN for medical image segmentation. 98. https://doi.org/10.1117/12.2582338

Mostafa, A. M., Ezz, M., Elbashir, M. K., Alruily, M., Hamouda, E., Alsarhani, M., & Said, W. (2023). Strengthening Cloud Security: An Innovative Multi-Factor Multi-Layer Authentication Framework for Cloud User Authentication. Applied Sciences 2023, Vol. 13, Page 10871, 13(19), 10871. https://doi.org/10.3390/APP131910871

Muller, N., Magaia, L., & Herbst, B. M. (2004). Singular value decomposition, eigenfaces, and 3D reconstructions. SIAM Review. https://doi.org/10.1137/S0036144501387517

Mutneja, V., & Singh, S. (2018). GPU accelerated face detection from low resolution surveillance videos using motion and skin color segmentation. Optik, 157, 1155–1165. https://doi.org/10.1016/J.IJLEO.2017.11.188

Rahim, R. (2017). 128 Bit Hash of Variable Length in Short Message Service Security. International Journal of Security and Its Applications, 11(1), 45–58. https://doi.org/10.14257/ijsia.2017.11.1.05

Rahim, R., Afriliansyah, T., Winata, H., Nofriansyah, D., Ratnadewi, & Aryza, S. (2018). Research of Face Recognition with Fisher Linear Discriminant. IOP Conference Series: Materials Science and Engineering, 300, 012037. https://doi.org/10.1088/1757-899X/300/1/012037

Schmidt, D., & Jaeger, T. (2013). Pitfalls in the automated strengthening of passwords. Proceedings of the 29th Annual Computer Security Applications Conference on - ACSAC ’13, 129–138. https://doi.org/10.1145/2523649.2523651

Schroff, F., Kalenichenko, D., & Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 815–823. https://doi.org/10.1109/CVPR.2015.7298682

Seprtitahara. (2012). Systems Face Recognition (Face Recognition) Using Hidden Method Markov Model (HMM).

Sun, X., Wu, P., & Hoi, S. C. H. (2018). Face detection using deep learning: An improved faster RCNN approach. Neurocomputing, 299, 42–50. https://doi.org/10.1016/J.NEUCOM.2018.03.030

Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. 2014 IEEE Conference on Computer Vision and Pattern Recognition, 1701–1708. https://doi.org/10.1109/CVPR.2014.220

Yan, A., & Cheng, Z. (2024). A Review of the Development and Future Challenges of Case-Based Reasoning. Applied Sciences, 14(16), 7130. https://doi.org/10.3390/app14167130

Yu, B., & Tao, D. (2019). Anchor Cascade for Efficient Face Detection. IEEE Transactions on Image Processing, 28(5), 2490–2501. https://doi.org/10.1109/TIP.2018.2886790

Zhang, K., Zhang, Z., Wang, H., Li, Z., Qiao, Y., & Liu, W. (2017). Detecting Faces Using Inside Cascaded Contextual CNN. Proceedings of the IEEE International Conference on Computer Vision, 2017-Octob, 3190–3198. https://doi.org/10.1109/ICCV.2017.344