An Improved Face Mask-aware Recognition System Based on Deep Learning

Chih Yang Lin, Amornthep Rojanasarit, Tipajin Thaipisutikul, Chi Wen Lung, Fityanul Akhyar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Face mask detection and recognition have been incorporated into many applications in daily life, especially during the current COVID-19 pandemic. To mitigate the spread of coronavirus, wearing face masks has become commonplace. However, traditional face detection and recognition systems utilize main facial features such as the mouth, nose, and eyes to determine a person’s identity. Masks make facial detection and recognition tasks more challenging since certain parts of the face are concealed. Yet, how to improve the performance of existing systems with a face mask overlaid on the original face input images remains an open area of inquiry. In this study, we propose an improved face mask-aware recognition system named ‘MAR’ based on deep learning, which can tackle challenges in face mask detection and recognition. MAR consists of five main modules to handle various kinds of input images. We re-train the CenterNet model with our augmented face mask inputs to perform face mask detection and propose four variations on face mask recognition models based on the pre-trained ArcFace to handle facial recognition. Finally, we demonstrate the effectiveness of our proposed models on the VGGFACE2 dataset and achieve a high accuracy score on both detection and recognition tasks.

Original languageEnglish
Title of host publicationData Science and Security - Proceedings of IDSCS 2022
EditorsSamiksha Shukla, Xiao-Zhi Gao, Joseph Varghese Kureethara, Durgesh Mishra
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages15
ISBN (Print)9789811922107
StatePublished - 2022
EventInternational Conference on Data Science, Computation, and Security, IDSCS 2022 - Lavasa, India
Duration: 11 Feb 202212 Feb 2022

Publication series

NameLecture Notes in Networks and Systems
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389


ConferenceInternational Conference on Data Science, Computation, and Security, IDSCS 2022


  • Deep learning
  • Face mask detection
  • Face mask recognition


Dive into the research topics of 'An Improved Face Mask-aware Recognition System Based on Deep Learning'. Together they form a unique fingerprint.

Cite this