A deep feature-level fusion model for masked face identity recommendation system

Tipajin Thaipisutikul, Phonarnun Tatiyamaneekul, Chih Yang Lin, Suppawong Tuarob

Research output: Contribution to journalArticlepeer-review

Abstract

The widespread occurrences of airborne outbreaks (e.g., COVID-19) and pollution (e.g., PM2.5) have urged people in the affected regions to protect themselves by wearing face masks. In certain areas, wearing masks amidst such health-endangering times is even enforced by law. While most people wear masks to guard themselves against airborne substances, some exploit such excuses and use face masks to conceal their identity for criminal purposes such as shoplifting, robbery, drug transport, and assault. While automatic face recognition models have been proposed, most of these models aim to identify clear, unobstructed faces for authentication purposes and cannot effectively handle cases where masks cover most facial areas. To mitigate such a problem, this paper proposes a deep-learning-based feature-fusion framework, FIREC, that combines additional demographic-estimated features such as age, gender, and race into the underlying facial representation to compensate for the information lost due to mask obstruction. Given an image of a masked face, our system recommends a ranked list of potential identities of the person behind the mask. Empirical results show that the best configuration of our proposed framework can recognize bare faces and masked faces with the accuracy of 99.34% and 97.65% in terms of Hit@10, respectively. The proposed framework could greatly benefit high-recall facial identity recognition applications such as identifying potential suspects from CCTV or passers-by’s cameras, especially during crisis times when people commonly cover their faces with protective masks.

Original languageEnglish
Pages (from-to)16011-16024
Number of pages14
JournalJournal of Ambient Intelligence and Humanized Computing
Volume14
Issue number12
DOIs
StatePublished - Dec 2023

Keywords

  • AI-driven technology
  • COVID-19
  • Deep learning
  • Face identity recommendation system
  • Masked face recognition

Fingerprint

Dive into the research topics of 'A deep feature-level fusion model for masked face identity recommendation system'. Together they form a unique fingerprint.

Cite this