Joint Masked Face Recognition and Temperature Measurement System Using Convolutional Neural Networks

Tsung Han Tsai, Ji Xiu Lu, Xuan Yu Chou, Chieng Yang Wang

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

With the outbreak of COVID-19, epidemic prevention has become a way to prevent the spread of epidemics. Many public places, such as hospitals, schools, and office places, require disinfection and temperature measurement. To implement epidemic prevention systems and reduce the risk of infection, it is a recent trend to measure body temperature through non-contact sensing systems with thermal imaging cameras. Compared to fingerprints and irises, face recognition is accurate and does not require close contact, which significantly reduces the risk of infection. However, masks block most facial features, resulting in the low accuracy of face recognition systems. This work combines masked face recognition with a thermal imaging camera for use as an automated attendance system. It can record body temperature and recognize the person at the same time. Through the designed UI system, we can search the attendance information of each person. We not only provide the design method based on convolutional neural networks (CNNs), but also provide the complete embedded system as a real demonstration and achieve a 94.1% accuracy rate of masked face recognition in the real world. With the face recognition system combined with a thermal imaging camera, the purpose of screening body temperature when checking in at work can be achieved.

Original languageEnglish
Article number2901
JournalSensors (Switzerland)
Volume23
Issue number6
DOIs
StatePublished - Mar 2023

Keywords

  • deep learning
  • embedded system
  • face detection
  • masked face recognition

Fingerprint

Dive into the research topics of 'Joint Masked Face Recognition and Temperature Measurement System Using Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this