Unconstrained face mask and face-hand interaction datasets: building a computer vision system to help prevent the transmission of COVID-19.

CNN COVID-19 Face mask detection Face-hand interaction detection Social distance measurement

Journal

Signal, image and video processing
ISSN: 1863-1703
Titre abrégé: Signal Image Video Process
Pays: England
ID NLM: 101646680

Informations de publication

Date de publication:
2023
Historique:
received: 01 07 2021
revised: 18 04 2022
accepted: 28 06 2022
medline: 2 8 2022
pubmed: 2 8 2022
entrez: 1 8 2022
Statut: ppublish

Résumé

Health organizations advise social distancing, wearing face mask, and avoiding touching face to prevent the spread of coronavirus. Based on these protective measures, we developed a computer vision system to help prevent the transmission of COVID-19. Specifically, the developed system performs face mask detection, face-hand interaction detection, and measures social distance. To train and evaluate the developed system, we collected and annotated images that represent face mask usage and face-hand interaction in the real world. Besides assessing the performance of the developed system on our own datasets, we also tested it on existing datasets in the literature without performing any adaptation on them. In addition, we proposed a module to track social distance between people. Experimental results indicate that our datasets represent the real-world's diversity well. The proposed system achieved very high performance and generalization capacity for face mask usage detection, face-hand interaction detection, and measuring social distance in a real-world scenario on unseen data. The datasets are available at https://github.com/iremeyiokur/COVID-19-Preventions-Control-System.

Identifiants

pubmed: 35910402
doi: 10.1007/s11760-022-02308-x
pii: 2308
pmc: PMC9307220
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1027-1034

Informations de copyright

© The Author(s) 2022.

Auteurs

Fevziye Irem Eyiokur (FI)

Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany.

Hazım Kemal Ekenel (HK)

Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey.

Alexander Waibel (A)

Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany.

Classifications MeSH