Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem

Image credit: Unsplash

Abstract

Observed variations in face recognition accuracy across demographics, often viewed as “bias”, have motivated research into the causes of such variations. Variations in facial hairstyle are an important potential cause of accuracy differences for males. In this work, we first explore how face recognition accuracy is affected by the facial hair region - clean-shaven, mustache, chin-area beard, side-toside beard. Results show that mustache area facial hair has a greater effect on accuracy than either chin-area beard or side-to-side beard. We then employ a synthetic facial hair method to verify the consistency of the observation across five synthetic facial hair colors and three face matchers. Results of these experiments indicate that, the larger the difference in brightness between facial hair region and skin region, the larger impact of the mustache area. To reduce accuracy differences caused by facial hairstyle, quantified by ∆d′, we adjust the training dataset distribution to have increased representation of facial hair, resulting in an over 40% reduction in accuracy difference.

Publication
In The Fifth Workshop on Demographic Variations in Performance of Biometrics And Related Technology (DVPBA)
Haiyu Wu
Haiyu Wu
Graduate Research Assistant