Mery, D.; Zhao, Y.; Bowyer, K. (2016): On accuracy estimation in biometric research based on face images. In 8th IEEE International Conference on Biometrics: Theory, Applications, and Systems (BTAS 2016). Niagara Falls, Sep. 6-9. (2016)

On accuracy estimation in biometric research based on face images

Revista : Proceedings of the 8th IEEE International Conference on Biometrics: Theory, Applications, and System
Tipo de publicación : Conferencia No A*

Abstract

The estimated accuracy of an algorithm is the most important element of the typical biometrics research publication. Comparisons between algorithms are commonly made based on estimated accuracies reported in different publications. However, even when the same dataset is used in two publications, there is a very low frequency of the publications using the same protocol for estimating algorithm accuracy. Using the example problems of face recognition, expression recognition and gender classification, we show that the variation in estimated performance on the same dataset across different protocols can be enormous. Based on these results, we make recommendations for how to obtain performance estimates that allow reliable comparison between algorithms.