
Presentation attack (spoofing) detection (PAD) typically operates alongside biometric verification to improve reliablity in the face of spoofing attacks. Even though the two sub-systems operate in tandem to solve the single task of reliable biometric verification, they address different detection tasks and are hence typically evaluated separately. Evidence shows that this approach is suboptimal. We introduce a new metric for the joint evaluation of PAD solutions operating in situ with biometric verification. In contrast to the tandem detection cost function proposed recently, the new tandem equal error rate (t-EER) is parameter free. The combination of two classifiers nonetheless leads to a \emph{set} of operating points at which false alarm and miss rates are equal and also dependent upon the prevalence of attacks. We therefore introduce the \emph{concurrent} t-EER, a unique operating point which is invariable to the prevalence of attacks. Using both modality (and even application) agnostic simulated scores, as well as real scores for a voice biometrics application, we demonstrate application of the t-EER to a wide range of biometric system evaluations under attack. The proposed approach is a strong candidate metric for the tandem evaluation of PAD systems and biometric comparators.
To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence. For associated codes, see https://github.com/TakHemlata/T-EER (Github) and https://colab.research.google.com/drive/1ga7eiKFP11wOFMuZjThLJlkBcwEG6_4m?usp=sharing (Google Colab)
FOS: Computer and information sciences, biometrics, Computer Science - Machine Learning, Sound (cs.SD), Computer Science - Cryptography and Security, tandem evaluation, Image and Video Processing (eess.IV), Electrical Engineering and Systems Science - Image and Video Processing, Statistics - Computation, Computer Science - Sound, Machine Learning (cs.LG), presentation attack detection, Audio and Speech Processing (eess.AS), FOS: Electrical engineering, electronic engineering, information engineering, equal error rate, Cryptography and Security (cs.CR), Computation (stat.CO), automatic speaker verification, Electrical Engineering and Systems Science - Audio and Speech Processing
FOS: Computer and information sciences, biometrics, Computer Science - Machine Learning, Sound (cs.SD), Computer Science - Cryptography and Security, tandem evaluation, Image and Video Processing (eess.IV), Electrical Engineering and Systems Science - Image and Video Processing, Statistics - Computation, Computer Science - Sound, Machine Learning (cs.LG), presentation attack detection, Audio and Speech Processing (eess.AS), FOS: Electrical engineering, electronic engineering, information engineering, equal error rate, Cryptography and Security (cs.CR), Computation (stat.CO), automatic speaker verification, Electrical Engineering and Systems Science - Audio and Speech Processing
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
