Face Recognition Accuracy: Forensic Professionals, Untrained People, and Deep Learning Networks
Humans are considered by many to be experts at the task of face recognition. In our work, we have undertaken a number of comparisons between humans and state-of-the-art face recognition algorithms. In our recent work, we have also examined professional forensic face examiners, who testify in court. This work shows that professionals perform more accurately than untrained people, but that state-of-art algorithms perform at the level of human experts. This work builds on our previous work of human-machine comparisons.
Phillips, P. J., Yates, A. N., Hu, Y., Hahn, C. A., Noyes, E. Jackson, K. Cavazos, J. G., Jeckeln, G., Ranjan, R., Sankaranarayarnan, S., Chen, J.C., Castillo, C., Chellappa, R. White, D., & O’Toole, A. J. (2018). Face Recognition Accuracy of Forensic Examiners, Super-recognizers, and Algorithms. Proceedings of the National Academy of Sciences,
Hu, Y., Jackson, K. Yates, A. White, D. Phillips, P. J. & O’Toole, A. J. (2017). Person recognition: Qualitative differences in how forensic face examiners and untrained people rely on the face vs. the body for identification. Visual Cognition, 25 (4-6), 492-506
White, D., Norell, K. Phillips, P. J. & O’Toole. (2016). Human factors in facial forensic examination. In (Eds. M. Tistarelli & C. Champod) Biometrics in Forensic Science. Springer Verlag.
White, D., Phillips, P. J., Hahn, C. A., Hill, M., & O’Toole, A. J. (2015). Perceptual expertise in forensic facial image comparison. Proceedings of the Royal Society of London B: Biological Sciences, 282, 1814-1822.
Phillips P. J., Hill, M. Q., Swindle, J. A. & O’Toole, A.J. (2015). Human and algorithm performance on the PaSC Face Recognition Challenge. 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems.
Phillips, P. J. and O’Toole, A. J. (2014). Comparison of human and computer performance across face recognition experiments. Image & Vision Computing, 32(1), 74-85. (Editor’s Choice Review Article).
Phillips, P. J., Beveridge, J. R., Draper, B. A., Givens, G., O’Toole, A. J., Bolme, D., Dunlop, J., Lui, Y. M., Sahizada, H. & Wiemer, S. (2012). An Introduction to the Good, Bad, & Ugly Challenge Problem. Image & Vision Computing, 30(3), 177-185.
O’Toole, A.J., An, X., Dunlop, J.P., Natu, V. & Phillips, P.J. (2012). Comparing face recognition algorithms to humans on challenging tasks. ACM Transactions on Applied Perception. 9(4), Article 16.
O’Toole, A. J., Phillips, P.J., An, X. & Dunlop, J. (2012). Demographic effects on estimates of automatic face recognition. Image & Vision Computing 30(3),169-176.
O’Toole, A. J. (2011). A comparative examination of face recognition by humans and machines. In (Eds. S. Li & A. Jain). Handbook of Face Recognition (2nd Edition). Springer-Verlag, London Ltd., UK.
Phillips, P.J., Beveridge, J. R., Draper, B. A., Givens, G., O’Toole, A. J., Bolme, D. Dunlop, J. Lui, Y. M. Sahizada, H. & Wiemer, S. (2011). An Introduction to the Good, Bad, & Ugly Challenge Problem. Proceedings of the 9th IEEE International Conference on Automatic Face and Gesture Recognition.
Phillips, P.J., Narvekar, A., Jiang, F. & O’Toole, A. J. (2010). An other-race effect for face recognition algorithms. ACM Transactions on Applied Perception, 8(2), ART 14.
Phillips, P.J., Scruggs, W. T., O’Toole, A. J., Flynn, P. J., Bowyer, K. W., Schott, C. L., Sharpe, M. (2010). Face Recognition Vendor Test 2006 and Iris Challenge Evaluation 2006 large-scale experimental results. IEEE: Transactions on Pattern Analysis and Machine Intelligence, 32(5), 831-846.
Phillips, P.J., Flynn, P. J., Beveridge, R., Scruggs, W. T., O’Toole, A. J., Bolme, D., Bowyer, K. W., Givens, G. H., Lui, Y.M., Sahibzada, H. Scallan, J. Weimer, S. (2009). Overview of the Multiple Biometrics Grand Challenge. Proceedings of the 3rd International Conference on Biometrics, 2009.
O’Toole, A. J., Phillips, P.J., Narvekar, A. (2008). Humans versus algorithms: Comparisons from the Face Recognition Vendor Test 2006. Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition.
O’Toole, A. J., Phillips, P. J., Jiang, F., Ayyad, J., Pénard, N., & Abdi, H. (2007). Face recognition algorithms surpass humans matching faces across changes in illumination. IEEE: Transactions on Pattern Analysis and Machine Intelligence, 29(9),1642-1646.
O’Toole, A.J., Abdi, H., Jiang, F. & Phillips, P.J. (2007). Fusing face recognition algorithms and humans. IEEE: Transactions on Systems, Man & Cybernetics, 37(5), 1149-1155.
O’Toole, A. J., Harms, J., Snow, S. L., Hurst, D. R., Pappas, M. R. & Abdi, H. (2005). A video database of moving faces and people. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(5), 812-816.
Links to our other projects
Perception and Memory for Human Faces
Functional Neuroimaging of High Level Visual Processing of Human Faces
Perceptual Relationships Between Body Shape and Language
Analyzing Face Recognition Algorithms
Behavioral and Neural Correlates of Person Recognition
Understanding the Performance of Forensic Facial Identification Experts