NEC Tops Competition In Identifying Subjects Wearing Face Masks At DHS 2020 Biometric Technology Rally
Advanced Matching Algorithms Outperform Median by 19% in Response to Coronavirus Pandemic
Washington DC - March 9, 2021 - An algorithm submitted by NEC Corporation of America (NEC) outpaced all competition in correctly matching images of subjects wearing face masks at the U.S. Department of Homeland Security (DHS) Science and Technology Directorate (S&T) 2020 Biometric Technology Rally. The algorithm submitted by NEC, code-named 'Alan' for the anonymized test, achieved the highest True Identification Rate (TIR) at 98.7% when combined with acquisition system code-named Glen on subjects wearing a facemask. This TIR result exceeded median performance by as much as 19%. The first-place finish in the key category was confirmed in results recently published by DHS S&T.(1)
The "focused" face matching category is considered the best test of pure performance of a biometric face matching algorithm as it excludes errors introduced when a front-end system-like a digital camera-cannot acquire a suitable image for processing. Even when including these external errors, NEC's algorithm still achieved a 95.9% TIR, which was a full 4 percentage points higher than the second-best competitor.
Further, when subjects were not wearing masks NEC's biometric matching technology was able to meet and exceed the Rally's goal of "99% or better" in each of the simulated scenarios DHS S&T organized. This included a first-place finish for the algorithm code named "Pearl," with a near-perfect 99.8% TIR without acquisition errors, and a 99.3% rate when instances of these errors were included. This new set of data reconfirmed earlier tests-including the well-regarded National Institute of Standards and Technology FRVT lab evaluations-that show NEC's algorithms have been consistently rated the most accurate for more than 10 years.(2)
The Biometric Technology Rally, which took place at the end of 2020 at its affiliated Maryland Test Facility, is an annual event hosted by DHS S&T that allows vendors to demonstrate their technology in front of potential U.S. government buyers. The tests are designed to level the playing field for all products under consideration and follow strict rules. They are done in accordance with government requirements, including testing rules to protect health, safety, and privacy of human subjects.
In 2020, the rally simulated the emerging technical challenge for industry resulting from the coronavirus pandemic: reliably identifying people wearing facemasks. This event consisted of an initial individual processing phase, as well as an advanced group processing phase. Technology providers were required to demonstrate strong performance in the individual processing phase to qualify for the group processing phase.
As part of the test, front-end-or Acquisition Systems-collected biometric images from demographically diverse volunteers. This is basically the physical part of the test that looks at the performance of hardware, like digital cameras, as users are engaged. The images were then processed through back-end Matching Systems, which generally consist of software systems powered by complex biometric algorithms.
Most volunteers had prior experience with biometric devices and process and were told to comply with any instruction but were not briefed on how to use specific products being tested. Groups of volunteers were directed to opt-in or out, then pass through test gates for each product, one at a time, and under a time constraint.
Having acquired images in a simulated real-world scenario, the back-end Matching Systems were fed the images and then evaluated on two factors including: overall algorithm performance and robustness. Overall performance is primarily a test of the algorithm’s effectiveness in making a successful match of a face to an image. Robustness measures how a matching system performs when used with different Acquisition Systems.
1. "Matching System Results for the 2020 Biometric Technology Rally," published January 27, 2021 by U.S. Department of Homeland Security Science & Technology and the Maryland Test Facility (MdTF).
2. "The Face Recognition Vendor Test 2018 (FRVT 2018)," sponsored by the US Department of Homeland Security and others, assessed the accuracy and speed of authentication for tens of millions of people using face recognition technologies from top vendors from throughout the world.
About NEC Corporation of America
NEC Corporation of America (NEC) is a leading technology integrator providing solutions that improve the way people work and communicate. NEC delivers integrated Solutions for Society that are aligned with our customers' priorities to create new value for people, businesses and society, with a special focus on safety, security and efficiency. We deliver one of the industry's strongest and most innovative portfolios of communications, analytics, security, biometrics and technology solutions that unleash customers' productivity potential. Through these solutions, NEC combines its best-in-class solutions and technology, and leverages a robust partner ecosystem to solve today's most complex business problems. NEC Corporation of America is a wholly-owned subsidiary of NEC Corporation, a global technology leader with a presence in 160 countries and $29 billion in revenues.
© 2021 NEC Corporation. NEC is a registered trademark of NEC Corporation. All Rights Reserved. Other product or service marks mentioned are the trademarks of their respective owners.