
Facial expression reading based on MLP classification from 3D depth maps and 2D images obtained by NIR-LFC
Machine-learned, light-field camera reads facial expressions from high-contrast illumination invariant 3D facial images
A joint research team led by Professors Ki-Hun Jeong and Doheon Lee from the KAIST Department of Bio and Brain Engineering reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.
Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smart phone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.
However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.
The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54% of image reconstruction errors. Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.
Through this technique, the team could overcome the limitations of existing light-field cameras and was able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.
The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85% accuracy – a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.
Professor Ki-Hun Jeong said, “The sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyze the facial expressions and emotions of humans.” To highlight the significance of this research, he added, “It could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions.”
Original Article: AI Light-Field Camera Reads 3D Facial Expressions?
More from: Korea Advanced Institute of Science and Technology
The Latest on: Facial expression detection
- Recognition of fear, anger impaired in psychosis patientson May 25, 2022 at 9:20 am
... globally recognize facial emotion expressions, with evidence for stronger effects on negative emotions and anger than on happiness. Facial anger recognition was significantly associated with ...
- Bengaluru plans facial recognition gates at Namma Metroon May 24, 2022 at 2:52 pm
The Bangalore Metro Rail Corporation is planning to install the system at automated fare collection gates throughout the Namma Metro network.
- Lawmakers urge FTC to look into ‘misleading’ statements by facial recognition company ID.meon May 18, 2022 at 2:34 pm
Four senators are urging the Federal Trade Commission (FTC) to investigate ID.me, who they say “made multiple misleading statements about its use of facial recognition,” according to a press release.
- Researcher explores Clearview facial recognition, GDPR allegations and enforcementon May 18, 2022 at 12:30 pm
Jasserand is a postdoctoral privacy researcher and Marie Skłodowska-Curie fellow at KU Leuven, and is studying the use of facial recognition in public spaces.
- Tag Archives: facial recognitionon May 18, 2022 at 10:26 am
Some of more tech-savvy Democrats in the U.S. Senate are asking the Federal Trade Commission (FTC) to investigate identity-proofing company ID.me for “deceptive statements” the company and its founder ...
- EmotionTrac analyzes facial expressions in real time to help lawyers pick juries, market themselveson May 18, 2022 at 6:37 am
Facial recognition software is becoming a greater part of our everyday lives. The police use it to investigate crime. Smartphones and computers use it to secure data. Businesses use it to provide more ...
- Facial Recognition Software Simplifies Resident, Tenant Accesson May 18, 2022 at 5:07 am
Video surveillance and biometrics, such as fingerprints, are common options—not to mention key cards—but forward-thinking properties are now moving to facial recognition software for tenants to enter ...
- American Green, Inc.(TM) (ERBB) Officially Acquires Vendweb - Supplier of Its Agx Facial Recognition and Over-21 Age Smart Vending Machineon May 17, 2022 at 4:30 am
American Green, Inc. (OTC Pink: ERBB) announced today that it has completed the purchase of Vendweb - the North Carolina vending machine company that has been supplying American Green with its ...
- ‘Stranger Things’ are happening at Domino’s. You can now order pizza with facial recognitionon May 16, 2022 at 10:19 am
ANN ARBOR, MI – Strange things are happening at Domino’s. The Ann Arbor-based pizza chain announced Monday that it has teamed up with Netflix to introduce the latest strange thing to come out ...
- Facial recognition technology is a valuable toolon May 15, 2022 at 11:32 am
With proper purpose, restraint and regulation, it can help solve crimes, aid victims and ultimately make the world a safer place.
via Bing News
The Latest on: Facial expression detection
via Google News
Add Comment