Facial expression reading based on MLP classification from 3D depth maps and 2D images obtained by NIR-LFC
Machine-learned, light-field camera reads facial expressions from high-contrast illumination invariant 3D facial images
A joint research team led by Professors Ki-Hun Jeong and Doheon Lee from the KAIST Department of Bio and Brain Engineering reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.
Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smart phone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.
However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.
The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54% of image reconstruction errors. Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.
Through this technique, the team could overcome the limitations of existing light-field cameras and was able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.
The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85% accuracy – a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.
Professor Ki-Hun Jeong said, “The sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyze the facial expressions and emotions of humans.” To highlight the significance of this research, he added, “It could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions.”
Original Article: AI Light-Field Camera Reads 3D Facial Expressions?
More from: Korea Advanced Institute of Science and Technology
The Latest on: Facial expression detection
- Emotion Detection and Recognition Market to surpass US$ 40.5 Billion by 2030, Says Coherent Market Insights (CMI)on March 27, 2023 at 6:00 am
According to Coherent Market Insights, global emotion detection and recognition market is estimated to be valued at US$ 22.21 billion in 2022 and is expected to exhibit a ...
- French privacy chief warns against using facial recognition for 2024 Olympicson March 25, 2023 at 5:07 pm
PARIS — The French data protection authority's president Marie-Laure Denis warned Tuesday against using facial recognition as part of the 2024 Paris Summer Olympics security toolkit. "The members of ...
- Truthsayer Uses Facial Recognition To See If You’re Telling The Truthon March 25, 2023 at 5:00 pm
[Fletcher] also threw in the FER library for facial expression recognition, to get an idea of the subject’s mood. Together, these cues form a rough estimate of the subject’s truthiness ...
- Masks hinder our ability to recognize facial expressions of sadness and fearon March 25, 2023 at 4:00 am
Face masks can make it harder to recognize facial expressions that stimulate empathy, such as sadness, according to new research published in the scientific journal Psychophysiology. Previous research ...
- Face detectionon March 22, 2023 at 5:00 pm
The little module has a camera and face detection built into it. It doesn’t draw much power at 150 milliwatts. It can sense faces, including where they are and how many people are looking.
- Indications that China has made big strides in chip muscle, price for facial recognitionon March 21, 2023 at 4:25 pm
A Chinese maker of measurement systems designed for 3D facial recognition says its chips outperform other chips on the international market and do it cheaper.
- Who’s Using Facial Recognition Technology?on March 21, 2023 at 6:17 am
Anyone can read what you share. By James Barron Good morning. It’s Tuesday. Facial recognition technology is increasingly being used to scan customers entering stores or, in the case of Madison ...
- Facial recognition difficulties may be linked to long COVIDon March 20, 2023 at 1:49 pm
Dartmouth researchers focused on the details from one of the patient's cases, Annie, 28, who had normal facial recognition abilities prior to her COVID-19 infection and said two months after the ...
- Facial recognition and AI get the evil eye from community groups and governmentson March 17, 2023 at 3:04 pm
Pushback against facial recognition is being organized by groups concerned about police overreach, privacy and biometric data security.
- A New York grocery store is using biometrics including eye scanners and voice prints to identify repeat shoplifters. Some shoppers say that's creepy — even if it deters theft.on March 17, 2023 at 10:34 am
Fairway joins a list of retailers, including Lowe's, Macy's, and Albertsons, that have deployed facial recognition technology to catch shoplifters.
via Bing News
The Latest on: Facial expression detection
[google_news title=”” keyword=”facial expression detection” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
Add Comment