via UCLA Henry Samueli School of Engineering and Applied Science
A pair of UCLA bioengineers and a former postdoctoral scholar have developed a new class of bionic 3D camera systems that can mimic flies’ multiview vision and bats’ natural sonar sensing, resulting in multidimensional imaging with extraordinary depth range that can also scan through blind spots.
Powered by computational image processing, the camera can decipher the size and shape of objects hidden around corners or behind other items. The technology could be incorporated into autonomous vehicles or medical imaging tools with sensing capabilities far beyond what is considered state of the art today. This research has been published in Nature Communications.
In the dark, bats can visualize a vibrant picture of their surroundings by using a form of echolocation, or sonar. Their high-frequency squeaks bounce off their surroundings and are picked back up by their ears. The minuscule differences in how long it takes for the echo to reach the nocturnal animals and the intensity of the sound tell them in real time where things are, what’s in the way and the proximity of potential prey.
Many insects have geometric-shaped compound eyes, in which each “eye” is composed of hundreds to tens of thousands of individual units for sight — making it possible to see the same thing from multiple lines of sight. For example, flies’ bulbous compound eyes give them a near-360-degree view even though their eyes have a fixed focus length, making it difficult for them to see anything far away, such as a flyswatter held aloft.
Inspired by these two natural phenomena found in flies and bats, the UCLA-led team set out to design a high-performance 3D camera system with advanced capabilities that leverage these advantages but also address nature’s shortcomings.
“While the idea itself has been tried, seeing across a range of distances and around occlusions has been a major hurdle,” said study leader Liang Gao, an associate professor of bioengineering at the UCLA Samueli School of Engineering. “To address that, we developed a novel computational imaging framework, which for the first time enables the acquisition of a wide and deep panoramic view with simple optics and a small array of sensors.”
The researchers also use a type of LiDAR, or “Light Detection And Ranging,” in which a laser scans the surroundings to create a 3D map of the area.
Conventional LiDAR, without CLIP, would take a high-resolution snapshot of the scene but miss hidden objects, much like our human eyes would.
Using seven LiDAR cameras with CLIP, the array takes a lower-resolution image of the scene, processes what individual cameras see, then reconstructs the combined scene in high- resolution 3D imaging. The researchers demonstrated the camera system could image a complex 3D scene with several objects, all set at different distances.
“If you’re covering one eye and looking at your laptop computer, and there’s a coffee mug just slightly hidden behind it, you might not see it, because the laptop blocks the view,” explained Gao, who is also a member of the California NanoSystems Institute. “But if you use both eyes, you’ll notice you’ll get a better view of the object. That’s sort of what’s happening here, but now imagine seeing the mug with an insect’s compound eye. Now multiple views of it are possible.”
According to Gao, CLIP helpsCombined with LiDAR, the system is able to achieve the bat echolocation effect so one can sense a hidden object by how long it takes for light to bounce back to the camera the camera array make sense of what’s hidden in a similar manner. Combined with LiDAR, the system is able to achieve the bat echolocation effect so one can sense a hidden object by how long it takes for light to bounce back to the camera.Combined with LiDAR, the system is able to achieve the bat echolocation effect so one can sense a hidden object by how long it takes for light to bounce back to the camera
The Latest on: Bionic Super 3D Cameras
- Phone Comparisons: Apple iPhone 14 Pro Max vs OnePlus 10Ton September 22, 2022 at 2:00 pm
Our Apple iPhone 14 Pro Max vs OnePlus 10T comparison is out. Is Apple's flagship worth that much more for you? Maybe this will help.
- iPhone 14 Pro vs Vivo X80 Pro: Specs Comparisonon September 21, 2022 at 2:55 pm
The iPhone is an icon, but the Vivo X80 Pro does not joke. Its design is simply amazing due to several aspects. First of all, it comes with a curved edge to edge display on the front, with a very high ...
- Iphone 14: A Natural Upgrade With Best Battery Life, Super Cameraon September 18, 2022 at 11:45 pm
The reasons are simple: Powerful main camera with a huge leap in low-light performance, advanced connectivity capabilities with 5G and eSIM, A15 Bionic that ... to receive super response in ...
- Apple A16 Bionic: Everything to know about the latest iPhone chipseton September 16, 2022 at 8:56 pm
and telephoto cameras. However, another notable upgrade is the A16 Bionic chipset. So what exactly is this processor? How does it compare to the best Android SoCs? What makes it stand out?
- Phone Comparisons: Apple iPhone 14 Pro Max vs Google Pixel 6 Proon September 15, 2022 at 4:56 pm
In this article, we'll comparing the Apple iPhone 14 Pro Max vs Google Pixel 6 Pro. Two top-of-the-line flagship smartphones.
- iPhone 14 Pro Max vs Xiaomi 12S Ultra: Specs Comparisonon September 15, 2022 at 12:49 pm
Apple has always been the most important company in terms of smartphone design and things did not change in 2022. The new iPhone 14 Pro Max ditches the notch in favor of a Dynamic Island, which is ...
- iPhone 14 Pro & Pro Max review: The 48-megapixel camera is legiton September 14, 2022 at 6:00 am
Between the Dynamic Island and the 48-megapixel camera, the iPhone 14 Pro and 14 Pro Max are finally worthy of the pro branding.
- Apple just gave owners of older iPhones a great reason not to upgradeon September 8, 2022 at 5:00 pm
The latest iPhones typically come with the latest and most powerful processor, as well as some camera upgrades that ... 14 models run on the same A15 Bionic processor as the iPhone 13 series.
- iPhone SEon March 13, 2022 at 12:45 pm
The current model added the A15 Bionic chip from the iPhone 13, 5G connectivity, an upgraded rear camera with more advanced ... Haptic Touch works similarly to 3D Touch and offers a lot of the ...
via Bing News
The Latest on: Bionic Super 3D Cameras
via Google News