via Caltech
Engineers at Caltech, ETH Zurich, and Harvard are developing an artificial intelligence (AI) that will allow autonomous drones to use ocean currents to aid their navigation, rather than fighting their way through them.
“When we want robots to explore the deep ocean, especially in swarms, it’s almost impossible to control them with a joystick from 20,000 feet away at the surface. We also can’t feed them data about the local ocean currents they need to navigate because we can’t detect them from the surface. Instead, at a certain point we need ocean-borne drones to be able to make decisions about how to move for themselves,” says John O. Dabiri (MS ’03, PhD ’05), the Centennial Professor of Aeronautics and Mechanical Engineering and corresponding author of a paper about the research that was published by Nature Communications on December 8.
To tackle this challenge, researchers turned to reinforcement learning (RL) networks. Compared to conventional neural networks, reinforcement learning networks do not train on a static data set but rather train as fast as they can collect experience. This scheme allows them to exist on much smaller computers—for the purposes of this project, the team wrote software that can be installed and run on a Teensy—a 2.4-by-0.7-inch microcontroller that anyone can buy for less than $30 on Amazon and only uses about a half watt of power.
Using a computer simulation in which flow past an obstacle in water created several vortices moving in opposite directions, the team taught the AI to navigate in such a way that it took advantage of low-velocity regions in the wake of the vortices to coast to the target location with minimal power used. To aid its navigation, the simulated swimmer only had access to information about the water currents at its immediate location, yet it soon learned how to exploit the vortices to coast toward the desired target. In a physical robot, the AI would similarly only have access to information that could be gathered from an onboard gyroscope and accelerometer, which are both relatively small and low-cost sensors for a robotic platform.
This kind of navigation is analogous to the way eagles and hawks ride thermals in the air, extracting energy from air currents to maneuver to a desired location with the minimum energy expended. Surprisingly, the researchers discovered that their reinforcement learning algorithm could learn navigation strategies that are even more effective than those thought to be used by real fish in the ocean.
“We were initially just hoping the AI could compete with navigation strategies already found in real swimming animals, so we were surprised to see it learn even more effective methods by exploiting repeated trials on the computer,” says Dabiri.
Original Article: Engineers Teach AI to Navigate Ocean with Minimal Energy
More from: California Institute of Technology | ETH Zürich | Harvard University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Ocean-borne drones
- DARPA's autonomous 'Manta Ray' drone can glide through ocean depths undetected
Northrop Grumman Corporation has built its Manta Ray uncrewed underwater vehicle, which will operate long-duration missions and carry payloads into the ocean depths in partnership with DARPA.
- Utah Cat with a Fondness for Cardboard Takes Surprise Trip to California in an Amazon Box
Galena, a 6-year-old house cat from Utah, likes hiding and playing with cardboard. Earlier this month, the combination of the two made for a stressful trip in an Amazon package, a feverish search, a ...
- King Charles III Returns to Public Duties with Trip to a Cancer Charity
King Charles III returned to public duties on Tuesday, visiting a cancer treatment charity and beginning his carefully managed comeback after the monarch’s own cancer diagnosis sidelined him for three ...
- Quantum investment will bring Australian entrepreneurs home: PM
Houthis attack four ships in Indian Ocean, Red Sea: Yemen’s Houthis said they targeted the MSC Orion container ship in a drone attack in the Indian Ocean ... of annual ship-borne commerce, including ...
- WATCH: Drone captures footage of Oceanside Pier fire
NBC 7 obtained drone footage showing the views in Oceanside on Thursday afternoon as a massive plume of black smoke filled the sky, stemming from a fire that erupted near the western end of the city's ...
Go deeper with Google Headlines on:
Ocean-borne drones
[google_news title=”” keyword=”ocean-borne drones” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Reinforcement learning
- America Can’t Stop Watching Creepy Robot Videos
Boston Dynamics has perfected the art of freaking people out. Now other tech companies are trying to do the same.
- Robot dog masters walking, trotting, pronking in a major milestone
Researchers at the Swiss Federal Institute of Technology Lausanne (EPFL) have trained a quadrupedal robot using machine learning, enabling it to adeptly navigate without falling by seamlessly ...
- Shelter Pup Desperate for Visitors To Play With Her, but Is Too Shy To Ask
"She's super smart and our Animal Care staff say she's great at learning new things with positive reinforcement like treats," Thompson said. Dottie love to play but is too shy to ask. She's still ...
- Read the email to Satya Nadella and Bill Gates that shows Microsoft's CTO was 'very worried' about Google's AI progress in 2019
Microsoft's concern about Google's AI progress, contained in emails forming part of the DoJ's antitrust case, may have spurred its OpenAI investment.
- A comprehensive guide to kindergarten readiness for parents
Kindergarten is more than just the first year of formal education; it's the foundation upon which a lifetime of learning is built. By following these tips and embracing this new chapter with ...
Go deeper with Google Headlines on:
Reinforcement learning
[google_news title=”” keyword=”reinforcement learning” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]