Home » blocking rogue microphones » An algorithm that blocks a rogue microphone from correctly hearing your words, in English so far, 80 percent of the time
For Your Consideration

An algorithm that blocks a rogue microphone from correctly hearing your words, in English so far, 80 percent of the time

Photo by Google

Photo by Google

Columbia Engineering computer scientists have built an algorithm that blocks a rogue microphone from correctly hearing your words—in English so far—80% of the time

Ever noticed online ads following you that are eerily close to something you’ve recently talked about with your friends and family? Microphones are embedded into nearly everything today, from our phones, watches, and televisions to voice assistants, and they are always listening to you. Computers are constantly using neural networks and AI to process your speech, in order to gain information about you. If you wanted to prevent this from happening, how could you go about it?

Back in the day, as portrayed in the hit TV show “The Americans,” you would play music with the volume way up or turn on the water in the bathroom. But what if you didn’t want to constantly scream over the music to communicate? Columbia Engineering researchers have developed a new system that generates whisper-quiet sounds that you can play in any room, in any situation, to block smart devices from spying on you. And it’s easy to implement on hardware like computers and smartphones, giving people agency over protecting the privacy of their voice.

“A key technical challenge to achieving this was to make it all work fast enough,” said Carl Vondrick, assistant professor of computer science. “Our algorithm, which manages to block a rogue microphone from correctly hearing your words 80% of the time, is the fastest and the most accurate on our testbed. It works even when we don’t know anything about the rogue microphone, such as the location of it, or even the computer software running on it. It basically camouflages a person’s voice over-the-air, hiding it from these listening systems, and without inconveniencing the conversation between people in the room.”

Staying Ahead of Conversations

While the team’s results in corrupting automatic speech recognition systems have been theoretically known to be possible in AI for a while, achieving them fast enough to use in practical applications has remained a major bottleneck. The problem has been that a sound that breaks a person’s speech now—at this specific moment—isn’t a sound that will break speech a second later. As people talk, their voices constantly change as they say different words and speak very fast. These alterations make it almost impossible for a machine to keep up with the fast pace of a person’s speech.

“Our algorithm is able to keep up by predicting the characteristics of what a person will say next, giving it enough time to generate the right whisper to make,” said Mia Chiquier, lead author of the study and a PhD student in Vondrick’s lab. “So far our method works for the majority of the English language vocabulary, and we plan to apply the algorithm on more languages, as well as eventually make the whisper sound completely imperceptible.”

Launching “Predictive Attacks”

The researchers needed to design an algorithm that could break neural networks in real time, that could be generated continuously as speech is spoken, and applicable to the majority of vocabulary in a language. While earlier work had successfully tackled at least one of these three requirements, none have achieved all three. Chiquier’s new algorithm uses what she calls “predictive attacks”—a signal that can disrupt any word that automatic speech recognition models are trained to transcribe. In addition, when attack sounds are played over-the-air, they need to be loud enough to disrupt any rogue “listening-in” microphone that could be far away. The attack sound needs to carry the same distance as the voice.

The researchers’ approach achieves real-time performance by forecasting an attack on the future of the signal, or word, conditioned on two seconds of input speech. The team optimized the attack so it has a volume similar to normal background noise, allowing people in a room to converse naturally and without being successfully monitored by an automatic speech recognition system. The group successfully demonstrated that their method works inside real-world rooms with natural ambient noise and complex scene geometries.

Ethical AI 

“For many of us in the research community, ethical concerns of AI technology are an essential issue, but it seems to belong to a separate thought process. It is like we are so happy that we finally made a driving car but forgot to design a steering wheel and a brake,” says Jianbo Shi, professor of computer and information science at the University of Pennsylvania and a leading researcher in machine learning. “As a community, we need to `consciously’ think about the human and societal impact of the AI technology we develop from the earliest research design phase. Mia Chiquier and Carl Vondrick’s study poses the question: ‘how to use AI to protect us against unintended AI usages?’ Their work makes many of us think in the following direction: ask not what ethical AI can do for us, but what we can do for ethical AI? Once we believe in this direction, ethical AI research is just as fun and creative.”


Original Article: Stopping “them” from spying on you

More from: Fu Foundation School of Engineering and Applied Science 


The Latest on: Blocking rogue microphones

  • Rogue Company Juke guide – Abilities, weapons, gadgets, Perks, tips
    on May 27, 2022 at 1:09 pm

    In the Daybreak update, Rogue Company introduces its most mobile Rogue to date: Juke. A true alternative to Lancer and a frankly preposterous character given the game’s semi-realistic approach, Juke ...

  • Rogue Memorial Challenge back for more in 2022
    on May 27, 2022 at 5:18 am

    A year ago, the ever-changing COVID-19 restrictions in Oregon made planning the return edition of the Rogue Memorial Challenge, quite literally, a challenge. This year? Maybe not 100% stress-free, but ...

  • Some universities and schools in the U.S. are reimposing indoor mask mandates.
    on May 25, 2022 at 2:44 pm

    Russia’s invasion of Ukraine eclipsed talk of rogue socializing in government offices ... is that arguments about the supposed dangers of vaccines had proved ineffective in blocking SB277, because no ...

  • Best Ion Bluetooth speaker
    on May 20, 2022 at 8:25 pm

    The Ion Audio Block Rocker Plus Portable Bluetooth Speaker ... also tend to have helpful features such as built-in radios, or microphones for events such as public speaking or karaoke.

  • Best antivirus software for protecting your Mac from viruses and malware
    on May 15, 2022 at 10:48 pm

    It'll catch malware that's still spreading or in circulation; block ransomware; protect older systems with ... intrusion attempts from outside as well as outgoing attempts from rogue software. You can ...

  • The 8 best noise-canceling earbuds
    on May 6, 2022 at 5:03 pm

    To get around that, Active Noise Cancellation uses a series of microphones and speakers to block any external sounds electronically. So naturally, a system that uses ANC needs a battery to function.

  • A small town, farm kid approach: Rogue Botanical innovates in crowded cannabis market
    on May 3, 2022 at 8:44 pm

    They are small town boys with a passion for agriculture and cannabis. The pair are co-founders of Rogue Botanical, a licensed producer of cannabis-based products based out of Niverville. Fayed grew up ...

  • How Democracies Spy on Their Citizens
    on May 1, 2022 at 5:01 pm

    The engineers quickly identified ways to block the offending code ... allowing the attacker to extract data or activate a camera or a microphone. The entire process was “zero click,” requiring ...

  • Bang & Olufsen Beoplay Portal headset review
    on April 28, 2022 at 7:39 am

    The flip side to this noise-blocking functionality are the features Own Voice and Transparency mode. Own Voice feeds your own voice back through the device while your microphone is in use ...

  • Erik Vlietinck
    on August 8, 2020 at 5:29 am

    Telestream’s Quality Control (QC) and transcoding app Switch has been upgraded to version 5. It is compatible with M1... Alex Raccuglia, the developer of apps like ...

via Bing News

The Latest on: Blocking rogue microphones

via Google News