Google is training AI to ‘hear’ when you’re sick. Here’s how it works.


0

Man in a blue shirt sneezing while holding a tissue

Google’s AI arm is reportedly tapping into “bioacoustics” — a field that blends a combination of biology and sounds that, in part, help researchers gain insights on how pathogen presence affects human sound. As it turns out, our sounds convey tell-tale information about our well-being.

According to a Bloomberg report, the search-engine giant built an AI model that uses sound signals to “predict early signs of disease.” In places where there is difficulty accessing quality healthcare, this technology can step in as an alternative where users need nothing but their smartphone’s microphone.

How does Google’s bioacoustics AI work?

Google’s bioacoustics-based AI model is called HeAR (Heath Acoustic Representations). It was trained on 300 million, two-second audio samples that include coughs, sniffles, sneezes, and breathing patterns. These audio clips were pulled from non-copyrighted, publicly available content from platforms like YouTube.

One example of such content is a video that recorded sounds of patients in a Zambia-based hospital where sick individuals came in for tuberculosis screenings. In fact, HeAR has been trained on 100 million cough sounds that help detect tuberculosis.

According to Bloomberg, bioacoustics can offer “near-imperceptible clues” that can reveal subtle signs of illness that can help health professionals diagnose patients. Plus, the AI model can detect minute differences in patients’ cough patterns, allowing it to spot early signs of a sickness’ amelioration or deterioration.

Google is partnering with Salcit Technologies, an AI healthcare startup based in India. Salcit has its own AI model called Swaasa (which means “breath” in Sanskrit) — and the Indian collaborator is using Swaasa to help HeAR improve its accuracy for tuberculosis and lung health screening.

Swaasa offers a mobile app that allows users to submit a 10-second cough sample. According to Salcit’s co-founder, Manmohan Jain, the app can identify whether an individual has a disease with an accuracy rate of 94 percent

The auditory-based test costs $2.40. This is much cheaper than a spirometry test, which costs about $35 in an India-based clinic.

HeAR doesn’t come without challenges, though. For example, Google and Salcit are still trying to navigate problems with users submitting audio samples with too much background noise.

Google’s bioacoustics-based AI model is nowhere near the “ready-for-market” stage, but you’ve got to admit, the concept of using AI in the medical field, combined with sound, is arguably innovative and promising.


Like it? Share with your friends!

0

What's Your Reaction?

hate hate
0
hate
confused confused
0
confused
fail fail
0
fail
fun fun
0
fun
geeky geeky
0
geeky
love love
0
love
lol lol
0
lol
omg omg
0
omg
win win
0
win

0 Comments

Your email address will not be published. Required fields are marked *

Choose A Format
Personality quiz
Series of questions that intends to reveal something about the personality
Trivia quiz
Series of questions with right and wrong answers that intends to check knowledge
Poll
Voting to make decisions or determine opinions
Story
Formatted Text with Embeds and Visuals
List
The Classic Internet Listicles
Countdown
The Classic Internet Countdowns
Open List
Submit your own item and vote up for the best submission
Ranked List
Upvote or downvote to decide the best list item
Meme
Upload your own images to make custom memes
Video
Youtube and Vimeo Embeds
Audio
Soundcloud or Mixcloud Embeds
Image
Photo or GIF
Gif
GIF format