Can A.I.-Driven Voice Analysis Help Identify Mental Disorders? (Published 2022)

Patients with anxiety feel more tension in their bodies, which can also change the way their voice sounds, she said. “They tend to speak faster. They have more difficulty breathing.”

Founded by Grace Chang and Rima Seiilova-Olson, who bonded over the shared past experience of struggling to access mental health care, Kintsugi develops technology for telehealth and call-center providers that can help them identify patients who might benefit from further support.

One concern with the development of these types of machine learning technologies is the issue of bias — ensuring the programs work equitably for all patients, regardless of age, gender, ethnicity, nationality and other demographic criteria.

Today, these types of vocal features are being leveraged by machine learning researchers to predict depression and anxiety, as well as other mental illnesses like schizophrenia and post-traumatic stress disorder. The use of deep-learning algorithms can uncover additional patterns and characteristics, as captured in short voice recordings, that migh... See more

By using Kintsugi’s voice-analysis program, a nurse might be prompted, for example, to take an extra minute to ask a harried parent with a colicky infant about his own well-being. 

These technological advances come at a time when the need for mental health care is particularly acute: According to a report from the National Alliance on Mental Illness, one in five adults in the United States experienced mental illness in 2020. And the numbers continue to climb.

Although A.I. technology can’t address the scarcity of qualified mental health care providers — there are not nearly enough to meet the country’s needs, said Dr. Bentley — there’s hope that it may lower the barriers to receiving a correct diagnosis, assist clinicians in identifying patients who may be hesitant to seek care and facilitate self-monit... See more

With depressed patients, Dr. Espinola said, “their speech is generally more monotone, flatter and softer. They also have a reduced pitch range and lower volume. They take more pauses. They stop more often.”

**Note:** These concerns are the same as in all applications of AI: bias, privacy, interpretability