skip to main content
Primo Search
Search in: Busca Geral
Tipo de recurso Mostra resultados com: Mostra resultados com: Índice

The Power of Speech in the Wild: Discriminative Power of Daily Voice Diaries in Understanding Auditory Verbal Hallucinations Using Deep Learning

Wang, Weichen ; Xu, Weizhe ; Chander, Ayesha ; Nepal, Subigya ; Buck, Benjamin ; Pakhomov, Serguei ; Cohen, Trevor ; Ben-Zeev, Dror ; Campbell, Andrew

Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies, 2023-09, Vol.7 (3), p.1-29, Article 133 [Periódico revisado por pares]

New York, NY, USA: ACM

Texto completo disponível

Citações Citado por
  • Título:
    The Power of Speech in the Wild: Discriminative Power of Daily Voice Diaries in Understanding Auditory Verbal Hallucinations Using Deep Learning
  • Autor: Wang, Weichen ; Xu, Weizhe ; Chander, Ayesha ; Nepal, Subigya ; Buck, Benjamin ; Pakhomov, Serguei ; Cohen, Trevor ; Ben-Zeev, Dror ; Campbell, Andrew
  • Assuntos: Applied computing ; Human-centered computing ; Life and medical sciences ; Ubiquitous and mobile computing ; Ubiquitous and mobile computing systems and tools
  • É parte de: Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies, 2023-09, Vol.7 (3), p.1-29, Article 133
  • Descrição: Mobile phone sensing is increasingly being used in clinical research studies to assess a variety of mental health conditions (e.g., depression, psychosis). However, in-the-wild speech analysis -- beyond conversation detecting -- is a missing component of these mobile sensing platforms and studies. We augment an existing mobile sensing platform with a daily voice diary to assess and predict the severity of auditory verbal hallucinations (i.e., hearing sounds or voices in the absence of any speaker), a condition that affects people with and without psychiatric or neurological diagnoses. We collect 4809 audio diaries from N=384 subjects over a one-month-long study period. We investigate the performance of various deep-learning architectures using different combinations of sensor behavioral streams (e.g., voice, sleep, mobility, phone usage, etc.) and show the discriminative power of solely using audio recordings of speech as well as automatically generated transcripts of the recordings; specifically, our deep learning model achieves a weighted f-1 score of 0.78 solely from daily voice diaries. Our results surprisingly indicate that a simple periodic voice diary combined with deep learning is sufficient enough of a signal to assess complex psychiatric symptoms (e.g., auditory verbal hallucinations) collected from people in the wild as they go about their daily lives.
  • Editor: New York, NY, USA: ACM
  • Idioma: Inglês

Buscando em bases de dados remotas. Favor aguardar.