“Hear me out”: Smart speaker based conversational agent to monitor symptoms in mental health

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

58 Downloads (Pure)

Abstract

Difference in features of voice such as tone, volume, intonation, and rate of speech have been suggested as sensitive and valid measures of mental illness. Researchers have used analysis of voice recordings during phone calls, response to the IVR systems and smartphone based conversational agents as a marker in continuous monitoring of symptoms and effect of treatment in patients with mental illness. While these methods of recording the patient’s voice have been considered efficient, they come with a number of issues in terms of adoption, privacy, security, data storage etc. To address these issues we propose a smart speaker based conversational agent – “Hear me out”. In this paper, we describe the proposed system, rationale behind using smart speakers, and the challenges we are facing in the design of the system.
Original languageEnglish
Title of host publicationUbiComp/ISWC 2019 : Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers
Number of pages5
PublisherAssociation for Computing Machinery
Publication date2019
Pages929-933
ISBN (Electronic)978-1-4503-6869-8
DOIs
Publication statusPublished - 2019
Event2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2019 - London, United Kingdom
Duration: 9 Sep 201913 Sep 2019

Conference

Conference2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2019
CountryUnited Kingdom
CityLondon
Period09/09/201913/09/2019
Sponsoremteq, Facebook Inc, Alphabet Inc., Huawei, Nokia Bell Labs

Keywords

  • Smart Speakers
  • Mental Health
  • Voice User Interface
  • Voice Feature Analysis
  • Conversational Agent
  • Patient Self Reports

Fingerprint Dive into the research topics of '“Hear me out”: Smart speaker based conversational agent to monitor symptoms in mental health'. Together they form a unique fingerprint.

Cite this