Skip to main navigation Skip to search Skip to main content

WWBP-SQT-lite: Difference Embeddings and Multi-level Models for Moments of Change Identification in Mental Health Forums

  • Adithya V. Ganesan
  • , Vasudha Varadarajan
  • , Juhi Mittal
  • , Shashanka Subrahamanya
  • , Matthew Matero
  • , Nikita Soni
  • , Sharath Chandra Guntuku
  • , Johannes C. Eichstaedt
  • , H. Andrew Schwartz
  • Stony Brook University
  • University of Pennsylvania
  • Stanford University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

Psychological states unfold dynamically; to understand and measure mental health at scale we need to detect and measure these changes from sequences of online posts. We evaluate two approaches to capturing psychological changes in text: the first relies on computing the difference between the embedding of a message with the one that precedes it, the second relies on a "human-aware" multi-level recurrent transformer (HaRT). The mood changes of timeline posts of users were annotated into three classes, ‘ordinary,’ ‘switching’ (positive to negative or vice versa) and ‘escalations’ (increasing in intensity). For classifying these mood changes, the difference-between-embeddings technique – applied to RoBERTa embeddings – showed the highest overall F1 score (0.61) across the three different classes on the test set. The technique particularly outperformed the HaRT transformer (and other baselines) in the detection of switches (F1 = .33) and escalations (F1 = .61). Consistent with the literature, the language use patterns associated with mental-health related constructs in prior work (including depression, stress, anger and anxiety) predicted both mood switches and escalations.

Original languageEnglish
Title of host publicationCLPsych 2022 - 8th Workshop on Computational Linguistics and Clinical Psychology, Proceedings
EditorsAyah Zirikly, Dana Atzil-Slonim, Maria Liakata, Steven Bedrick, Bart Desmet, Molly Ireland, Andrew Lee, Sean MacAvaney, Matthew Purver, Rebecca Resnik, Andrew Yates
PublisherAssociation for Computational Linguistics (ACL)
Pages251-258
Number of pages8
ISBN (Electronic)9781955917872
StatePublished - 2022
Event8th Workshop on Computational Linguistics and Clinical Psychology, CLPsych 2022 - Seattle, United States
Duration: Jul 15 2022 → …

Publication series

NameCLPsych 2022 - 8th Workshop on Computational Linguistics and Clinical Psychology, Proceedings

Conference

Conference8th Workshop on Computational Linguistics and Clinical Psychology, CLPsych 2022
Country/TerritoryUnited States
CitySeattle
Period07/15/22 → …

Fingerprint

Dive into the research topics of 'WWBP-SQT-lite: Difference Embeddings and Multi-level Models for Moments of Change Identification in Mental Health Forums'. Together they form a unique fingerprint.

Cite this