Skip to main navigation Skip to search Skip to main content

DiaLogic: Interaction-Focused Speaker Diarization

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

diaLogic is a user-friendly Python program which performs social interaction classification through speaker diarization. The main libraries used include Python's PyQt5 and Keras APIs, Matplotlib, and the computational R language. Speaker diarization is achieved with high consistency due to a simple four-layer convolutional neural network (CNN) trained on the Librispeech ASR corpus. Speaker interactions are modeled through a custom R language script. The data generated by the program allows the characterization of speaker traits within social experiments. Group leaders, followers, and level of speaker contribution can be characterized. These traits can be used to determine overall group performance, as well as the performance of individuals. The interface is designed to be simplistic and intuitive, which allows easy operation by nonengineers. This design consideration allows program operation with minimal training for users in the social sciences disciplines. The program is designed with a modular backend, which is invisible to the user of the program. The backend allows easy expansion through modular algorithms. For future iterations of the program, speaker interaction data collection will be fully automated through machine learning and/or logical constructs. The integration of voice-based emotion recognition will be the next phase for this program. Overall, the diaLogic program is the central workspace for social interaction characterization.

Original languageEnglish
Title of host publication15th Annual IEEE International Systems Conference, SysCon 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665444392
DOIs
StatePublished - Apr 15 2021
Event15th Annual IEEE International Systems Conference, SysCon 2021 - Virtual, Online
Duration: Apr 15 2021May 15 2021

Publication series

Name15th Annual IEEE International Systems Conference, SysCon 2021 - Proceedings

Conference

Conference15th Annual IEEE International Systems Conference, SysCon 2021
CityVirtual, Online
Period04/15/2105/15/21

Fingerprint

Dive into the research topics of 'DiaLogic: Interaction-Focused Speaker Diarization'. Together they form a unique fingerprint.

Cite this