TY - GEN
T1 - DiaLogic
T2 - 15th Annual IEEE International Systems Conference, SysCon 2021
AU - Duke, R.
AU - Doboli, A.
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/4/15
Y1 - 2021/4/15
N2 - diaLogic is a user-friendly Python program which performs social interaction classification through speaker diarization. The main libraries used include Python's PyQt5 and Keras APIs, Matplotlib, and the computational R language. Speaker diarization is achieved with high consistency due to a simple four-layer convolutional neural network (CNN) trained on the Librispeech ASR corpus. Speaker interactions are modeled through a custom R language script. The data generated by the program allows the characterization of speaker traits within social experiments. Group leaders, followers, and level of speaker contribution can be characterized. These traits can be used to determine overall group performance, as well as the performance of individuals. The interface is designed to be simplistic and intuitive, which allows easy operation by nonengineers. This design consideration allows program operation with minimal training for users in the social sciences disciplines. The program is designed with a modular backend, which is invisible to the user of the program. The backend allows easy expansion through modular algorithms. For future iterations of the program, speaker interaction data collection will be fully automated through machine learning and/or logical constructs. The integration of voice-based emotion recognition will be the next phase for this program. Overall, the diaLogic program is the central workspace for social interaction characterization.
AB - diaLogic is a user-friendly Python program which performs social interaction classification through speaker diarization. The main libraries used include Python's PyQt5 and Keras APIs, Matplotlib, and the computational R language. Speaker diarization is achieved with high consistency due to a simple four-layer convolutional neural network (CNN) trained on the Librispeech ASR corpus. Speaker interactions are modeled through a custom R language script. The data generated by the program allows the characterization of speaker traits within social experiments. Group leaders, followers, and level of speaker contribution can be characterized. These traits can be used to determine overall group performance, as well as the performance of individuals. The interface is designed to be simplistic and intuitive, which allows easy operation by nonengineers. This design consideration allows program operation with minimal training for users in the social sciences disciplines. The program is designed with a modular backend, which is invisible to the user of the program. The backend allows easy expansion through modular algorithms. For future iterations of the program, speaker interaction data collection will be fully automated through machine learning and/or logical constructs. The integration of voice-based emotion recognition will be the next phase for this program. Overall, the diaLogic program is the central workspace for social interaction characterization.
UR - https://www.scopus.com/pages/publications/85111443512
U2 - 10.1109/SysCon48628.2021.9447101
DO - 10.1109/SysCon48628.2021.9447101
M3 - Conference contribution
AN - SCOPUS:85111443512
T3 - 15th Annual IEEE International Systems Conference, SysCon 2021 - Proceedings
BT - 15th Annual IEEE International Systems Conference, SysCon 2021 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 April 2021 through 15 May 2021
ER -