TY - GEN
T1 - Brain Network State Transformer
T2 - 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2025
AU - Nie, Jiawei
AU - Han, Keqi
AU - Zhang, Tianyi
AU - You, Chenyu
AU - Van Rooij, Sanne
AU - Stevens, Jennifer
AU - Dunlop, Boadie
AU - Gillespie, Charles
AU - Yang, Carl
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Recent advancements in functional Magnetic Resonance Imaging (fMRI) have highlighted the importance of capturing the dynamic nature of brain activities, prompting a shift from static Functional Connectivity (FC) to dynamic FC (DFC). However, existing DFC approaches often struggle to balance temporal granularity with interpretability, leading to challenges in disentangling meaningful connectivity patterns. In this work, we introduce the Brain Network State Transformer (BNST), a novel framework that leverages State FC to enhance brain network analysis. Our approach integrates three key steps: (1) Deep Clustering to identify recurring brain states from high-dimensional DFC matrices, (2) State-Based Rechunking to reorganize BOLD time series according to these states, and (3) a Transformer-Based Feature Extraction mechanism that models intra-state and inter-state relationships for downstream prediction tasks. We demonstrate the effectiveness of BNST on two publicly available fMRI datasets - ABCD and HCP - across both classification and regression tasks. By capturing structured temporal dynamics, BNST not only boosts prediction performance but also improves interpretability by identifying distinct brain states and their functional significance, providing a structured representation that aligns with meaningful cognitive and neural processes.
AB - Recent advancements in functional Magnetic Resonance Imaging (fMRI) have highlighted the importance of capturing the dynamic nature of brain activities, prompting a shift from static Functional Connectivity (FC) to dynamic FC (DFC). However, existing DFC approaches often struggle to balance temporal granularity with interpretability, leading to challenges in disentangling meaningful connectivity patterns. In this work, we introduce the Brain Network State Transformer (BNST), a novel framework that leverages State FC to enhance brain network analysis. Our approach integrates three key steps: (1) Deep Clustering to identify recurring brain states from high-dimensional DFC matrices, (2) State-Based Rechunking to reorganize BOLD time series according to these states, and (3) a Transformer-Based Feature Extraction mechanism that models intra-state and inter-state relationships for downstream prediction tasks. We demonstrate the effectiveness of BNST on two publicly available fMRI datasets - ABCD and HCP - across both classification and regression tasks. By capturing structured temporal dynamics, BNST not only boosts prediction performance but also improves interpretability by identifying distinct brain states and their functional significance, providing a structured representation that aligns with meaningful cognitive and neural processes.
UR - https://www.scopus.com/pages/publications/105023727324
U2 - 10.1109/EMBC58623.2025.11254044
DO - 10.1109/EMBC58623.2025.11254044
M3 - Conference contribution
C2 - 41337146
AN - SCOPUS:105023727324
T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
BT - 2025 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2025 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 14 July 2025 through 18 July 2025
ER -