Keywords: Analysis/Processing, AI/ML Software, brain decoding, fMRI, foundation models
Motivation: Understanding brain activity is a key neuroscience challenge. While fMRI offers insights, its high dimensionalit may limit its use in modeling brain function.
Goal(s): We propose a foundation model for ROI-based fMRI data, trained on resting-state data from HCP, to develop generalizable brain latent representations.
Approach: Using a masked autoencoder with self-supervised learning, we train a transformer model on fMRI time series from the HCP dataset. The model encodes signals into a latent space and reconstructs masked segments, capturing key spatiotemporal features.
Results: The model produced strong, transferable representations, achieving high performance in downstream tasks like classification across seven cognitive tasks.
Impact: We foundation model for fMRI, trained on resting-state data from the HCP to develop generalizable brain representations. Using self-supervised learning, this task-agnostic model can be applied to various neuroscience tasks, including physiological prediction and brain decoding.
How to access this content:
For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.
After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.
After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.
Keywords