Multimodal Data Analysis and Integration

ABSTRACT: This Conte Center proposal seeks to elucidate the role of slow brain network fluctuations (SBNFs) across species and scales, and to establish computational models of neural circuit dynamics that characterize SBNFs. Data collected in Projects 1-3 will span multiple modalities (EEG, fMRI, ECoG/LFP, and single-unit recordings) and species (humans and nonhuman primates). The overarching goal of the Multimodal Data Analysis & Integration Core (Core-B) is to address the challenge of integrating data across these multiple modalities and analyses. To achieve this goal, Core-B will apply and develop multimodal alignment frameworks that establish a common space for analysis across modalities, individuals, and species (to be used in Projects 1-3), as well as integrate these data to facilitate computational modeling of neural dynamics (to be used in Project 4). Aim 1 will leverage the functional alignment framework to construct a common space for different modalities within- and between-subjects. Aim 2 will refine the cross-species alignment using the functional data from the common tasks to provide the spatial transformation to link human data in Projects 1-2 and macaque data in Project 3. In addition to optimizing cross-modal and cross-species alignment, Aim 3 will construct a framework for decomposing brain dynamics into spatiotemporal states and state-transitions derived jointly from EEG, fMRI, and physiological signals. We will also leverage the cross-species transformation between humans and macaques in Aim 2 to delineate the matched states across species and characterize the species-specific temporal configurations. This framework will provide a state-space in which brain dynamics and their causal properties can be interrogated across individuals and species. The alignment approach and aligned data generated by this Core will be applied to the curated, quality-checked outputs received from Core C after appropriate preprocessing (determined by domain experts from the individual Projects) and will be distributed to Projects 1-4.