A Method for Investigating Age-related Differences in the Functional Connectivity of Cognitive Control Networks Associated with Dimensional Change Card Sort Performance

Summary

This video presents a method of examining age-related changes in functional connectivity of cognitive control networks engaged by targeted tasks/processes. The technique is based on multi-variate analysis of fMRI data.

Abstract

The ability to adjust behavior to sudden changes in the environment develops gradually in childhood and adolescence. For example, in the Dimensional Change Card Sort task, participants switch from sorting cards one way, such as shape, to sorting them a different way, such as color. Adjusting behavior in this way exacts a small performance cost, or switch cost, such that responses are typically slower and more error-prone on switch trials in which the sorting rule changes as compared to repeat trials in which the sorting rule remains the same. The ability to flexibly adjust behavior is often said to develop gradually, in part because behavioral costs such as switch costs typically decrease with increasing age. Why aspects of higher-order cognition, such as behavioral flexibility, develop so gradually remains an open question. One hypothesis is that these changes occur in association with functional changes in broad-scale cognitive control networks. On this view, complex mental operations, such as switching, involve rapid interactions between several distributed brain regions, including those that update and maintain task rules, re-orient attention, and select behaviors. With development, functional connections between these regions strengthen, leading to faster and more efficient switching operations. The current video describes a method of testing this hypothesis through the collection and multivariate analysis of fMRI data from participants of different ages.

Introduction

The ability to regulate behavior develops gradually in childhood and adolescence (for review, see Diamond¹). In the Dimensional Change Card Sort task, for example, participants switch from sorting cards one way, such as shape, to sorting them a different way, such as color² (see Figure 2). Switching exacts a small performance cost, or switch cost, such that responses are typically slower and more error-prone on switch trials in which the sorting rule changes as compared to repeat trials in which the sorting rule remains the same³. The magnitude of these costs typically gets smaller as children grow older⁴, illustrating the fact that the capacity for behavioral regulation undergoes continued development early in life.

Because complex mental operations, such as switching, involve rapid interactions between multiple brain regions⁵, there is growing interest in relating the development of higher-order cognition to changes in the functional organization of broad-scale cortical networks⁶.

One approach to investigating developmental change in broad-scale networks is through the use of seed-based functional connectivity analysis^6,7. The first step in this technique is to consult with available research literature and define a priori regions of interest, or ROIs, that seem to be relevant to the behavior in question. These ROIs, or nodes, define the basic skeleton of the network. Next, low-frequency fluctuations in activity (or T2*-weighted signal intensity) in these ROIs are measured for 5 to 10 min while participants are at rest in an MRI scanner. Functional connectivity between any two nodes of the network is then quantified as the correlation of their respective time courses. Nodes that are strongly connected functionally should have similar, and thus highly correlated, signal time courses. On the other hand, nodes that are weakly connected functionally should have dissimilar and thus weakly correlated, signal time courses. To complete a model of the network, edges (or links) are drawn between nodes whose time courses correlate above a chosen threshold. Tests for age-related differences in functional connectivity within a network can be conducted on any single node-to-node connection, or on the topology of the entire set of nodes and edges. These differences in functional connectivity can then be related to measures of cognitive performance collected offline.

In this paper, a different approach is described that is based on group independent component analysis of task-based fMRI data⁸. Independent component analysis (or ICA) is a statistical procedure for blindly revealing hidden sources underlying a set of observations such that the revealed sources are maximally independent. Applied to the analysis of fMRI data, the procedure assumes that each volume is a mixture of a finite number of spatially-independent sources. Using one of a variety of different algorithms, such as the infomax algorithm, ICA then estimates an unmixing matrix, which when applied to the original data yields a set of maximally independent sources, or components. Each component can be thought of as a network, insofar as it comprises of a set of voxels that share a common time course. Group ICA is a particular type of ICA in which a common set of group components is first estimated from an entire data set, and then participant-specific sets of the group components are computed in a back-reconstruction step. Once an entire data set is decomposed into a set of components, the next step is to discard artifactual components that represent noise sources, and identify theoretically meaningful components that correspond with networks of interest. This can be achieved either by modeling component time courses in the context of a GLM to identify networks that activate in a predicted manner, spatially correlating components with a template of a network of interest, or both. The resulting set of components can then be submitted to a group comparison to test for possible age-related differences in functional connectivity within theoretically interesting networks^7,9,10.

Studying age-related changes in functional connectivity through the application of group ICA to task-based fMRI data has several advantages over the application of seed-based techniques to resting-state fMRI data. First, unlike seed-based techniques that focus on a small set of a priori defined ROIs, the current group ICA approach utilizes all voxels comprising a volumetric time series. This diminishes opportunities for bias that necessarily arise when a small group of seeds are selected a priori as regions of interest. Second, applying functional connectivity analysis (ICA-based or otherwise) to task- rather than resting-state fMRI data has the advantage of allowing network organization and network function to be more directly associated. If, for example, examining the cognitive or behavioral implications of functional connectivity (such as variation in DCCS performance) is a priority, it is important to show that the network of interest is associated with task performance. With resting-state protocols, this is very difficult because the researcher has no record of any cognitive, behavioral, or affective states experienced by the participant during data acquisition. It is therefore impossible to provide direct evidence that any network of interest is relevant for task performance. By contrast, when functional connectivity analysis, such as ICA, is applied to task-data, it is possible to confirm that the network of interest is at least associated with the performance of a task. Finally, ICA is less subject to the adverse influence of noise. Noise sources, such as those associated with subject motion and the cardiac rhythm, have unique spatio-temporal profiles. Therefore, in the context of a group ICA, these sources are isolated and assigned to separate components, leaving remaining components relatively free of these unwelcome sources of variance. Because seed-based analyses use raw time courses in the estimation of functional connectivity, and time courses are, by definition, mixtures of neurophysiological signal and artifactual noise, group differences in functional connectivity estimates can reflect true group differences in underlying neurophysiology, group differences in the structure of noise, or both¹¹.

Protocol

1. Obtain Approval for Working with Human Subjects

2. fMRI Data Acquisition

1. Acquire fMRI data following procedures suitable for young children (see Raschle, et al.¹²). Make every effort to limit possible age-related differences in task performance and motion, as these differences introduce unwanted confounds that limit one's capacity to draw inferences about developmentally-relevant differences in brain activation and functional connectivity.
   Note: In the current protocol, a repeated-trials version of the DCCS was administered in the form of a block design¹³. Each run includes two 8-trial switch blocks and two 8-trial repeat blocks, where switch blocks consist of 4 switch trials and 4 repeat trials, and repeat blocks consist of 8 repeat trials. The protocol is perfectly suitable for use with event-related fMRI data. However, block designs are nice to work with when first getting acquainted with ICA, as it is easy to see task modulations in the component time courses.
2. Preprocess fMRI data following standard fMRI preprocessing procedures.
   1. Realign all functional images to the same orientation and position. Typically, the first functional volume is used as a reference image for all other volumes to be aligned to.
   2. Coregister the T1-weighted (anatomical) image with the T2*-weighted (functional) scans, so that activation is superimposed onto the correct anatomical location.
   3. Normalize all of the images to a standardized size, space, and position with the selection of a template brain (e.g. Talairach space). This helps to ensure that homologous regions from different subjects are being compared.
      Note: Images are warped to Talairach space in the current protocol, although other templates may also be used (for example, MNI {Montreal Neurological Institute} space).
   4. Smooth all functional volumes in the data set with a 6  to 10 mm smoothing kernel.
3. Sequester preprocessed volumes into a separate set of directories. Use "Functional scans" as the top directory. Within "Functional scans" include a separate directory for each participant, and within each participant directory, a separate directory for each run. The data is now ready for ICA analysis.

3. Group Independent Component Analysis (ICA)

1. Download and install group ICA software. There are a number of toolboxes available for implementing ICA on different types of neurophysiological data, including fMRI. While any toolbox that performs group ICA would potentially be suitable, the one utilized in the current protocol is called GIFT. GIFT was developed by Vince Calhoun and colleagues at the University of New Mexico. The GIFT toolbox is a set of MATLAB scripts that works together with SPM, a well-known fMRI analysis package. Both can be downloaded for free from the internet (GIFT: mialab.mrn.org/software/gift/index.html#; SPM: www.fil.ion.ucl.ac.uk/spm/). Once downloaded, add the GIFT toolbox and all sub-directories to the MATLAB search path and save path file.
2. Computing a group ICA on fMRI data using GIFT makes substantial demands on RAM memory. The precise demands on memory will vary depending on the number of participants, the amount of data collected from each participant, and the resolution of the data. To avoid memory issues, it is best to run the ICA analysis on a server. If running the analysis on a local computer, the RAM requirements can be estimated through the use of a script "icatb_mem_ica.m" that is part of GIFT.
3. Set-up or parameterize the analysis. Do this by modifying a pre-existing batch script called "Input_data_subjects_1.m" that is stored in GIFT under "icatb_batch_files".
   Note: This can also be done by using GIFT's Graphical User Interface. However, it is much easier, with a bit of practice, to set up the analysis by modifying this pre-existing script.
   1. Specify data modality as fMRI
   2. Specify Type of Analysis as ICA with ICASSO. This will ensure the ICA is run with the ICASSO procedure. ICASSO estimates the reliability of the decomposition by running the ICA several times starting with different random seeds. It then tests the similarity of each result by means of clustering. Use of ICASSO is recommended as mean of checking the quality of the ICA decomposition, but will considerably extend the time it takes GIFT to complete the analysis.
      1. To run the ICA with the ICASSO procedure, select '2' under "Type of analysis" and then parameterize the ICASSO procedure in the succeeding lines of the setup file.
   3. Maximize the performance of the group PCA by choosing '1' under Group PCA performance settings. Consider setting this parameter to '2' should problems of insufficient RAM memory occur.
   4. To enable later sorting of resulting components using predictors from a standard SPM design matrix, specify whether or not there are different matrices for different subjects.
   5. Specify where the preprocessed functional data are stored and whether an SPM.mat file containing the design matrix is stored together with the preprocessed functional data.
      1. The most straightforward way of getting GIFT to read the data is if every participant has the same number of runs, and the data directory is structured as described in Step 2.3 under fMRI data acquisition. If so, then under DataSelectionMethod, chose '1' for Method 1, and complete the parameter "sourceDir_filePattern_flagLocation" by including the filepath where the data are stored, the file format of the data, and a statement indicating that individual sessions are stored as subdirectories within each subject folder.
   6. Indicate the directory where the output of the analysis should be written. Do not write the results to the same directory where the data are stored.
   7. Provide a prefix that will be added to all output files.
   8. Provide a filepath to a mask. All volumes submitted to ICA are masked. GIFT provides a default mask. For this work, an in-house script to generate a mask from the data that will be submitted to ICA. At a minimum, the mask should eliminate skull, extra-cerebral space, and especially the eyeballs. Signal from eyeball voxels will show very large fluctuations during a run and will therefore have a sizable influence on the structure of the final components. Figure 3 illustrates what a good mask should look like.
   9. Specify the type of group PCA to be used. Use 'subject specific.'
   10. Specify the back-reconstruction method. In this stage, individual subject IC's and their associated time courses are computed from the results of the group analysis. GICA is recommended for obtaining the best time courses, although there is considerable discussion in the literature on this point.
   11. Specify data pre-processing type. Use intensity normalization to avoid non-numerical values (i.e. infinites, and NaN's) in the output. In this example, we chose the default of '1'.
   12. Specify the type of PCA (we use standard) and accept default values under PCA Options. GIFT performs a PCA on each run of each participant and retains a number of components equal to the number of sources to be unmixed in the ICA. The PCA serves two important purposes. First, it helps to eliminate sources of noise that are unique to each participant and each run. Second, it makes the computational demands of the analysis more tractable.
   13. Specify how many PCAs to run on the data before the ICA (2 is recommended). As well, specify how many components to retain after each PCA (if running 2, it is recommended that the number of components retained after the first PCA is twice the number retained after the second).
   14. Specify how the data should be scaled. For this work, z-score scaling was used.
   15. Choose a blind source separation algorithm for the ICA. For this work, Infomax was used. GIFT offers a choice of at least 10 different algorithms.
   16. Remaining parameters can be left as is.
4. Once the ICA is completed, select from among available components those that are of potential theoretical interest. Through the GIFT GUI, choose component selection: spatial sorting sorts the spatial components by means of spatial correlation with a pre-existing template; temporal sorting sorts the component time courses by means of linear predictors from the SPM design matrix that you can store with the data (see 3.3.5).
   Note: Both approaches to component selection have utility. However, when working with task data, temporal selection criteria are particularly useful, as they provide a means of verifying that the selected component was activated by the task. In the case of the DCCS, use of temporal sorting can be used to confirm that the selected component was more active during switch blocks than during repeat blocks.
5. Test whether child and adult versions of these selected components differ. Aggregate child and adult components of interest into two separate groups and test by means of a two-sample t-test regions where the components vary. This is relatively easy to do through the GIFT GUI.

Results

Group ICA, even on a relatively small fMRI data set, will return a set of components comparable to those observed in other studies. Figure 4 is a superimposition of 5 such components and their associated time courses unmixed from a sample of 12 children and 13 adults, with approximately 800 volumes per participant. As shown in Figure 4, default mode, fronto-parietal, cingulo-insular, and visual networks can readily be seen from the results of this decomposition. As well, notice how ...

Discussion

Higher-order mental operations, such as the ability to switch sorting rules, develop rapidly throughout childhood and adolescence. Because these mental operations involve interactions between multiple distributed brain regions, there is growing interest in exploring the relationship between the development of higher-order cognition and age-related changes in the organization of broad-scale cortical networks. We present a method based on group independent component analysis applied to task-based fMRI data as a means of ex...

Materials

Name	Company	Catalog Number	Comments
SPM8	The MathWorks, Inc.	R2013a