using homer3 software to perform the pre-processing of the fnirs hyperscanning data

Revolutionizing fNIRS Studies&amp;#58; A Novel Approach to Neural Coupling

In recent years, there has been a shift in the types of studies conducted to understand the neural bases of social behavior1,2. Traditionally, studies in social neuroscience have focused on neural activation in one isolated brain during a socially relevant task. However, advances in neuroimaging technology now allow for the examination of neural activation in the brains of one or more individuals during social interaction as it occurs in &#34;real-life&#34; settings3. In &#34;real-life&#34; settings, individuals are able to move freely, and patterns of brain activation are likely to change as information is exchanged and social partners receive feedback from one another4.
Hyperscanning is a method that assesses this bidirectional information exchange by measuring the brain activity from two or more individuals simultaneously5. An emerging body of research has utilized functional near-infrared spectroscopy (fNIRS), a non-invasive neuroimaging technique that, in comparison to other neuroimaging techniques, is less susceptible to motion artifacts6. Hyperscanning via fNIRS allows for the assessment of inter-brain synchronization (IBS) in real-life settings while the interactive partners move freely and naturally. This is particularly relevant for work with infants and young children, who tend to be quite active. IBS has been reported to reflect mutual understanding between interactive partners, which serves as the foundation for effective social interaction and communication and mediates shared intentionality1,7,8.
Several methods are used to evaluate the IBS of two brains. Such methods include time series correlations, such as cross-correlation and the Pearson correlation coefficient9,10 (see a review by Scholkmann et al.10). Other methods involve evaluating the strength of coupling in the frequency domain. Such methods include phase-locking value (PLV) and phase coherence (see a review by Czeszumski et al.11). One of the most common methods in fNIRS studies uses wavelet transform coherence (WTC)-a measure of the cross-correlation of two time series as a function of frequency and time10.
WTC uses correlational analyses to calculate the coherence and phase lag between two time series in the time-frequency domain. FNIRS hyperscanning studies have used WTC to estimate IBS in many domains of functioning, including action monitoring12, cooperative and competitive behaviour5,13,14,15, imitation16, mother-infant problem solving17, and teaching-learning behavior18,19,20,21. Typically, in hyperscanning studies, cross-brain coherence, as measured by WTC, during an experimental task is compared to cross-brain coherence during a control task. These findings are usually presented with a WTC &#34;hot plot&#34;, which shows the coherence across the two brains at each time point and frequency (see Figure 1).
As suggested by Czesumaski et al.11, WTC has become the standard analytical approach for analyzing fNIRS hyperscanning. WTC analysis is a flexible, &#34;tool-agnostic&#34; method for data visualization and interpretation22. The coherence coefficient heatmap, which provides a narrative form of analysis allowing for the easy identification of periods of synchronous or asynchronous behavior as well as the intensity of brain activity during the completion of a task, is the main advantage of WTC and makes it a strong tool for applied research22. WTC has an advantage over correlation techniques. Correlations are sensitive to the hemodynamic response function&#39;s (HRF) shape, which is thought to differ between individuals (particularly in terms of age) and among different brain areas. In contrast, WTC is unaffected by interregional changes in the (HRF)23. Researchers have used the wavelet approach to study fMRI time series. Zhang et al.24 compared the commonly used functional connectivity metrics, including the Pearson correlation, partial correlation, mutual information, and wavelet coherence transformation (WTC). They carried out classification experiments using large-scale functional connectivity patterns derived from resting-state fMRI data and natural-stimulus fMRI data of video viewing. Their findings indicated that WTC performed best in classification (specificity, sensitivity, and accuracy), implying that WTC is a preferable functional connectivity metric for studying functional brain networks, at least in classification applications24.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/65347/65347fig01.jpg" /> 
Figure 1: Wavelet transform coherence (WTC). WTC shows the coherence and phase angle between two time series as a function of both time (x-axis) and frequency (y-axis). The coherence increase is depicted by the red color in the graph, and the small arrows in the graph show the phase angle of the two time series. The rightward-pointing arrow represents in-phase synchronization; the downward-pointing and upward-pointing arrows represent lagged synchronization; and the leftward-pointing arrow represents anti-phase synchronization30. This figure was adapted from Pan et al.19. <a href="https://www.jove.com/files/ftp_upload/65347/65347fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
Recently, Hamilton25 articulated several limitations to the interpretation of cross-brain coherence data in fNIRS hyperscanning studies. One of Hamilton&#39;s primary concerns was that coherence measures (e.g., WTC) only report effects as symmetrical (i.e., two brains are correlated, showing the same pattern of change). However, many social interactions are asymmetric (e.g., information flow between a speaker and a listener) in that two participants may play different roles, and it is not clear that WTC can capture this information. Here, this concern is addressed by a new framework that allows for a straightforward interpretation of the cross-wavelet power by using the cross-wavelet phase&#160;to detect directionality. This framework will also allow examination of how the dynamics of interactions develop and change throughout a task.
While WTC and correlation methods assess functional connectivity, other methods assess effective connectivity, attempting to extract the causal influences of one neural element over another. Transfer entropy is a measure from the field of information theory that describes the transfer between jointly dependent processes26. Another related method is Granger causality analysis (GCA), which has been described as equivalent to transfer entropy26.
In the existing literature of fNIRS hyperscanning studies, Granger causality analysis (GCA) has been widely used to estimate the coupling directionality between fNIRS time series data obtained during a variety of different tasks, such as cooperation5, teaching19, and imitation16. GCA employs vector autoregressive models to assess the directionality of coupling between time series in brain data. Granger causality is based on prediction and precedence: &#34;a variable X is said to &#39;G-cause&#39; variable Y if the past of X contains the information that helps to predict the future of Y over and above information already in the past of Y&#34;27. Accordingly, the G-causality is analyzed in two directions: 1) from subject A to subject B and 2) from subject B to subject A.
While GCA analysis serves as a complementary analysis aimed at determining whether a high coherence value obtained using a WTC function reflects IBS or lagged synchronization (one signal leading the other), it does not allow for the determination of whether anti-phase synchronization has occurred. In traditional neuroimaging studies, in which only one participant is scanned (i.e., the &#34;single-brain&#34; approach), an anti-phase pattern means that the activity in one brain region is increased while the activity in the other brain region is decreased28. In the hyperscanning literature, the presence of anti-phase synchronization may suggest that neural activation is increased in one subject, and at the same time, neural activation is decreased for the other subject. Therefore, there is a need to provide a comprehensive model that can detect the directionality. More specifically, this model will be able to detect anti-phase synchronization (in which the direction of activity in one individual is opposite to that of their partner) in addition to in-phase synchronization and lagged synchronization.
In an attempt to address the concern that WTC shows only symmetrical effects, where both brains show the same pattern of change25, a new approach to identify the type of interaction by examining the phase of synchronization (i.e., in-phase, lagged, or anti-phase) is presented (see Figure 2). To this end, a toolbox using the WTC method to classify the different types of interactions was developed. The types of interactions are classified by using relative phase data from cross-wavelet transform analysis.
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/65347/65347fig02.jpg" /> 
Figure 2: Illustration of the different phase relationships of simple sine waves. (A) When the two signals, Signal 1 (blue lines) and Signal 2&#160;(orange lines), reach their respective maximum, minimum, and zero values at the same time point, they are said to be showing in-phase synchronization32. (B) When one signal reaches its maximum value and the other signal reaches zero value at the same time point, they are said to be showing lagged synchronization (one is leading by 90&#176;)32,33,34. (C) When two time series shift in opposite directions, meaning one signal reaches the maximum and the other reaches the minimum value at the same time point, this is referred to as anti-phase synchronization28. (D-P) In all other phase relationships between two time series, one signal is leading the other. In all positive phases, Signal 2&#160;is leading Signal 1 (e.g., panels E, F, M, and N), whereas in all negative phases, Signal 1 is leading Signal 2 (e.g., panels D, G, H, O, and P). Notably, when the absolute value of the phase is higher, it becomes more distinctive which time series is leading the other (e.g., the leadership is more distinctive in panel J than in panel I, and in panel K, the leadership is more distinctive than in panel L). <a href="https://www.jove.com/files/ftp_upload/65347/65347fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>

Author Spotlight: Unlocking New Insights in fNIRS Studies -  A Novel Framework for Inter-Brain Synchrony Analysis 

New Framework for Understanding Cross-Brain Coherence in Functional Near-Infrared Spectroscopy (fNIRS) Hyperscanning Studies

Many fNIRS studies have focused on coherence to estimate interbrain synchrony, neglecting phase lag information in the WBC hot plot. Here, a more sensitive approach has been presented that estimates coupling directionality, classifying phase angle value as in-phase synchronization, lag phase synchronization, and anti-phase synchronization. Reanalyzing the previous findings using a new proposed framework offers a comprehensive understanding of the nature of the synchronization between participants.Differentiating in-phase synchronization and anti-phase synchronization provides a new level of clarity, enabling the precise interpretation of previous findings. This framework can be applied to various scenarios, such as studying the role of interpersonal synchronization in social behavior, communication, and decision making. Emphasizing the application of craft theory in conjunction with the developed phase toolbox for hyperscanning apneas provides a deeper understanding of the various type of directionalities observed in interaction extending beyond mere coherence.This approach enables the exploration of the information flow from one brain to another brain in hyperscanning setting.

Watch this Scientific Journal Video about Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data at JoVE.com

Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data  

To begin open MATLAB, then navigate to the folder where the raw and irs files are saved. Select and open the folder. Type Homer3 into the command window of MATLAB to launch the Homer3 GUI.Homer3 will detect the nirs files and ask to convert them to snirf format to proceed with the pre-processing of the data. After converting the files, click on the Tools option and select Edit Processing Stream. In the process stream edit GUI select the pre-processing steps from the registry function column to the current processing stream column by clicking on Add.Click on the Save option to save the current processing stream and then exit the process stream edit GUI. Click on the RUN option to run the pre-processing stream in the main Homer3 GUI. After Homer3 finishes running the selected processing stream, it will save the pre-processed time series for each participant in a mat file format containing HBO, HBR, and HBT for all the channels and events.A folder named derivatives will be created by Homer3 in the selected folder to store these files. Select the homer folder located in the derivatives folder. Choose the mat file for each brain, and export HBO, HBR, HBT.

using-homer3-software-to-perform-pre-processing-fnirs-hyperscanning

Research

JoVE Journal

Neuroscience

406 Views.  Ariel University. To begin open MATLAB, then navigate to the folder where the raw and irs files are saved. Select and open the folder. Type Homer3 into the command window of MATLAB to launch the Homer3 GUI.Homer3 will detect the nirs files and ask to convert them to snirf format to proceed with the pre-processing of the data. After converting the files, click on the Tools option and select Edit Processing Stream. In the process stream edit GUI select the pre-processing steps from the registry function c...

Video: Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data  

Despite the growing body of functional near-infrared spectroscopy (fNIRS) hyperscanning studies, the assessment of coupling between two neural signals using wavelet transform coherence (WTC) seems to ignore the directionality of the interaction. The field is currently lacking a framework that allows researchers to determine whether a high coherence value obtained using a WTC function reflects in-phase synchronization (i.e., neural activation is seen in both members of the dyad at the same time), lagged synchronization (i.e., neural activation is seen in one member of the dyad prior to the other member), or anti-phase synchronization (i.e., neural activation is increased in one member of the dyad and decreased in the other). To address this need, a complementary and more sensitive approach for analyzing the phase coherence of two neural signals is proposed in this work. The toolbox allows investigators to estimate the coupling directionality by classifying the phase angle values obtained using traditional WTC into in-phase synchronization, lagged synchronization, and anti-phase synchronization. The toolbox also allows researchers to assess how the dynamics of interactions develop and change throughout the task. Using this novel WTC approach and the toolbox will advance our understanding of complex social interactions through their uses in fNIRS hyperscanning studies.

Wavelet transform coherence (WTC) is a common methodology for assessing the coupling between signals that is used in functional near-infrared spectroscopy (fNIRS) hyperscanning studies. A toolbox for assessing the directionality of the signal interaction is presented in this work.

Despite the growing body of functional near-infrared spectroscopy (fNIRS) hyperscanning studies, the assessment of coupling between two neural signals ...

Getting Started with the LeaderFollowerByPhase Toolbox

Open the leader follower by phase"toolbox to analyze the type of interaction that occurs in a hyper scanning recording. In MATLAB, select the mat files for each brain and load the HBO or HBR data of the specific channel and event into a one dimension vector as signal one and signal two. In the MATLAB command line, define the parameters of the functions low frequency and high frequency.The default value of low frequency is 0.01 hertz, and high frequency is one hertz. Then define the parameter for phase range, followed by the threshold. The default value of the threshold is zero.Execute the MATLAB function LeaderFollowerByPhase"by entering the command shown on the screen. The toolbox generates one figure with four plots. In MATLAB, inspect the box chart plot, which shows the R squared values for each type of interaction category in phase signal one, leading signal two leading, and antiphase.Then inspect the bar graph on the output figure, which displays the maximum values, mean, and median for all interaction types. The scatterplot displays the values of coherence and the types of interaction over time. The division of time according to different types of interactions.Next, inspect the output table with the statistic values for each type of interaction. The table also presents the percentage of time for which each type of interaction occurred. Finally, examine the output value in the extracted spreadsheet file.The classification analysis was repeated with a threshold of 0.5 on dyad A to explore the influence of changing the minimum threshold values on the classification of the types of interaction within a dyad. The result shows that when a threshold of 0.5 was used, the distribution of the different types of relative phase relationships changed. The percentage of antiphase synchronization increased from 35%to 59%and the percentage of endphase synchronization decreased from 26%to 8%This suggests that antiphase synchronization may be the type of interaction that is more representative of this dyad.