using homer3 software to perform the pre-processing of the fnirs hyperscanning data

fNIRS研究の革命:ニューラルカップリングへの新しいアプローチ

In recent years, there has been a shift in the types of studies conducted to understand the neural bases of social behavior1,2. Traditionally, studies in social neuroscience have focused on neural activation in one isolated brain during a socially relevant task. However, advances in neuroimaging technology now allow for the examination of neural activation in the brains of one or more individuals during social interaction as it occurs in &#34;real-life&#34; settings3. In &#34;real-life&#34; settings, individuals are able to move freely, and patterns of brain activation are likely to change as information is exchanged and social partners receive feedback from one another4.
Hyperscanning is a method that assesses this bidirectional information exchange by measuring the brain activity from two or more individuals simultaneously5. An emerging body of research has utilized functional near-infrared spectroscopy (fNIRS), a non-invasive neuroimaging technique that, in comparison to other neuroimaging techniques, is less susceptible to motion artifacts6. Hyperscanning via fNIRS allows for the assessment of inter-brain synchronization (IBS) in real-life settings while the interactive partners move freely and naturally. This is particularly relevant for work with infants and young children, who tend to be quite active. IBS has been reported to reflect mutual understanding between interactive partners, which serves as the foundation for effective social interaction and communication and mediates shared intentionality1,7,8.
Several methods are used to evaluate the IBS of two brains. Such methods include time series correlations, such as cross-correlation and the Pearson correlation coefficient9,10 (see a review by Scholkmann et al.10). Other methods involve evaluating the strength of coupling in the frequency domain. Such methods include phase-locking value (PLV) and phase coherence (see a review by Czeszumski et al.11). One of the most common methods in fNIRS studies uses wavelet transform coherence (WTC)-a measure of the cross-correlation of two time series as a function of frequency and time10.
WTC uses correlational analyses to calculate the coherence and phase lag between two time series in the time-frequency domain. FNIRS hyperscanning studies have used WTC to estimate IBS in many domains of functioning, including action monitoring12, cooperative and competitive behaviour5,13,14,15, imitation16, mother-infant problem solving17, and teaching-learning behavior18,19,20,21. Typically, in hyperscanning studies, cross-brain coherence, as measured by WTC, during an experimental task is compared to cross-brain coherence during a control task. These findings are usually presented with a WTC &#34;hot plot&#34;, which shows the coherence across the two brains at each time point and frequency (see Figure 1).
As suggested by Czesumaski et al.11, WTC has become the standard analytical approach for analyzing fNIRS hyperscanning. WTC analysis is a flexible, &#34;tool-agnostic&#34; method for data visualization and interpretation22. The coherence coefficient heatmap, which provides a narrative form of analysis allowing for the easy identification of periods of synchronous or asynchronous behavior as well as the intensity of brain activity during the completion of a task, is the main advantage of WTC and makes it a strong tool for applied research22. WTC has an advantage over correlation techniques. Correlations are sensitive to the hemodynamic response function&#39;s (HRF) shape, which is thought to differ between individuals (particularly in terms of age) and among different brain areas. In contrast, WTC is unaffected by interregional changes in the (HRF)23. Researchers have used the wavelet approach to study fMRI time series. Zhang et al.24 compared the commonly used functional connectivity metrics, including the Pearson correlation, partial correlation, mutual information, and wavelet coherence transformation (WTC). They carried out classification experiments using large-scale functional connectivity patterns derived from resting-state fMRI data and natural-stimulus fMRI data of video viewing. Their findings indicated that WTC performed best in classification (specificity, sensitivity, and accuracy), implying that WTC is a preferable functional connectivity metric for studying functional brain networks, at least in classification applications24.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/65347/65347fig01.jpg" /> 
Figure 1: Wavelet transform coherence (WTC). WTC shows the coherence and phase angle between two time series as a function of both time (x-axis) and frequency (y-axis). The coherence increase is depicted by the red color in the graph, and the small arrows in the graph show the phase angle of the two time series. The rightward-pointing arrow represents in-phase synchronization; the downward-pointing and upward-pointing arrows represent lagged synchronization; and the leftward-pointing arrow represents anti-phase synchronization30. This figure was adapted from Pan et al.19. <a href="https://www.jove.com/files/ftp_upload/65347/65347fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
Recently, Hamilton25 articulated several limitations to the interpretation of cross-brain coherence data in fNIRS hyperscanning studies. One of Hamilton&#39;s primary concerns was that coherence measures (e.g., WTC) only report effects as symmetrical (i.e., two brains are correlated, showing the same pattern of change). However, many social interactions are asymmetric (e.g., information flow between a speaker and a listener) in that two participants may play different roles, and it is not clear that WTC can capture this information. Here, this concern is addressed by a new framework that allows for a straightforward interpretation of the cross-wavelet power by using the cross-wavelet phase&#160;to detect directionality. This framework will also allow examination of how the dynamics of interactions develop and change throughout a task.
While WTC and correlation methods assess functional connectivity, other methods assess effective connectivity, attempting to extract the causal influences of one neural element over another. Transfer entropy is a measure from the field of information theory that describes the transfer between jointly dependent processes26. Another related method is Granger causality analysis (GCA), which has been described as equivalent to transfer entropy26.
In the existing literature of fNIRS hyperscanning studies, Granger causality analysis (GCA) has been widely used to estimate the coupling directionality between fNIRS time series data obtained during a variety of different tasks, such as cooperation5, teaching19, and imitation16. GCA employs vector autoregressive models to assess the directionality of coupling between time series in brain data. Granger causality is based on prediction and precedence: &#34;a variable X is said to &#39;G-cause&#39; variable Y if the past of X contains the information that helps to predict the future of Y over and above information already in the past of Y&#34;27. Accordingly, the G-causality is analyzed in two directions: 1) from subject A to subject B and 2) from subject B to subject A.
While GCA analysis serves as a complementary analysis aimed at determining whether a high coherence value obtained using a WTC function reflects IBS or lagged synchronization (one signal leading the other), it does not allow for the determination of whether anti-phase synchronization has occurred. In traditional neuroimaging studies, in which only one participant is scanned (i.e., the &#34;single-brain&#34; approach), an anti-phase pattern means that the activity in one brain region is increased while the activity in the other brain region is decreased28. In the hyperscanning literature, the presence of anti-phase synchronization may suggest that neural activation is increased in one subject, and at the same time, neural activation is decreased for the other subject. Therefore, there is a need to provide a comprehensive model that can detect the directionality. More specifically, this model will be able to detect anti-phase synchronization (in which the direction of activity in one individual is opposite to that of their partner) in addition to in-phase synchronization and lagged synchronization.
In an attempt to address the concern that WTC shows only symmetrical effects, where both brains show the same pattern of change25, a new approach to identify the type of interaction by examining the phase of synchronization (i.e., in-phase, lagged, or anti-phase) is presented (see Figure 2). To this end, a toolbox using the WTC method to classify the different types of interactions was developed. The types of interactions are classified by using relative phase data from cross-wavelet transform analysis.
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/65347/65347fig02.jpg" /> 
Figure 2: Illustration of the different phase relationships of simple sine waves. (A) When the two signals, Signal 1 (blue lines) and Signal 2&#160;(orange lines), reach their respective maximum, minimum, and zero values at the same time point, they are said to be showing in-phase synchronization32. (B) When one signal reaches its maximum value and the other signal reaches zero value at the same time point, they are said to be showing lagged synchronization (one is leading by 90&#176;)32,33,34. (C) When two time series shift in opposite directions, meaning one signal reaches the maximum and the other reaches the minimum value at the same time point, this is referred to as anti-phase synchronization28. (D-P) In all other phase relationships between two time series, one signal is leading the other. In all positive phases, Signal 2&#160;is leading Signal 1 (e.g., panels E, F, M, and N), whereas in all negative phases, Signal 1 is leading Signal 2 (e.g., panels D, G, H, O, and P). Notably, when the absolute value of the phase is higher, it becomes more distinctive which time series is leading the other (e.g., the leadership is more distinctive in panel J than in panel I, and in panel K, the leadership is more distinctive than in panel L). <a href="https://www.jove.com/files/ftp_upload/65347/65347fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>

著者スポットライト:fNIRS研究における新たな洞察の解き放つ - 脳間同期分析のための新しいフレームワーク 

機能的近赤外分光法(fNIRS)ハイパースキャニング研究における脳間コヒーレンスを理解するための新しいフレームワーク

Watch this Scientific Journal Video about Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data at JoVE.com

Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data  

Homer3ソフトウェアを使用したfNIRSハイパースキャンデータの前処理の実行

まず、MATLAB を開き、raw ファイルと irs ファイルが保存されているフォルダーに移動します。フォルダを選択して開きます。MATLAB のコマンド ウィンドウに「Homer3」と入力して、Homer3 GUI を起動します。Homer3 は nirs ファイルを検出し、データの前処理を続行するためにそれらを snirf 形式に変換するように要求します。ファイルを変換した後、[ツール]オプションをクリックし、[処理ストリームの編集]を選択します。プロセスストリーム編集GUIで、[Add]をクリックして、レジストリ関数列から現在の処理ストリーム列への前処理ステップを選択します。[保存]オプションをクリックして現在の処理ストリームを保存し、プロセスストリーム編集GUIを終了します。[実行]オプションをクリックして、メインのHomer3GUIで前処理ストリームを実行します。Homer3 は、選択した処理ストリームの実行を終了すると、各参加者の前処理された時系列を、すべてのチャネルとイベントの HBO、HBR、および HBT を含む mat ファイル形式で保存します。これらのファイルを格納するために、選択したフォルダーに Homer3 によって derivatives という名前のフォルダーが作成されます。derivativesフォルダにあるhomerフォルダを選択します。各脳のmatファイルを選択し、HBO、HBR、HBTをエクスポートします。

using-homer3-software-to-perform-pre-processing-fnirs-hyperscanning

Research

JoVE Journal

Neuroscience

Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data

445 ビュー. まず、MATLAB を開き、raw ファイルと irs ファイルが保存されているフォルダーに移動します。フォルダを選択して開きます。MATLAB のコマンド ウィンドウに「Homer3」と入力して、Homer3 GUI を起動します。Homer3 は nirs ファイルを検出し、データの前処理を続行するためにそれらを snirf 形式に変換するように要求します。ファイルを変換した後、[ツール]オプションをク?...

ビデオ: Using Homer3 Software to Perform the Pre-Processing of the fNIRS Hyperscanning Data  

New Framework for Understanding Cross-Brain Coherence in Functional Near-Infrared Spectroscopy (fNIRS) Hyperscanning Studies

Despite the growing body of functional near-infrared spectroscopy (fNIRS) hyperscanning studies, the assessment of coupling between two neural signals using wavelet transform coherence (WTC) seems to ignore the directionality of the interaction. The field is currently lacking a framework that allows researchers to determine whether a high coherence value obtained using a WTC function reflects in-phase synchronization (i.e., neural activation is seen in both members of the dyad at the same time), lagged synchronization (i.e., neural activation is seen in one member of the dyad prior to the other member), or anti-phase synchronization (i.e., neural activation is increased in one member of the dyad and decreased in the other). To address this need, a complementary and more sensitive approach for analyzing the phase coherence of two neural signals is proposed in this work. The toolbox allows investigators to estimate the coupling directionality by classifying the phase angle values obtained using traditional WTC into in-phase synchronization, lagged synchronization, and anti-phase synchronization. The toolbox also allows researchers to assess how the dynamics of interactions develop and change throughout the task. Using this novel WTC approach and the toolbox will advance our understanding of complex social interactions through their uses in fNIRS hyperscanning studies.

Wavelet transform coherence (WTC) is a common methodology for assessing the coupling between signals that is used in functional near-infrared spectroscopy (fNIRS) hyperscanning studies. A toolbox for assessing the directionality of the signal interaction is presented in this work.

Despite the growing body of functional near-infrared spectroscopy (fNIRS) hyperscanning studies, the assessment of coupling between two neural signals ...