The work was funded by a Presidential Postdoctoral Fellowship Grant from Nanyang Technological University that was awarded to VR.

Real-Life EEG and ECG Synchronization in Infant-Caregiver Interactions

<ol>
	<li>Hari, R., Henriksson, L., Malinen, S., Parkkonen, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Centrality+of+social+interaction+in+human+brain+function.">Centrality of social interaction in human brain function.</a> Neuron. 88 (1), 181-193 (2015).</li><li>Endevelt-Shapira, Y., Djalovski, A., Dumas, G., Feldman, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Maternal+chemosignals+enhance+infant-adult+brain-to-brain+synchrony.">Maternal chemosignals enhance infant-adult brain-to-brain synchrony.</a> Sci Adv. 7 (50), (2021).</li><li>Santamaria, L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Emotional+valence+modulates+the+topology+of+the+parent-infant+inter-brain+network.">Emotional valence modulates the topology of the parent-infant inter-brain network.</a> NeuroImage. 207, 116341 (2020).</li><li>Nguyen, T., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+effects+of+interaction+quality+on+neural+synchrony+during+mother-child+problem+solving.">The effects of interaction quality on neural synchrony during mother-child problem solving.</a> Cortex. 124, 235-249 (2020).</li><li>Reindl, V., Gerloff, C., Scharke, W., Konrad, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Brain-to-brain+synchrony+in+parent-child+dyads+and+the+relationship+with+emotion+regulation+revealed+by+fNIRS-based+hyperscanning.">Brain-to-brain synchrony in parent-child dyads and the relationship with emotion regulation revealed by fNIRS-based hyperscanning.</a> NeuroImage. 178, 493-502 (2018).</li><li>Reindl, V., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Conducting+hyperscanning+experiments+with+functional+near-infrared+spectroscopy.">Conducting hyperscanning experiments with functional near-infrared spectroscopy.</a> J Vis Exp. (143), e58807 (2019).</li><li>Gardner, F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Methodological+issues+in+the+direct+observation+of+parent-child+interaction:+Do+observational+findings+reflect+the+natural+behavior+of+participants.">Methodological issues in the direct observation of parent-child interaction: Do observational findings reflect the natural behavior of participants.</a> Clin Child Fam Psychol Rev. 3, 185-198 (2000).</li><li>Xu, J., Zhong, B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Review+on+portable+EEG+technology+in+educational+research.">Review on portable EEG technology in educational research.</a> Comput Hum Behav. 81, 340-349 (2018).</li><li>Troller-Renfree, S. V., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Feasibility+of+assessing+brain+activity+using+mobile,+in-home+collection+of+electroencephalography:+methods+and+analysis.">Feasibility of assessing brain activity using mobile, in-home collection of electroencephalography: methods and analysis.</a> Dev Psychobiol. 63 (6), e22128 (2021).</li><li>B&#246;gels, S., Levinson, S. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+brain+behind+the+response:+Insights+into+turn-taking+in+conversation+from+neuroimaging.">The brain behind the response: Insights into turn-taking in conversation from neuroimaging.</a> Res Lang Soc. 50 (1), 71-89 (2017).</li><li>Georgieva, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Toward+the+understanding+of+topographical+and+spectral+signatures+of+infant+movement+artifacts+in+naturalistic+EEG.">Toward the understanding of topographical and spectral signatures of infant movement artifacts in naturalistic EEG.</a> Front Neurosci. 14, 452947 (2020).</li><li>Dikker, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Brain-to-brain+synchrony+tracks+real-world+dynamic+group+interactions+in+the+classroom.">Brain-to-brain synchrony tracks real-world dynamic group interactions in the classroom.</a> Curr Biol. 27 (9), 1375-1380 (2017).</li><li>Oliveira, A. S., Bryan, R. S., Hairston, W. D., Peter, K., Daniel, P. F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Proposing+metrics+for+benchmarking+novel+EEG+technologies+towards+real-world+measurements.">Proposing metrics for benchmarking novel EEG technologies towards real-world measurements.</a> Front Hum Neurosci. 10, 188 (2016).</li><li>Turk, E., Endevelt-Shapira, Y., Feldman, R., vanden Heuvel, M. I., Levy, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Brains+in+sync:+Practical+guideline+for+parent-infant+EEG+during+natural+interaction.">Brains in sync: Practical guideline for parent-infant EEG during natural interaction.</a> Front Psychol. 13, 833112 (2022).</li><li>Kayhan, E., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+dual+EEG+pipeline+for+developmental+hyperscanning+studies.">A dual EEG pipeline for developmental hyperscanning studies.</a> Dev Cogn Neurosci. 54, 101104 (2022).</li><li>Ayrolles, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=HyPyP:+a+Hyperscanning+Python+pipeline+for+inter-brain+connectivity+analysis.">HyPyP: a Hyperscanning Python pipeline for inter-brain connectivity analysis.</a> Soc Cogn Affect Neurosci. 16 (1-2), 72-83 (2021).</li><li>Delorme, S., Makeig, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=EEGLAB:+an+open-source+toolbox+for+analysis+of+single-trial+EEG+dynamics.">EEGLAB: an open-source toolbox for analysis of single-trial EEG dynamics.</a> J Neurosci Meth. 134, 9-21 (2004).</li><li>Nathan, K., Contreras-Vidal, J. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Negligible+motion+artifacts+in+scalp+electroencephalography+(EEG)+during+treadmill+walking.">Negligible motion artifacts in scalp electroencephalography (EEG) during treadmill walking.</a> Front Hum Neurosci. 9, 708 (2016).</li><li>Stone, D. B., Tamburro, G., Fiedler, P., Haueisen, J., Comani, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automatic+removal+of+physiological+artifacts+in+EEG:+The+optimized+fingerprint+method+for+sports+science+applications.">Automatic removal of physiological artifacts in EEG: The optimized fingerprint method for sports science applications.</a> Front Hum Neurosci. 12, 96 (2018).</li><li>Noreika, V., Georgieva, S., Wass, S., Leong, V. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=14+challenges+and+their+solutions+for+conducting+social+neuroscience+and+longitudinal+EEG+research+with+infants.">14 challenges and their solutions for conducting social neuroscience and longitudinal EEG research with infants.</a> Infant Behav Dev. 58, 101393 (2020).</li><li>Ng, B., Reh, R. K., Mostafavi, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+practical+guide+to+applying+machine+learning+to+infant+EEG+data.">A practical guide to applying machine learning to infant EEG data.</a> Dev Cogn Neurosci. 54, 101096 (2022).</li><li>vander Velde, B., Junge, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Limiting+data+loss+in+infant+EEG:+putting+hunches+to+the+test.">Limiting data loss in infant EEG: putting hunches to the test.</a> Dev Cogn Neurosci. 45, 100809 (2020).</li><li>Bell, M. A., Cuevas, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Using+EEG+to+study+cognitive+development:+Issues+and+practices.">Using EEG to study cognitive development: Issues and practices.</a> J Cogn Dev. 13 (3), 281-294 (2012).</li><li>Lopez, K. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=HAPPILEE:+HAPPE+in+low+electrode+electroencephalography,+a+standardized+pre-processing+software+for+lower+density+recordings.">HAPPILEE: HAPPE in low electrode electroencephalography, a standardized pre-processing software for lower density recordings.</a> NeuroImage. 260, 119390 (2022).</li></ol>

No conflicts of interest are to be declared.

In this protocol, we conduct measurements in the participants&#39; homes where infants and caregivers may feel more comfortable and their behaviors may be more representative of their real-life interactions as opposed to a laboratory setting, thus, increasing ecological validity7. Further, recordings in the home environment may ease the burden on&#160;the participants, e.g., with respect to travel times, and may thus make certain participant groups more accessible. However, along with these advant...

With the simultaneous recording of brain activities from two or more interacting subjects, also known as hyperscanning, it has become possible to elucidate the neural basis of social interactions in their complex, bidirectional, and fast-paced dynamics1. This technique has shifted the focus from studying individuals in isolated, tightly controlled settings to examining more naturalistic interactions, such as parent-child interactions during free play2,3, puzzle-solving4, and cooperative computer games5,6. These studies demonstrate that brain activities synchronize during social interactions, i.e., show temporal similarities, a phenomenon termed interpersonal neural synchrony (INS). However, the great majority of hyperscanning studies have been confined to laboratory settings. While this allows for better experimental control, it may come at the expense of losing some ecological validity. Behaviors observed in the laboratory may not be representative of the participants&#39; typical everyday interactive behaviors due to the unfamiliar and artificial setting and the nature of the tasks imposed7.
Recent advances in mobile neuroimaging devices, such as electroencephalography (EEG) or functional near-infrared spectroscopy (fNIRS), alleviate these issues by removing the requirement for participants to remain physically connected to the recording computer. Thus, they allow us to measure participants&#39; brain activities while they interact freely in the classroom or in their homes8,9. The advantage of EEG compared to other neuroimaging techniques, such as fNIRS, is that it has an excellent temporal resolution, which makes it particularly suitable for investigating fast-paced social dynamics10. Yet, it comes with the caveat that the EEG signal is highly vulnerable to motion and other physiological and non-physiological artifacts11.
Despite this, the first studies have successfully implemented EEG hyperscanning set-ups in realistic environments and conditions. For instance, Dikker et al.12 measured the EEG signal of a group of students while they engaged in various classroom activities, including attending lectures, watching videos, and participating in group discussions. This study, along with other studies8,9, has predominantly utilized dry EEG electrodes to ease the process of conducting measurements in non-laboratory settings. Compared to wet electrodes, which require the application of conductive gel or paste, dry electrodes offer notable advantages in terms of usability. They have been shown to exhibit comparable performance to wet electrodes in adult populations and stationary conditions; however, their performance may decrease in motion-related scenarios due to increased impedance levels13.
Here, we present a working protocol to capture synchronized recordings from a low-density seven-channel liquid gel EEG system with a single lead electrocardiography (ECG) connected to the same wireless amplifier (sampling rate: 500 Hz)&#160;of infant-caregiver dyads in a home setting. While active electrodes were used for adults, passive electrodes were used instead for infants since the latter typically comes in the form of ring electrodes, thereby easing the process of gel application. Additionally, EEG-ECG recordings were synchronized to three cameras and microphones to capture the participants&#39; behaviors from different angles. In the study, 8-12-month-old infants and their caregivers engaged in a reading and play task while their EEG, ECG, and behaviors were recorded. To minimize the impact of excessive movement on EEG signal quality, the tasks were conducted in a table-top setting (e.g., utilizing the kitchen table and an infant highchair), requiring participants to remain seated throughout the interaction task. Caregivers were provided with three age-appropriate books and table-top toys (equipped with suction cups to prevent them from falling). They were instructed to read to their child for approximately 5 min, followed by a 10 min play session with the toys.
This protocol details the methods for collecting synchronized EEG-ECG, video, and audio data during the reading and play tasks. The overall procedure, however, is not specific to this research design but is appropriate for different populations (e.g., parent-child dyads, friend dyads) and experimental tasks. The method of synchronization of different data streams will be presented. Further, a basic EEG preprocessing pipeline based on Dikker et al.12 will be outlined, and EEG data retention rates and quality control metrics will be reported. Since the specific analytical choices depend on a variety of factors (such as task design, research questions, EEG montage), hyperscanning-EEG analysis will not be detailed further, but instead, the reader will be referred to existing guidelines and toolboxes (e.g.,14 for guidelines;15,16 for hyperscanning analysis toolboxes). Finally, the protocol discusses challenges and potential solutions for EEG-ECG hyperscanning in the home and other real-world settings.

<table><tbody><tr><td>10 cc Luer Lock Tip syringe without Needle</td><td>Terumo Corporation</td><td></td><td></td></tr><tr><td>actiCAP slim 8-channel electrode set (LiveAMP8)</td><td>Brain Products GmbH</td><td></td><td></td></tr><tr><td>Arduino Software (IDE)</td><td>Arduino</td><td>Arduino IDE 1.8.19</td><td>The software used to write the code for the Arduino microcontroller. Alternate programming software may be used to accompany the chosen microcontroller unit.&amp;nbsp;</td></tr><tr><td>Arduino Uno board</td><td>Arduino</td><td></td><td>Used for building the circuit of the trigger box. Alternate microcontroller boards may be used.</td></tr><tr><td>BNC connectors</td><td></td><td></td><td>BNC connectors to connect the various parts of the trigger box setup.</td></tr><tr><td>BNC Push button&amp;nbsp;</td><td>Brain Products GmbH</td><td>BP-345-9000</td><td>BNC trigger push button to send triggers.</td></tr><tr><td>BNC to 2.5 mm jack trigger cable (80 cm)&amp;nbsp;</td><td>Brain Products GmbH</td><td>BP-245-1200</td><td>BNC cables connecting the 2 LiveAmps to the trigger box.</td></tr><tr><td>BrainVision Analyzer Version 2.2.0.7383</td><td>Brain Products GmbH</td><td></td><td>EEG analysis software.</td></tr><tr><td>BrainVision Recorder License with dongle</td><td>Brain Products GmbH</td><td>S-BP-170-3000</td><td></td></tr><tr><td>BrainVision Recorder Version 1.23.0003</td><td>Brain Products GmbH</td><td></td><td>EEG recording software.</td></tr><tr><td>Custom 8Ch LiveAmp Cap passive (infant EEG caps)</td><td>Brain Products GmbH</td><td>LC-X6-SAHS-44, LC-X6-SAHS-46, LC-X6-SAHS-48&amp;nbsp;</td><td>For infant head sizes 44, 46, 48 . Alternate EEG caps may be used.</td></tr><tr><td>Dell Latitude 3520 Laptops</td><td>Dell</td><td></td><td>Two laptops, one for adult EEG recording and one for infant EEG recording. Alternate computers may be used.</td></tr><tr><td>Dental Irrigation Syringes</td><td></td><td></td><td></td></tr><tr><td>LiveAmp 8-CH wireless amplifier</td><td>BrainProducts GmbH</td><td>BP-200-3020</td><td>Two LiveAmps, one for adult EEG and one for infant EEG. Alternate amplifier may be used.</td></tr><tr><td>Manfrotto MT190X3 Tripod with 128RC Micro Fluid Video Head</td><td>Manfrotto</td><td>MT190X3</td><td>Alternate tripods may be used.</td></tr><tr><td>Matlab Software</td><td>The MathWorks, Inc.</td><td>R2023a</td><td>Alternate analysis and presentation software may be used.</td></tr><tr><td>Power bank (10000 mAh)</td><td>Philips</td><td>DLP6715NB/69</td><td>Alternate power banks may be used.</td></tr><tr><td>Raw EEG caps</td><td>EASYCAP GmbH</td><td></td><td>For Adult head sizes 52, 54, 56, 58. Alternate EEG caps may be used.</td></tr><tr><td>Rode Wireless Go II Single Set</td><td>R&amp;oslash;de Microphones</td><td></td><td>Alternate microphones may be used.</td></tr><tr><td>Sony FDR-AX700 Camcorder</td><td>Sony</td><td>FDR-AX700</td><td>Alternate camcorders or webcams may be used.</td></tr><tr><td>SuperVisc High-Viscosity Gel&amp;nbsp;</td><td>EASYCAP GmbH</td><td>NS-7907</td><td></td></tr></tbody></table>

home-based eeg hyperscanning for infant-caregiver social interactions

Prior hyperscanning studies that record the brain activities of caregivers and children concurrently have primarily been conducted within the confines of the laboratory, thus limiting the generalizability of results to real-life settings. Here, a comprehensive protocol for capturing synchronized electroencephalography (EEG), electrocardiography (ECG), and behavioral recordings from infant-caregiver dyads during various interactive tasks at home is proposed. This protocol demonstrates how to synchronize the different data streams and report EEG data retention rates and quality checks. Additionally, critical issues and possible solutions with respect to the experimental setup, tasks, and data collection in home settings are discussed. The protocol is not limited to infant-caregiver dyads but can be applied to various dyadic constellations. Overall, we demonstrate the flexibility of EEG hyperscanning setups, which allow experiments to be conducted outside of the laboratory to capture participants' brain activities in more ecologically valid environmental settings. Yet, movement and other types of artifacts still constrain the experimental tasks that can be performed in the home setting.

Participants included in this study were 8- to 12-month-old, typically developing infants and their mother and/or grandmother who spoke English or English and a second language at home. The 7-electrode EEGs and a single-lead ECG of adults and infants, as well as video and audio recordings from three cameras and microphones, were acquired simultaneously during the tasks. Neural activities were measured over F3, F4, C3, Cz, C4, P3, and P4 according to the international 10-20 system. The different data streams were temporal...

Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection

This protocol describes how synchronized electroencephalography, electrocardiography, and behavioral recordings were captured from infant-caregiver dyads in a home setting.

Home-Based EEG Hyperscanning for Infant-Caregiver Social Interactions

Prior hyperscanning studies that record the brain activities of caregivers and children concurrently have primarily been conducted within the confines of ...

home-based-eeg-hyperscanning-for-infant-caregiver-social-interactions

Research

JoVE Journal

Neuroscience

694 Views.  Nanyang Technological University. This protocol describes how synchronized electroencephalography, electrocardiography, and behavioral recordings were captured from infant-caregiver dyads in a home setting.

Video: Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection

Functional Mapping with Simultaneous MEG and EEG

We use magnetoencephalography (MEG) and electroencephalography (EEG) to locate and determine the temporal evolution in brain areas involved in the processing of simple sensory stimuli. We will use somatosensory stimuli to locate the hand somatosensory areas, auditory stimuli to locate the auditory cortices, visual stimuli in four quadrants of the visual field to locate the early visual areas. These type of experiments are used for functional mapping in epileptic and brain tumor patients to locate eloquent cortices. In basic neuroscience similar experimental protocols are used to study the orchestration of cortical activity. The acquisition protocol includes quality assurance procedures, subject preparation for the combined MEG/EEG study, and acquisition of evoked-response data with somatosensory, auditory, and visual stimuli. We also demonstrate analysis of the data using the equivalent current dipole model and cortically-constrained minimum-norm estimates. Anatomical MRI data are employed in the analysis for visualization and for deriving boundaries of tissue boundaries for forward modeling and cortical location and orientation constraints for the minimum-norm estimates.

We use magnetoencephalography (MEG) and electroencephalography (EEG) to map brain areas involved in the processing of simple sensory stimuli.

We use magnetoencephalography (MEG) and electroencephalography (EEG) to locate and determine the temporal evolution in brain areas involved in the ...

Combining Behavioral Endocrinology and Experimental Economics: Testosterone and Social Decision Making

Behavioral endocrinological research in humans as well as in animals suggests that testosterone plays a key role in social interactions. Studies in rodents have shown a direct link between testosterone and aggressive behavior1 and folk wisdom adapts these findings to humans, suggesting that testosterone induces antisocial, egoistic or even aggressive behavior2. However, many researchers doubt a direct testosterone-aggression link in humans, arguing instead that testosterone is primarily involved in status-related behavior3,4. As a high status can also be achieved by aggressive and antisocial means it can be difficult to distinguish between anti-social and status seeking behavior.
We therefore set up an experimental environment, in which status can only be achieved by prosocial means. In a double-blind and placebo-controlled experiment, we administered a single sublingual dose of 0.5 mg of testosterone (with a hydroxypropyl-&beta;-cyclodextrin carrier) to 121 women and investigated their social interaction behavior in an economic bargaining paradigm. Real monetary incentives are at stake in this paradigm; every player A receives a certain amount of money and has to make an offer to another player B on how to share the money. If B accepts, she gets what was offered and player A keeps the rest. If B refuses the offer, nobody gets anything. A status seeking player A is expected to avoid being rejected by behaving in a prosocial way, i.e. by making higher offers.
The results show that if expectations about the hormone are controlled for, testosterone administration leads to a significant increase in fair bargaining offers compared to placebo. The role of expectations is reflected in the fact that subjects who report that they believe to have received testosterone make lower offers than those who say they believe that they were treated with a placebo. These findings suggest that the experimental economics approach is sensitive for detecting neurobiological effects as subtle as those achieved by administration of hormones. Moreover, the findings point towards the importance of both psychosocial as well as neuroendocrine factors in determining the influence of testosterone on human social behavior.

The procedure described in this protocol shows that testosterone administration and folk beliefs about testosterone may be associated with directly opposed social behaviors.

Behavioral endocrinological research in humans as well as in animals suggests that testosterone plays a key role in social interactions. Studies in ...

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they yield data relevant to the cognitive processing that occurs under ecologically valid conditions. These two goals often are at odds, since well controlled stimuli often are too repetitive to sustain subjects' motivation. Studies employing electroencephalography (EEG) are often especially sensitive to this dilemma between ecological validity and experimental control: attaining sufficient signal-to-noise in physiological averages demands large numbers of repeated trials within lengthy recording sessions, limiting the subject pool to individuals with the ability and patience to perform a set task over and over again. This constraint severely limits researchers' ability to investigate younger populations as well as clinical populations associated with heightened anxiety or attentional abnormalities. Even adult, non-clinical subjects may not be able to achieve their typical levels of performance or cognitive engagement: an unmotivated subject for whom an experimental task is little more than a chore is not the same, behaviourally, cognitively, or neurally, as a subject who is intrinsically motivated and engaged with the task. A growing body of literature demonstrates that embedding experiments within video games may provide a way between the horns of this dilemma between experimental control and ecological validity. The narrative of a game provides a more realistic context in which tasks occur, enhancing their ecological validity (Chaytor &amp; Schmitter-Edgecombe, 2003). Moreover, this context provides motivation to complete tasks. In our game, subjects perform various missions to collect resources, fend off pirates, intercept communications or facilitate diplomatic relations. In so doing, they also perform an array of cognitive tasks, including a Posner attention-shifting paradigm (Posner, 1980), a go/no-go test of motor inhibition, a psychophysical motion coherence threshold task, the Embedded Figures Test (Witkin, 1950, 1954) and a theory-of-mind (Wimmer &amp; Perner, 1983) task. The game software automatically registers game stimuli and subjects' actions and responses in a log file, and sends event codes to synchronise with physiological data recorders. Thus the game can be combined with physiological measures such as EEG or fMRI, and with moment-to-moment tracking of gaze. Gaze tracking can verify subjects' compliance with behavioural tasks (e.g. fixation) and overt attention to experimental stimuli, and also physiological arousal as reflected in pupil dilation (Bradley et al., 2008). At great enough sampling frequencies, gaze tracking may also help assess covert attention as reflected in microsaccades - eye movements that are too small to foveate a new object, but are as rapid in onset and have the same relationship between angular distance and peak velocity as do saccades that traverse greater distances. The distribution of directions of microsaccades correlates with the (otherwise) covert direction of attention (Hafed &amp; Clark, 2002).

Procedures for recording high-density EEG and gaze data during computer game-based cognitive tasks are described. Using a video game to present cognitive tasks enhances ecological validity without sacrificing experimental control.

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they ...

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

The ability to gauge social interactions is crucial in the assessment of others&#x2019; intentions. Factors such as facial expressions and body language affect our decisions in personal and professional life alike 1. These "friend or foe" judgements are often based on first impressions, which in turn may affect our decisions to "approach or avoid". Previous studies investigating the neural correlates of social cognition tended to use static facial stimuli 2. Here, we illustrate an experimental design in which whole-body animated characters were used in conjunction with functional magnetic resonance imaging (fMRI) recordings. Fifteen participants were presented with short movie-clips of guest-host interactions in a business setting, while fMRI data were recorded; at the end of each movie, participants also provided ratings of the host behaviour. This design mimics more closely real-life situations, and hence may contribute to better understanding of the neural mechanisms of social interactions in healthy behaviour, and to gaining insight into possible causes of deficits in social behaviour in such clinical conditions as social anxiety and autism 3.

This article demonstrates an experimental design in which whole-body animated characters are used in conjunction with functional magnetic resonance imaging (fMRI) to investigate the neural correlates of observing virtual social interactions.

The ability to gauge social interactions is crucial in the assessment of others&#x2019; intentions. Factors such as facial expressions and body language ...

Infant Auditory Processing and Event-related Brain Oscillations

Rapid auditory processing and acoustic change detection abilities play a critical role in allowing human infants to efficiently process the fine spectral and temporal changes that are characteristic of human language. These abilities lay the foundation for effective language acquisition; allowing infants to hone in on the sounds of their native language. Invasive procedures in animals and scalp-recorded potentials from human adults suggest that simultaneous, rhythmic activity (oscillations) between and within brain regions are fundamental to sensory development; determining the resolution with which incoming stimuli are parsed. At this time, little is known about oscillatory dynamics in human infant development. However, animal neurophysiology and adult EEG data provide the basis for a strong hypothesis that rapid auditory processing in infants is mediated by oscillatory synchrony in discrete frequency bands. In order to investigate this, 128-channel, high-density EEG responses of 4-month old infants to frequency change in tone pairs, presented in two rate conditions (Rapid: 70 msec ISI and Control: 300 msec ISI) were examined. To determine the frequency band and magnitude of activity, auditory evoked response averages were first co-registered with age-appropriate brain templates. Next, the principal components of the response were identified and localized using a two-dipole model of brain activity. Single-trial analysis of oscillatory power showed a robust index of frequency change processing in bursts of Theta band (3 - 8 Hz) activity in both right and left auditory cortices, with left activation more prominent in the Rapid condition. These methods have produced data that are not only some of the first reported evoked oscillations analyses in infants, but are also, importantly, the product of a well-established method of recording and analyzing clean, meticulously collected, infant EEG and ERPs. In this article, we describe our method for infant EEG net application, recording, dynamic brain response analysis, and representative results.

High-density electroencephalography (dEEG) is being used increasingly to study brain development and plasticity in the early years of life. Here we present an application of sophisticated analysis techniques that builds on traditional EEG recording to understand the oscillatory dynamics of rapid auditory processing in the infant brain.

Rapid auditory processing and acoustic change detection abilities play a critical role in allowing human infants to efficiently process the fine spectral ...

Behavior

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Understanding typical and atypical development remains one of the fundamental questions in developmental human neuroscience. Traditionally, experimental paradigms and analysis tools have been limited to constrained laboratory tasks and contexts due to technical limitations imposed by the available set of measuring and analysis techniques and the age of the subjects. These limitations severely limit the study of developmental neural dynamics and associated neural networks engaged in cognition, perception and action in infants performing &#8220;in action and in context&#8221;. This protocol presents a novel approach to study infants and young children as they freely organize their own behavior, and its consequences in a complex, partly unpredictable and highly dynamic environment. The proposed methodology integrates synchronized high-density active scalp electroencephalography (EEG), inertial measurement units (IMUs), video recording and behavioral analysis to capture brain activity and movement non-invasively in freely-behaving infants. This setup allows for the study of neural network dynamics in the developing brain, in action and context, as these networks are recruited during goal-oriented, exploration and social interaction tasks.

This protocol presents a novel methodology for the neural decoding of intent from freely-behaving infants during unscripted social interaction with an actor. Neural activity is acquired using non-invasive high-density active scalp electroencephalography (EEG). Kinematic data is collected with inertial measurement units and supplemented with synchronized video recording.

Understanding typical and atypical development remains one of the fundamental questions in developmental human neuroscience. Traditionally, experimental ...

Investigating Social Cognition in Infants and Adults Using Dense Array Electroencephalography (dEEG)

Dense array electroencephalography (dEEG), which provides a non-invasive window for measuring brain activity and a temporal resolution unsurpassed by any other current brain imaging technology1,2, is being used increasingly in the study of social cognitive functioning in infants and adults. While dEEG is enabling researchers to examine brain activity patterns with unprecedented levels of sensitivity, conventional EEG recording systems continue to face certain limitations, including 1) poor spatial resolution and source localization3,4,2) the physical discomfort for test subjects of enduring the individual application of numerous electrodes to the surface of the scalp, and 3) the complexity for researchers of learning to use multiple software packages to collect and process data. Here we present an overview of an established methodology that represents a significant improvement on conventional methodologies for studying EEG in infants and adults. Although several analytical software techniques can be used to establish indirect indices of source localization to improve the spatial resolution of dEEG, the HydroCel Geodesic Sensor Net (HCGSN) by Electrical Geodesics, Inc. (EGI), a dense sensory array that maintains equal distances among adjacent recording electrodes on all surfaces of the scalp, further enhances spatial resolution4,5,6 compared to standard dEEG systems. The sponge-based HCGSN can be applied rapidly and without scalp abrasion, making it ideal for use with adults7,8, children9,10,11, and infants12, in both research and clinical4,5,6,13,14,15 settings. This feature allows for considerable cost and time savings by decreasing the average net application time compared to other dEEG systems. Moreover, the HCGSN includes unified, seamless software applications for all phases of data, greatly simplifying the collection, processing, and analysis of dEEG data.
The HCGSN features a low-profile electrode pedestal, which, when filled with electrolyte solution, creates a sealed microenvironment and an electrode-scalp interface. In all Geodesic dEEG systems, EEG sensors detect changes in voltage originating from the participant's scalp, along with a small amount of electrical noise originating from the room environment. Electrical signals from all sensors of the Geodesic sensor net are received simultaneously by the amplifier, where they are automatically processed, packaged, and sent to the data-acquisition computer (DAC). Once received by the DAC, scalp electrical activity can be isolated from artifacts for analysis using the filtering and artifact detection tools included in the EGI software. Typically, the HCGSN can be used continuously for only up to two hours because the electrolyte solution dries out over time, gradually decreasing the quality of the scalp-electrode interface.
In the Parent-Infant Research Lab at the University of Toronto, we are using dEEG to study social cognitive processes including memory, emotion, goals, intentionality, anticipation, and executive functioning in both adult and infant participants.

Investigating Social Cognition in Infants and Adults Using Dense Array Electroencephalography dEEG

Dense array electroencephalography is being used increasingly to study social cognitive functions in infants and adults. Here we present an established methodology that represents a significant improvement on conventional methodologies for studying EEG in infants and adults.

Dense array electroencephalography (dEEG), which provides a non-invasive window for measuring brain activity and a temporal resolution unsurpassed by any ...

A Within-subjects Experimental Protocol to Assess the Effects of Social Input on Infant EEG

Despite the importance of social interactions for infant brain development, little research has assessed functional neural activation while infants socially interact. Electroencephalography (EEG) power is an advantageous technique to assess infant functional neural activation. However, many studies record infant EEG only during one baseline condition. This protocol describes a paradigm that is designed to comprehensively assess infant EEG activity in both social and nonsocial contexts as well as tease apart how different types of social inputs differentially relate to infant EEG. The within-subjects paradigm includes four controlled conditions. In the nonsocial condition, infants view objects on computer screens. The joint attention condition involves an experimenter directing the infant's attention to pictures. The joint attention condition includes three types of social input: language, face-to-face interaction, and the presence of joint attention. Differences in infant EEG between the nonsocial and joint attention conditions could be due to any of these three types of input. Therefore, two additional conditions (one with language input while the experimenter is hidden behind a screen and one with face-to-face interaction) were included to assess the driving contextual factors in patterns of infant neural activation. Representative results demonstrate that infant EEG power varied by condition, both overall and differentially by brain region, supporting the functional nature of infant EEG power. This technique is advantageous in that it includes conditions that are clearly social or nonsocial and allows for examination of how specific types of social input relate to EEG power. This paradigm can be used to assess how individual differences in age, affect, socioeconomic status, and parent-infant interaction quality relate to the development of the social brain. Based on the demonstrated functional nature of infant EEG power, future studies should consider the role of EEG recording context and design conditions that are clearly social or nonsocial.

This novel protocol is designed to assess the neural bases of social interaction in infants. The paradigm is designed to tease apart how various social inputs such as language, joint attention, and face-to-face interaction relate to infant neural activation. Infant EEG power is recorded during both social and nonsocial conditions.

Despite the importance of social interactions for infant brain development, little research has assessed functional neural activation while infants ...

How to Find Effects of Stimulus Processing on Event Related Brain Potentials of Close Others when Hyperscanning Partners

The partners of each pair must be able to pass the McGill Friendship Questionnaire without communicating. Each partner is then seated in front of a screen in one of two adjacent rooms. These rooms are separated by a glass window through which participants communicate to maintain feelings of togetherness while being fitted with the EEG cap. After checking for adequate EEG signals, the glass is covered by a curtain to prevent visual communication. Then, partners must be silent but are instructed to try to feel in the presence of their partner during the entire experiment. Just before it starts, participants are told that each of them will be presented with one image at a time and that these images will occur at the same time for both of them on their own screen. They are also instructed that, for each trial, the simultaneous images will always be different. However, unbeknownst to them, trials are randomized: only half of them are consistent with this instruction and actually include two different images. These trials form the DSC, that is, the different-stimuli condition. The other half of the trials are inconsistent with the instruction. They include two identical images and form the ISC (identical-stimuli condition). After the experiment, participants are sorted into two groups: those who reported that they felt in the presence of their partner during the majority of the trials and those who reported they did not. The impact of the stimulus processing of the partner is found by subtracting the mean voltages of the ERPs of the ISC (inconsistent with the instructions) from the ERPs of the DSC (consistent with the instructions) in at least two time windows (TWs): firstly, in the 75 to 150 ms TW, where the absolute values of these subtractions are greater, especially at right frontal sites, in those who felt in the presence of their partner than in those who did not; secondly, in the LPP time window (i.e., from 650 to 950 ms post onset), where ERPs are significantly less positive in the DSC than in the ISC in those in whom the raw results of the early (75-150ms) subtractions are negative.

This protocol describes key steps involved in assessing the sensitivity of the brain of one person to the stimulus processing of a close other by selecting pairs of partners, recording their electroencephalogram (EEG) simultaneously and computing their event-related brain potentials (ERPs).

The partners of each pair must be able to pass the McGill Friendship Questionnaire without communicating. Each partner is then seated in front of a screen ...

Conducting Hyperscanning Experiments with Functional Near-Infrared Spectroscopy

Concurrent brain recordings of two or more interacting persons, an approach termed hyperscanning, are gaining increasing importance for our understanding of the neurobiological underpinnings of social interactions, and possibly interpersonal relationships. Functional near-infrared spectroscopy (fNIRS) is well suited for conducting hyperscanning experiments because it measures local hemodynamic effects with a high sampling rate and, importantly, it can be applied in natural settings, not requiring strict motion restrictions. In this article, we present a protocol for conducting fNIRS hyperscanning experiments with parent-child dyads and for analyzing brain-to-brain synchrony. Furthermore, we discuss critical issues and future directions, regarding the experimental design, spatial registration of the fNIRS channels, physiological influences and data analysis methods. The described protocol is not specific to parent-child dyads, but can be applied to a variety of different dyadic constellations, such as adult strangers, romantic partners or siblings. To conclude, fNIRS hyperscanning has the potential to yield new insights into the dynamics of the ongoing social interaction, which possibly go beyond what can be studied by examining the activities of individual brains.

The present protocol describes how to conduct fNIRS hyperscanning experiments and analyze brain-to-brain synchrony. Further, we discuss challenges and possible solutions.

Concurrent brain recordings of two or more interacting persons, an approach termed hyperscanning, are gaining increasing importance for our understanding ...