sensor streams synchronization of electroencephalography (eeg), electrocardiography (ecg) in natural settings for caregiver-child interaction studies

تزامن EEG و ECG الواقعي في التفاعلات بين الرضع ومقدمي الرعاية

With the simultaneous recording of brain activities from two or more interacting subjects, also known as hyperscanning, it has become possible to elucidate the neural basis of social interactions in their complex, bidirectional, and fast-paced dynamics1. This technique has shifted the focus from studying individuals in isolated, tightly controlled settings to examining more naturalistic interactions, such as parent-child interactions during free play2,3, puzzle-solving4, and cooperative computer games5,6. These studies demonstrate that brain activities synchronize during social interactions, i.e., show temporal similarities, a phenomenon termed interpersonal neural synchrony (INS). However, the great majority of hyperscanning studies have been confined to laboratory settings. While this allows for better experimental control, it may come at the expense of losing some ecological validity. Behaviors observed in the laboratory may not be representative of the participants&#39; typical everyday interactive behaviors due to the unfamiliar and artificial setting and the nature of the tasks imposed7.
Recent advances in mobile neuroimaging devices, such as electroencephalography (EEG) or functional near-infrared spectroscopy (fNIRS), alleviate these issues by removing the requirement for participants to remain physically connected to the recording computer. Thus, they allow us to measure participants&#39; brain activities while they interact freely in the classroom or in their homes8,9. The advantage of EEG compared to other neuroimaging techniques, such as fNIRS, is that it has an excellent temporal resolution, which makes it particularly suitable for investigating fast-paced social dynamics10. Yet, it comes with the caveat that the EEG signal is highly vulnerable to motion and other physiological and non-physiological artifacts11.
Despite this, the first studies have successfully implemented EEG hyperscanning set-ups in realistic environments and conditions. For instance, Dikker et al.12 measured the EEG signal of a group of students while they engaged in various classroom activities, including attending lectures, watching videos, and participating in group discussions. This study, along with other studies8,9, has predominantly utilized dry EEG electrodes to ease the process of conducting measurements in non-laboratory settings. Compared to wet electrodes, which require the application of conductive gel or paste, dry electrodes offer notable advantages in terms of usability. They have been shown to exhibit comparable performance to wet electrodes in adult populations and stationary conditions; however, their performance may decrease in motion-related scenarios due to increased impedance levels13.
Here, we present a working protocol to capture synchronized recordings from a low-density seven-channel liquid gel EEG system with a single lead electrocardiography (ECG) connected to the same wireless amplifier (sampling rate: 500 Hz)&#160;of infant-caregiver dyads in a home setting. While active electrodes were used for adults, passive electrodes were used instead for infants since the latter typically comes in the form of ring electrodes, thereby easing the process of gel application. Additionally, EEG-ECG recordings were synchronized to three cameras and microphones to capture the participants&#39; behaviors from different angles. In the study, 8-12-month-old infants and their caregivers engaged in a reading and play task while their EEG, ECG, and behaviors were recorded. To minimize the impact of excessive movement on EEG signal quality, the tasks were conducted in a table-top setting (e.g., utilizing the kitchen table and an infant highchair), requiring participants to remain seated throughout the interaction task. Caregivers were provided with three age-appropriate books and table-top toys (equipped with suction cups to prevent them from falling). They were instructed to read to their child for approximately 5 min, followed by a 10 min play session with the toys.
This protocol details the methods for collecting synchronized EEG-ECG, video, and audio data during the reading and play tasks. The overall procedure, however, is not specific to this research design but is appropriate for different populations (e.g., parent-child dyads, friend dyads) and experimental tasks. The method of synchronization of different data streams will be presented. Further, a basic EEG preprocessing pipeline based on Dikker et al.12 will be outlined, and EEG data retention rates and quality control metrics will be reported. Since the specific analytical choices depend on a variety of factors (such as task design, research questions, EEG montage), hyperscanning-EEG analysis will not be detailed further, but instead, the reader will be referred to existing guidelines and toolboxes (e.g.,14 for guidelines;15,16 for hyperscanning analysis toolboxes). Finally, the protocol discusses challenges and potential solutions for EEG-ECG hyperscanning in the home and other real-world settings.

تسليط الضوء على المؤلف: التقاط تفاعلات الرضع ومقدمي الرعاية من خلال جمع البيانات متعددة الوسائط المتزامنة

المسح المفرط لتخطيط كهربية الدماغ في المنزل للتفاعلات الاجتماعية بين الرضع ومقدمي الرعاية

Our research aims to study how social interactions between infants and caregivers can impact the infant's learning and development. We have developed a comprehensive hyperscanning protocol to capture synchronized EEG, ECG, and behavioral recordings from infant-caregiver dyads during interactive play tasks in the family home. Unlike prior hyperscanning protocols, which have primarily been conducted in laboratory environments, our experiment is conducted in the home setting.One key experimental challenge is balancing the need for standardization across home environments, which can limit ecological validity, with the flexibility required to promote naturalistic interactions between participants. This protocol offers unique insights into addressing potential issues and critical considerations regarding the experimental setup, tasks, and data collection in home settings. Additionally, our protocol provides a detailed demonstration of the design and setup of the multimodal synchronization of EEG, ECG, video and audio data into a single timeline.

تزامن تدفقات المستشعر لتخطيط كهربية الدماغ (EEG) ، تخطيط كهربية القلب (ECG) في الإعدادات الطبيعية لدراسات التفاعل بين مقدم الرعاية والطفل

بعد ترتيب الإعداد اللازم للمسح المفرط لتخطيط كهربية الدماغ في المنزل ، قم بإعداد مقدم الرعاية لهذا الإجراء. بعد ذلك ، قم بتوصيل جهاز استقبال الميكروفون بكاميرا الفيديو الخاصة به لمزامنة الفيديو والصوت تلقائيا. قم بتوصيل جهاز إرسال الميكروفون بياقة الجزء العلوي من مقدم الرعاية وسترة الرضيع.بعد التأكد من وضع الكاميرات لالتقاط إشارة ضوء LED من صندوق الزناد في الغرفة ، ابدأ التسجيل على جميع كاميرات الفيديو الثلاثة. ابدأ تسجيل EEG على الكمبيوتر المحمول ومكبر الصوت لكل من الرضيع ومقدم الرعاية. باستخدام مقبس 2.5 ملم ، قم بتوصيل كلا مكبرات الصوت بصندوق الزناد ، مما يضمن اتصالا محكما.قم بتنفيذ ضغطات طويلة على زر الضغط حيث لا يتضح الاختلاف الملحوظ في مظهر العلامة إلا بضغطات طويلة. تحقق من أن إشارة LED من صندوق التشغيل مرئية في تسجيلات جميع الكاميرات. تحقق من وجود علامات متزامنة في تسجيلات EEG المستمرة على الكمبيوتر المحمول.بعد ذلك ، افصل مكبرات الصوت عن إعداد صندوق التشغيل. أثناء إجراء المهام التجريبية ، تأكد من إخفاء جميع المجربين عن رؤية الرضيع طوال التجربة لتجنب الانحرافات. يجب أن يبقى أحد المجربين في مكان قريب مع أجهزة الكمبيوتر المحمولة للتسجيل للتدخل في حالة ظهور أي مشكلات في تدفق المستشعر.توقف عن التسجيل على كاميرات الفيديو وبرامج EEG ومكبر الصوت. ثم قم بإيقاف تشغيل مكبر الصوت وفصله عن الغطاء. بعد ذلك ، قم بإزالة أشرطة ECG والأقطاب الكهربائية بعناية ، بدءا من مقدم الرعاية.إذا لزم الأمر ، ساعد مقدم الرعاية في إزالة مخطط كهربية القلب للرضيع. ثم قم بفك الخطاف ونهايات حلقة الغطاء. انزع الغطاء للخلف وقم بقلبه من الداخل للخارج.نظف بقايا الجل من رأس الرضيع بمناديل مبللة للأطفال قبل الشروع في إزالة غطاء مقدم الرعاية.

Research

JoVE Journal

Neuroscience

Sensor Streams Synchronization of Electroencephalography (EEG), Electrocardiography (ECG) in Natural Settings for Caregiver-Child Interaction Studies

Real-Life EEG and ECG Synchronization in Infant-Caregiver Interactions

Home-Based EEG Hyperscanning for Infant-Caregiver Social Interactions

Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection

Prior hyperscanning studies that record the brain activities of caregivers and children concurrently have primarily been conducted within the confines of ...

Experiment Preparation at the Participant&#39;s Home for Home-Based Electroencephalography (EEG) Hyperscanning

التحضير للتجربة في منزل المشارك للمسح المفرط لتخطيط كهربية الدماغ المنزلي (EEG)

Electroencephalogram (EEG) and Electrocardiogram (ECG) Sensor Application for the Caregiver for Home-Based EEG Hyperscanning

تطبيق مستشعر مخطط كهربية الدماغ (EEG) ومستشعر مخطط كهربية القلب (ECG) لمقدم الرعاية للمسح المفرط لتخطيط كهربية الدماغ في المنزل