ק פיטרסון נתמכה על ידי תעודת סטודנט לדוקטורט מהמחלקה Bioengineering ומימון של חיל האוויר האמריקאי מעבדות מחקר. נ Ejaz נתמכה על ידי מלגת הלימודים לתואר שלישי מן החינוך הגבוה ועדת פקיסטן במימון חיל האוויר האמריקאי מעבדות מחקר.

<ol>
	<li>Chiappe, E. M., Seelig, J. D., Reiser, M. B., Jayaraman, V. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Walking+modulates+speed+sensitivity+in+Drosophila+motion+vision.">Walking modulates speed sensitivity in Drosophila motion vision.</a> Curr. Biol. 20, 1470-1475 (2010).</li><li>Franceschini, N., Snyder, A. W., Menzel, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Sampling+of+the+visual+environment+by+the+compound+eye+of+the+fly:+fundamentals+and+applications.">Sampling of the visual environment by the compound eye of the fly: fundamentals and applications.</a> Photoreceptor optics. , 98-125 (1975).</li><li>Karmeier, K., Tabor, R., Egelhaaf, M., Krapp, H. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Early+visual+experience+and+the+receptive-field+organization+of+optic+flow+processing+interneurons+in+the+fly+motion+pathway.">Early visual experience and the receptive-field organization of optic flow processing interneurons in the fly motion pathway.</a> Vis. Neurosci. 18, 1-8 (2001).</li><li>Krapp, H. G., Hengstenberg, B., Hengstenberg, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dendritic+structure+and+receptive-field+organization+of+optic+flow+processing+interneurons+in+the+fly.">Dendritic structure and receptive-field organization of optic flow processing interneurons in the fly.</a> Jour. of Neurophys. 79, 1902-1917 (1998).</li><li>Krapp, H. G., Hengstenberg, R., Egelhaaf, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Binocular+contributions+to+optic+flow+processing+in+the+fly+visual+system.">Binocular contributions to optic flow processing in the fly visual system.</a> Jour. of Neurophys. 85, 724-734 (2001).</li><li>Longden, K. D., Krapp, H. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Octopaminergic+modulation+of+temporal+frequency+coding+in+an+identified+optic-flow+processing+interneuron.">Octopaminergic modulation of temporal frequency coding in an identified optic-flow processing interneuron.</a> Frontiers in Systems Neuroscience. 4, 153-153 (2010).</li><li>Bender, J. A., Dickinson, M. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+comparison+of+visual+and+haltere-mediated+feedback+in+the+control+of+body+saccades+in+Drosophila+melanogaster.">A comparison of visual and haltere-mediated feedback in the control of body saccades in Drosophila melanogaster.</a> J. Exp. Bio. 209, 4597-4606 (2006).</li><li>Longden, K. D., Krapp, H. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=State-dependent+performance+of+optic+flow-processing+interneurons.">State-dependent performance of optic flow-processing interneurons.</a> J. Neurophysiol. 102, 3606-3618 (2009).</li><li>Maimon, G., Straw, A. D., Dickinson, M. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Active+flight+increases+the+gain+of+visual+motion+processing+in.">Active flight increases the gain of visual motion processing in.</a> 13, 393-399 (2010).</li><li>Petrovitz, R., Dahmen, H., Egelhaaf, M., Krapp, H. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Arrangement+of+optical+axes+and+spatial+resolution+in+the+compound+eye+of+the+female+blowfly+Calliphora.">Arrangement of optical axes and spatial resolution in the compound eye of the female blowfly Calliphora.</a> J Comp Physiol A. 186, 737-746 (2000).</li><li>Warzecha, A. K., Horstmann, W., Egelhaaf, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Temperature-dependence+of+neuronal+performance+in+the+motion+pathway+of+the+blowfly+Calliphora+Erythrocephala.">Temperature-dependence of neuronal performance in the motion pathway of the blowfly Calliphora Erythrocephala.</a> J Exp Biology. 202, 3161-3170 (1999).</li></ol>

<ol style=";text-align:right;direction:rtl"><li style=";text-align:right;direction:rtl"> טוס לנתיחה צריך להתבצע בזהירות ולוודא כי אנו מכוונים כראוי את הזבוב ביחס מסכי מחשב. </li><li style=";text-align:right;direction:rtl"> הפרדת קוצים מן נוירון H1 של דוקרנים מכל נוירונים אחרים כדי לקבל איתות טוב יחס רעש אשר לאחר מכן ניתן להשתמש כדי לשלוט על הרובוט אמין. </li><li style=";text-align:right;direction:rtl"> יש להקפיד כדי למנוע כל רקמה עצבית מהתייבשות במהלך הניסוי. </li><li style=";text-align:right;direction:rtl"> המצלמות מחוברות למחשבים באמצעות כבל Ethernet. יש להקפיד, כך שהם לא מעל הפצע במהלך הניסוי כמו זה ישפיע על הסיבוב של הרובוט. </li><li style=";text-align:right;direction:rtl"> כיום אנו באמצעות פעילות של ספייק H1 אחת ההתקנה משימה ייצוב בכיוון אחד בלבד של סיבוב לסבסב. אנחנו יכולים להוסיף אלקטרודה שנייה לקבל אותות H1 מימין ומשמאל כך שאנחנו יכולים ללמוד לשלוט אלגוריתמים ייצוב בשני הכיוונים של סיבוב לסבסב. </li><li style=";text-align:right;direction:rtl"> אנחנו יכולים להסיר את הזירה המכיל את פסים שחור לבן בכיוון אנכי ולהשתמש בסביבה מעבדה כמו גירוי חזותי לטוס. זה יאפשר לנו ללמוד לולאה סגורה ביצועים עם תמונות נטורליסטי. </li><li style=";text-align:right;direction:rtl"> הרובוט ניתן להסיר מהשולחן פרסה, ואפשרו לו להסתובב בסביבת מעבדה תוך שליטה לולאה סגורה. זה יאפשר לנו לחקור אלגוריתמים בקרה מעורב הימנעות התנגשות. </li><li style=";text-align:right;direction:rtl"> החוטים המחברים את המצלמות למחשבים ניתן להסיר על ידי יישום מערכת התמסורת האלחוטית, נותן לנו הגדרה רובוטית רסן. </li><li style=";text-align:right;direction:rtl"> מודד את הביצועים של אלגוריתמים שונים לשלוט ייתן לנו הבנה של האופן שבו אסטרטגיות שונות מסוגלים להתמודד עם אותות עצביים שאינם נייחים משתנה. ידע זה יכול להיות מיושם שונים במוח המכונה ממשקים קליניים ולא קליניים. </li><li style=";text-align:right;direction:rtl"> זו הגדרת הניסוי הוא הצעד הראשון לקראת הקלטת אותות עצביים של התנהגות בעלי חיים. המטרה שלנו היא המקום זבוב על הרובוט ולהשתמש הפעילות העצבית שלה עבור בקרת לולאה סגורה. ב ההתקנה כזה, נוכל להקליט הפעילות העצבית של הזבוב בזמן שהוא מקבל גירויים רב חושיים כתוצאה תנועה של הרובוט. </li><li style=";text-align:right;direction:rtl"> הקלטת אותות מתא אחד בלבד. בתצורת אנחנו צריכים אותך, התא המתאים ביותר יהיה H1-cell. בידוד התגובות של נוירון H1 של נוירונים אחרים עם שדות פתוחים דומה, למשל H2, חשוב לשמור אות טוב יחס רעש עבור ההקלטות עצביים. התגובות של H1 ו-H2 נוירונים יכולה להיות מופלה על ידי וציין כי H2 יש אופיינית נמוכה יותר ספונטני כלומר שיעור spiking מאשר נוירון H1. הנוירונים יכול גם להיות מופלה על בסיס של המורפולוגיה שלהם (קראפ et al. 2001). </li><li style=";text-align:right;direction:rtl"> המערכת שלנו מאפשרת לנו להשוות את הרווח לולאה סגורה מושגת על ידי ממשק שלנו לטוס רובוט במשימה ייצוב תמונה, ולהשוות את הביצועים שלו עם לולאה סגורה רווחי optomotor שנצפה בניסויים קודמים על זבובים (בנדר &amp; דיקינסון 2006, Warzecha ואח&#39; . 1996, הייזנברג &amp; Wolf, 1990). בנוסף, הוא מאפשר לנו לחקור המדינה תלויי שינויים בעיבוד מידע חזותי תחת לולאה סגורה התנאים (Chiappe et al. 2010, מימון ואח&#39;. 2010, Longden &amp; קראפ 2009, Longden &amp; קראפ 2010). </li></ol>

<ol style=";text-align:right;direction:rtl"><li style=";text-align:right;direction:rtl"> 1) High-Speed ​​CRT מציג (LG Studioworks 221U) </li><li style=";text-align:right;direction:rtl"> מצלמות מהירות גבוהה (Prosilica, GC640) </li><li style=";text-align:right;direction:rtl"> רובוט רציף (ASURO עם שינויים מותאמים אישית) </li><li style=";text-align:right;direction:rtl"> Bluetooth מודם סידורי (Bluesmirf) </li><li style=";text-align:right;direction:rtl"> שלב מיקרו דרייב (יישומי מערכות תנועה, ST5-SI) </li><li style=";text-align:right;direction:rtl"> מנוע צעד (Sanyo Denki, 103H6704-0140) </li><li style=";text-align:right;direction:rtl"> אלקטרודות טונגסטן (FH-co.com - קוד פריט - UEW SHG SE 3P1M) </li><li style=";text-align:right;direction:rtl"> תאיים מגבר (NPI EXT 10-2F) </li><li style=";text-align:right;direction:rtl"> Micromanipulator ממונע (Scientifica, PS-700-Z) </li><li style=";text-align:right;direction:rtl"> מיקרוסקופ סטריאו (לייקה, MZ95) </li></ol>

an experimental platform to study the closed-loop performance of brain-machine interfaces

האופי הלא נייחים השתנות של אותות עצביים היא בעיה בסיסית ממשק מוח מכונה. פיתחנו ממשק מוח מכונה להעריך את החוסן של שליטה חוקים שונים ליישם משימה לולאה סגורה ייצוב תמונה. ניצול היטב מאופיין לטוס במסלול visuomotor לנו להקליט את הפעילות החשמלית של תא עצב רגיש זיהה תנועה, H1, כדי לשלוט על סיבוב לסבסב של רובוט שני גלגלים. הרובוט מצויד 2 במהירות גבוהה, מצלמות וידאו מתן קלט תנועה חזותי להטיס להציב מול 2 צגי CRT המחשב. הפעילות של נוירון H1 מציין את כיוון המהירות היחסית של הסיבוב של הרובוט. הפעילות העצבית מסוננת והאכילה חזרה על ידי אמצעי שליטה יחסית ומידתית / הסתגלות למערכת ההיגוי של הרובוט. המטרה שלנו היא לבחון למטב את הביצועים של חוקים שונים תחת שליטה לולאה סגורה התנאים עבור יישום רחב יותר גם ממשקים אחרים במוח המכונה.

Watch this Scientific Journal Video about An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces at JoVE.com

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

אנו משתמשים בלולאה סגורה לטוס מכונת ממשק לחקור עקרונות כלליים השליטה העצבית.

פלטפורמה ניסויית לחקר ביצועים לולאה סגורה של המוח מכונת ממשקים

The non-stationary nature and variability of neuronal signals is a fundamental problem in brain-machine interfacing. We developed a brain-machine ...

an-experimental-platform-to-study-closed-loop-performance-brain

Research

JoVE Journal

Neuroscience

13.6K Views.  Imperial College London. אנו משתמשים בלולאה סגורה לטוס מכונת ממשק לחקור עקרונות כלליים השליטה העצבית.

Video: An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Simultaneous Scalp Electroencephalography (EEG), Electromyography (EMG), and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

Recent studies support the involvement of supraspinal networks in control of bipedal human walking. Part of this evidence encompasses studies, including our previous work, demonstrating that gait kinematics and limb coordination during treadmill walking can be inferred from the scalp electroencephalogram (EEG) with reasonably high decoding accuracies. These results provide impetus for development of non-invasive brain-machine-interface (BMI) systems for use in restoration and/or augmentation of gait- a primary goal of rehabilitation research. To date, studies examining EEG decoding of activity during gait have been limited to treadmill walking in a controlled environment. However, to be practically viable a BMI system must be applicable for use in everyday locomotor tasks such as over ground walking and turning. Here, we present a novel protocol for non-invasive collection of brain activity (EEG), muscle activity (electromyography (EMG)), and whole-body kinematic data (head, torso, and limb trajectories) during both treadmill and over ground walking tasks. By collecting these data in the uncontrolled environment insight can be gained regarding the feasibility of decoding unconstrained gait and surface EMG from scalp EEG.

Simultaneous Scalp Electroencephalography EEG, Electromyography EMG, and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

Development of an effective brain-machine-interface (BMI) system for restoration and rehabilitation of bipedal locomotion requires accurate decoding of user's intent. Here we present a novel experimental protocol and data collection technique for simultaneous non-invasive acquisition of neural activity, muscle activity, and whole-body kinematics during various locomotion tasks and conditions.

Electroencephalography סימולטני קרקפת (EEG), (EMG), והקלטת אינרציה מגזרי כל גוף לMulti-מודאלית עצבית פענוח

Recent  studies support the involvement of supraspinal networks in control of bipedal  human walking. Part of this evidence  encompasses studies, ...

Behavior

Functional Near Infrared Spectroscopy of the Sensory and Motor Brain Regions with Simultaneous Kinematic and EMG Monitoring During Motor Tasks

There are several advantages that functional near-infrared spectroscopy (fNIRS) presents in the study of the neural control of human movement. It is relatively flexible with respect to participant positioning and allows for some head movements during tasks. Additionally, it is inexpensive, light weight, and portable, with very few contraindications to its use. This presents a unique opportunity to study functional brain activity during motor tasks in individuals who are typically developing, as well as those with movement disorders, such as cerebral palsy. An additional consideration when studying movement disorders, however, is the quality of actual movements performed and the potential for additional, unintended movements. Therefore, concurrent monitoring of both blood flow changes in the brain and actual movements of the body during testing is required for appropriate interpretation of fNIRS results. Here, we show a protocol for the combination of fNIRS with muscle and kinematic monitoring during motor tasks. We explore gait, a unilateral multi-joint movement (cycling), and two unilateral single-joint movements (isolated ankle dorsiflexion, and isolated hand squeezing). The techniques presented can be useful in studying both typical and atypical motor control, and can be modified to investigate a broad range of tasks and scientific questions.

Monitoring brain activity during upright motor tasks is of great value when investigating the neural source of movement disorders. Here, we demonstrate a protocol that combines functional near infrared spectroscopy with continuous monitoring of muscle and kinematic activity during 4 types of motor tasks.

קרוב פונקציונלי אינפרא אדום ספקטרוסקופיה של אזורים חושיים ומוטורי במוח עם סימולטני Kinematic וניטור EMG במהלך משימות מוטוריות

There are several advantages that functional near-infrared spectroscopy (fNIRS) presents in the study of the neural control of human movement. It is ...

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

To enable intuitive operation of powered artificial legs, an interface between user and prosthesis that can recognize the user's movement intent is desired. A novel neural-machine interface (NMI) based on neuromuscular-mechanical fusion developed in our previous study has demonstrated a great potential to accurately identify the intended movement of transfemoral amputees. However, this interface has not yet been integrated with a powered prosthetic leg for true neural control. This study aimed to report (1) a flexible platform to implement and optimize neural control of powered lower limb prosthesis and (2) an experimental setup and protocol to evaluate neural prosthesis control on patients with lower limb amputations. First a platform based on a PC and a visual programming environment were developed to implement the prosthesis control algorithms, including NMI training algorithm, NMI online testing algorithm, and intrinsic control algorithm. To demonstrate the function of this platform, in this study the NMI based on neuromuscular-mechanical fusion was hierarchically integrated with intrinsic control of a prototypical transfemoral prosthesis. One patient with a unilateral transfemoral amputation was recruited to evaluate our implemented neural controller when performing activities, such as standing, level-ground walking, ramp ascent, and ramp descent continuously in the laboratory. A novel experimental setup and protocol were developed in order to test the new prosthesis control safely and efficiently. The presented proof-of-concept platform and experimental setup and protocol could aid the future development and application of neurally-controlled powered artificial legs.

Neural-machine interfaces (NMI) have been developed to identify the user's locomotion mode. These NMIs are potentially useful for neural control of powered artificial legs, but have not been fully demonstrated. This paper presented (1) our designed engineering platform for easy implementation and development of neural control for powered lower limb prostheses and (2) an experimental setup and protocol in a laboratory environment to evaluate neurally-controlled artificial legs on patients with lower limb amputations safely and efficiently.

פלטפורמה להנדסה ולפרוטוקול ניסויי לעיצוב והערכה של Transfemoral תותב מופעל בשליטה עצבית

To enable intuitive operation of powered artificial legs, an interface between user and prosthesis that can recognize the user's movement intent is ...

Bioengineering

Recording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping

Neuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), magnetoencephalography or functional magnetic-resonance imaging. These techniques have either inherently low temporal or low spatial resolution, and suffer from low signal-to-noise ratio and/or poor high-frequency sensitivity. Thus, they are suboptimal for exploring the short-lived spatio-temporal dynamics of many of the underlying brain processes. In contrast, the invasive technique of electrocorticography (ECoG) provides brain signals that have an exceptionally high signal-to-noise ratio, less susceptibility to artifacts than EEG, and a high spatial and temporal resolution (i.e., &lt;1 cm/&lt;1 millisecond, respectively). ECoG involves measurement of electrical brain signals using electrodes that are implanted subdurally on the surface of the brain. Recent studies have shown that ECoG amplitudes in certain frequency bands carry substantial information about task-related activity, such as motor execution and planning1, auditory processing2 and visual-spatial attention3. Most of this information is captured in the high gamma range (around 70-110 Hz). Thus, gamma activity has been proposed as a robust and general indicator of local cortical function1-5. ECoG can also reveal functional connectivity and resolve finer task-related spatial-temporal dynamics, thereby advancing our understanding of large-scale cortical processes. It has especially proven useful for advancing brain-computer interfacing (BCI) technology for decoding a user's intentions to enhance or improve communication6 and control7. Nevertheless, human ECoG data are often hard to obtain because of the risks and limitations of the invasive procedures involved, and the need to record within the constraints of clinical settings. Still, clinical monitoring to localize epileptic foci offers a unique and valuable opportunity to collect human ECoG data. We describe our methods for collecting recording ECoG, and demonstrate how to use these signals for important real-time applications such as clinical mapping and brain-computer interfacing. Our example uses the BCI2000 software platform8,9 and the SIGFRIED10 method, an application for real-time mapping of brain functions. This procedure yields information that clinicians can subsequently use to guide the complex and laborious process of functional mapping by electrical stimulation.
Prerequisites and Planning:
Patients with drug-resistant partial epilepsy may be candidates for resective surgery of an epileptic focus to minimize the frequency of seizures. Prior to resection, the patients undergo monitoring using subdural electrodes for two purposes: first, to localize the epileptic focus, and second, to identify nearby critical brain areas (i.e., eloquent cortex) where resection could result in long-term functional deficits. To implant electrodes, a craniotomy is performed to open the skull. Then, electrode grids and/or strips are placed on the cortex, usually beneath the dura. A typical grid has a set of 8 x 8 platinum-iridium electrodes of 4 mm diameter (2.3 mm exposed surface) embedded in silicon with an inter-electrode distance of 1cm. A strip typically contains 4 or 6 such electrodes in a single line. The locations for these grids/strips are planned by a team of neurologists and neurosurgeons, and are based on previous EEG monitoring, on a structural MRI of the patient's brain, and on relevant factors of the patient's history. Continuous recording over a period of 5-12 days serves to localize epileptic foci, and electrical stimulation via the implanted electrodes allows clinicians to map eloquent cortex. At the end of the monitoring period, explantation of the electrodes and therapeutic resection are performed together in one procedure.
In addition to its primary clinical purpose, invasive monitoring also provides a unique opportunity to acquire human ECoG data for neuroscientific research. The decision to include a prospective patient in the research is based on the planned location of their electrodes, on the patient's performance scores on neuropsychological assessments, and on their informed consent, which is predicated on their understanding that participation in research is optional and is not related to their treatment. As with all research involving human subjects, the research protocol must be approved by the hospital's institutional review board. The decision to perform individual experimental tasks is made day-by-day, and is contingent on the patient's endurance and willingness to participate. Some or all of the experiments may be prevented by problems with the clinical state of the patient, such as post-operative facial swelling, temporary aphasia, frequent seizures, post-ictal fatigue and confusion, and more general pain or discomfort.
At the Epilepsy Monitoring Unit at Albany Medical Center in Albany, New York, clinical monitoring is implemented around the clock using a 192-channel Nihon-Kohden Neurofax monitoring system. Research recordings are made in collaboration with the Wadsworth Center of the New York State Department of Health in Albany. Signals from the ECoG electrodes are fed simultaneously to the research and the clinical systems via splitter connectors. To ensure that the clinical and research systems do not interfere with each other, the two systems typically use separate grounds. In fact, an epidural strip of electrodes is sometimes implanted to provide a ground for the clinical system. Whether research or clinical recording system, the grounding electrode is chosen to be distant from the predicted epileptic focus and from cortical areas of interest for the research. Our research system consists of eight synchronized 16-channel g.USBamp amplifier/digitizer units (g.tec, Graz, Austria). These were chosen because they are safety-rated and FDA-approved for invasive recordings, they have a very low noise-floor in the high-frequency range in which the signals of interest are found, and they come with an SDK that allows them to be integrated with custom-written research software. In order to capture the high-gamma signal accurately, we acquire signals at 1200Hz sampling rate-considerably higher than that of the typical EEG experiment or that of many clinical monitoring systems. A built-in low-pass filter automatically prevents aliasing of signals higher than the digitizer can capture. The patient's eye gaze is tracked using a monitor with a built-in Tobii T-60 eye-tracking system (Tobii Tech., Stockholm, Sweden). Additional accessories such as joystick, bluetooth Wiimote (Nintendo Co.), data-glove (5th Dimension Technologies), keyboard, microphone, headphones, or video camera are connected depending on the requirements of the particular experiment.
Data collection, stimulus presentation, synchronization with the different input/output accessories, and real-time analysis and visualization are accomplished using our BCI2000 software8,9. BCI2000 is a freely available general-purpose software system for real-time biosignal data acquisition, processing and feedback. It includes an array of pre-built modules that can be flexibly configured for many different purposes, and that can be extended by researchers' own code in C++, MATLAB or Python. BCI2000 consists of four modules that communicate with each other via a network-capable protocol: a Source module that handles the acquisition of brain signals from one of 19 different hardware systems from different manufacturers; a Signal Processing module that extracts relevant ECoG features and translates them into output signals; an Application module that delivers stimuli and feedback to the subject; and the Operator module that provides a graphical interface to the investigator.
A number of different experiments may be conducted with any given patient. The priority of experiments will be determined by the location of the particular patient's electrodes. However, we usually begin our experimentation using the SIGFRIED (SIGnal modeling For Realtime Identification and Event Detection) mapping method, which detects and displays significant task-related activity in real time. The resulting functional map allows us to further tailor subsequent experimental protocols and may also prove as a useful starting point for traditional mapping by electrocortical stimulation (ECS).
Although ECS mapping remains the gold standard for predicting the clinical outcome of resection, the process of ECS mapping is time consuming and also has other problems, such as after-discharges or seizures. Thus, a passive functional mapping technique may prove valuable in providing an initial estimate of the locus of eloquent cortex, which may then be confirmed and refined by ECS. The results from our passive SIGFRIED mapping technique have been shown to exhibit substantial concurrence with the results derived using ECS mapping10.
The protocol described in this paper establishes a general methodology for gathering human ECoG data, before proceeding to illustrate how experiments can be initiated using the BCI2000 software platform. Finally, as a specific example, we describe how to perform passive functional mapping using the BCI2000-based SIGFRIED system.

Recording Human Electrocorticographic ECoG Signals for Neuroscientific Research and Real-time Functional Cortical Mapping

We present a method for collecting electrocorticographic signals for research purposes from humans who are undergoing invasive epilepsy monitoring. We show how to use the BCI2000 software platform for data collection, signal processing and stimulus presentation. Specifically, we demonstrate SIGFRIED, a BCI2000-based tool for real-time functional brain mapping.

הקלטת אדם Electrocorticographic (ECOG) אותות לחקר Neuroscientific בזמן אמת מיפוי קורטיקלי פונקציונלית

Neuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), ...

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

The fields that develop methods for sensory substitution and sensory augmentation have aimed to control external goals using signals from the central nervous systems (CNS). Less frequent however, are protocols that update external signals self-generated by interactive bodies in motion. There is a paucity of methods that combine the body-heart-brain biorhythms of one moving agent to steer those of another moving agent during dyadic exchange. Part of the challenge to accomplish such a feat has been the complexity of the setup using multimodal bio-signals with different physical units, disparate time scales and variable sampling frequencies.
In recent years, the advent of wearable bio-sensors that can non-invasively harness multiple signals in tandem, has opened the possibility to re-parameterize and update the peripheral signals of interacting dyads, in addition to improving brain- and/or body-machine interfaces. Here we present a co-adaptive interface that updates efferent somatic-motor output (including kinematics and heart rate) using biosensors; parameterizes the stochastic bio-signals, sonifies this output, and feeds it back in re-parameterized form as visuo/audio-kinesthetic reafferent input. We illustrate the methods using two types of interactions, one involving two humans and another involving a human and its avatar interacting in near real time. We discuss the new methods in the context of possible new ways to measure the influences of external input on internal somatic-sensory-motor control.

We present protocols and methods of analyses to build co-adaptive interfaces that stream, parameterize, analyze, and modify human body and heart signals in close-loop. This setup interfaces signals derived from the peripheral and central nervous systems of the person with external sensory inputs to help track biophysical change.

בקרת Proxy בזמן אמת של אותות היקפיים עם פרמטרים מחדש באמצעות ממשק לולאה קרובה

The fields that develop methods for sensory substitution and sensory augmentation have aimed to control external goals using signals from the central ...

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation of a given stimulus might be dependent on context and history. If this is actually the case, bi-directional interactions between the brain (or if need be a reduced model of it) and sensory-motor system can shed a light on how encoding and decoding of information is performed. Here an experimental system is introduced and described in which the activity of a neuronal element (i.e., a network of neurons extracted from embryonic mammalian hippocampi) is given context and used to control the movement of an artificial agent, while environmental information is fed back to the culture as a sequence of electrical stimuli. This architecture allows a quick selection of diverse encoding, decoding, and learning algorithms to test different hypotheses on the computational properties of neuronal networks.

In this paper, an experimental framework to perform closed-loop experiments is presented, in which information processing (i.e., coding and decoding) and learning of neuronal assemblies are studied during the continuous interaction with a robotic body.

ניסויי נוירו-רובוטית לולאה סגורה כדי לבדוק את מאפיינים חישובית של רשתות עצבי

Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation ...

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

The present work focuses on how to build a wearable brain-computer interface (BCI). BCIs are a novel means of human-computer interaction that relies on direct measurements of brain signals to assist both people with disabilities and those who are able-bodied. Application examples include robotic control, industrial inspection, and neurorehabilitation. Notably, recent studies have shown that steady-state visually evoked potentials (SSVEPs) are particularly suited for communication and control applications, and efforts are currently being made to bring BCI technology into daily life. To achieve this aim, the final system must rely on wearable, portable, and low-cost instrumentation. In exploiting SSVEPs, a flickering visual stimulus with fixed frequencies is required. Thus, in considering daily-life constraints, the possibility to provide visual stimuli by means of smart glasses was explored in this study. Moreover, to detect the elicited potentials, a commercial device for electroencephalography (EEG) was considered. This consists of a single differential channel with dry electrodes (no conductive gel), thus achieving the utmost wearability and portability. In such a BCI, the user can interact with the smart glasses by merely staring at icons appearing on the display. Upon this simple principle, a user-friendly, low-cost BCI was built by integrating extended reality (XR) glasses with a commercially available EEG device. The functionality of this wearable XR-BCI was examined with an experimental campaign involving 20 subjects. The classification accuracy was between 80%-95% on average depending on the stimulation time. Given these results, the system can be used as a human-machine interface for industrial inspection but also for rehabilitation in ADHD and autism.

This paper discusses how to build a brain-computer interface by relying on consumer-grade equipment and steady-state visually evoked potentials. For this, a single-channel electroencephalograph exploiting dry electrodes was integrated with augmented reality glasses for stimuli presentation and output data visualization. The final system was non-invasive, wearable, and portable.

ממשק מוח-מחשב לביש חד-ערוצי ולא פולשני לתעשייה ולשירותי בריאות

The present work focuses on how to build a wearable brain-computer interface (BCI). BCIs are a novel means of human-computer interaction that relies on ...

Engineering

Assessment and Communication for People with Disorders of Consciousness

In this experiment, we demonstrate a suite of hybrid Brain-Computer Interface (BCI)-based paradigms that are designed for two applications: assessing the level of consciousness of people unable to provide motor response and, in a second stage, establishing a communication channel for these people that enables them to answer questions with either &#39;yes&#39; or &#39;no&#39;. The suite of paradigms is designed to test basic responses in the first step and to continue to more comprehensive tasks if the first tests are successful. The latter tasks require more cognitive functions, but they could provide communication, which is not possible with the basic tests. All assessment tests produce accuracy plots that show whether the algorithms were able to detect the patient&#39;s brain&#39;s response to the given tasks. If the accuracy level is beyond the significance level, we assume that the subject understood the task and was able to follow the sequence of commands presented via earphones to the subject. The tasks require users to concentrate on certain stimuli or to imagine moving either the left or right hand. All tasks are designed around the assumption that the user is unable to use the visual modality, and thus, all stimuli presented to the user (including instructions, cues, and feedback) are auditory or tactile.

With this experiment, one might be able to detect consciousness in people with disorders of consciousness. Furthermore, the approach can create a simple communication channel that enables people to give simple YES/NO answers to questions.

הערכה ותקשורת לאנשים עם הפרעות תודעה

In this experiment, we demonstrate a suite of hybrid Brain-Computer Interface (BCI)-based paradigms that are designed for two applications: assessing the ...

Rodent Behavioral Testing to Assess Functional Deficits Caused by Microelectrode Implantation in the Rat Motor Cortex

Medical devices implanted in the brain hold tremendous potential. As part of a Brain Machine Interface (BMI) system, intracortical microelectrodes demonstrate the ability to record action potentials from individual or small groups of neurons. Such recorded signals have successfully been used to allow patients to interface with or control&#160;computers, robotic limbs, and their own limbs. However, previous animal studies have shown that a microelectrode implantation in the brain not only damages the surrounding tissue but can also result in functional deficits. Here, we discuss a series of behavioral tests to quantify potential motor impairments following the implantation of intracortical microelectrodes into the motor cortex of a rat. The methods for open field grid, ladder crossing, and grip strength testing provide valuable information regarding the potential complications resulting from a microelectrode implantation. The results of the behavioral testing are correlated with endpoint histology, providing additional information on the pathological outcomes and impacts of this procedure on the adjacent tissue.

We have shown that a microelectrode implantation in the motor cortex of rats causes immediate and lasting motor deficits. The methods proposed herein outline a microelectrode implantation surgery and three rodent behavioral tasks to elucidate potential changes in the fine or gross motor function due to implantation-caused damage to the motor cortex.

מכרסם ההתנהגותי בוחן להערכת תפקודית גירעונות הנגרמת על ידי ההשרשה Microelectrode של קליפת המוח המוטורית עכברוש

Medical devices implanted in the brain hold tremendous potential. As part of a Brain Machine Interface (BMI) system, intracortical microelectrodes ...

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Feedback control theory has been extensively implemented to theoretically model human sensorimotor control. However, experimental platforms capable of manipulating important components of multiple feedback loops lack development. This paper describes WheelCon, an open-source platform aimed at resolving such insufficiencies. Using only a computer, a standard display, and inexpensive gaming steering wheel equipped with a force feedback motor, WheelCon safely simulates the canonical sensorimotor task of riding a mountain bike down a steep, twisting, bumpy trail. The platform provides flexibility, as will be demonstrated in the demos provided, so that researchers may manipulate the disturbances, delay, and quantization (data rate) in the layered feedback loops, including a high-level advanced plan layer and a low-level delayed reflex layer. In this paper, we illustrate WheelCon&#39;s graphical user interface (GUI), the input and output of existing demos, and how to design new games. In addition, we present the basic feedback model and the experimental results from the demo games, which align well with the model&#39;s prediction. The WheelCon platform can be downloaded at https://github.com/Doyle-Lab/WheelCon. In short, the platform is featured to be cheap, simple to use, and flexible to program for effective sensorimotor neuroscience research and control engineering education.

WheelCon is a novel, free and open-source platform to design video games that noninvasively simulates mountain biking down a steep, twisting, bumpy trail. It contains components presenting in human sensorimotor control (delay, quantization, noise, disturbance, and multiple feedback loops) and allows researchers to study the layered architecture in sensorimotor control.

גלגלים: בקרת גלגל המשחקים מבוססי פלטפורמת המשחק ללמוד Sensorimotor האדם בקרת

Feedback control theory has been extensively implemented to theoretically model human sensorimotor control. However, experimental platforms capable of ...