We thank all patients for their participation. This research was supported by the Rockefeller Neuroscience Institute, the Autism Science Foundation and the Dana Foundation (to S.W.), an NSF CAREER award (1554105 to U.R.), and the NIH (R01MH110831 and U01NS098961 to U.R.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.&#160;We thank James Lee, Erika Quan, and the staff of the Cedars-Sinai Simulation Center for their help in producing the demonstration video.

1. Participants
<ol>
	<li>Recruit neurosurgical patients with intractable epilepsy who are undergoing placement of intracranial electrodes to localize their epileptic seizures.</li>
	<li>Insert depth electrodes with embedded microwires into all clinically indicated target locations, which typically include a subset of amygdala, hippocampus, anterior cingulate cortex and pre-supplementary motor area. See details for implantation in our previous protocol2.</li>
	<li>Once the patient returns to the...

<ol>
	<li>Fried, I., Rutishauser, U., Cerf, M., Kreiman, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Single Neuron Studies of the Human Brain: Probing Cognition. , (2014).</li><li>Minxha, J., Mamelak, A. N., Rutishauser, U., Sillitoe, R. V. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Surgical+and+Electrophysiological+Techniques+for+Single-Neuron+Recordings+in+Human+Epilepsy+Patients.">Surgical and Electrophysiological Techniques for Single-Neuron Recordings in Human Epilepsy Patients.</a> Extracellular Recording Approaches. , 267-293 (2018).</li><li>Rutishauser, U., Mamelak, A. N., Schuman, E. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Single-Trial+Learning+of+Novel+Stimuli+by+Individual+Neurons+of+the+Human+Hippocampus-Amygdala+Complex.">Single-Trial Learning of Novel Stimuli by Individual Neurons of the Human Hippocampus-Amygdala Complex.</a> Neuron. 49, 805-813 (2006).</li><li>Rutishauser, U., Ross, I. B., Mamelak, A. N., Schuman, E. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Human+memory+strength+is+predicted+by+theta-frequency+phase-locking+of+single+neurons.">Human memory strength is predicted by theta-frequency phase-locking of single neurons.</a> Nature. 464, 903-907 (2010).</li><li>Wang, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neurons+in+the+human+amygdala+selective+for+perceived+emotion.">Neurons in the human amygdala selective for perceived emotion.</a> Proceedings of the National Academy of Sciences. 111, E3110-E3119 (2014).</li><li>Wang, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+human+amygdala+parametrically+encodes+the+intensity+of+specific+facial+emotions+and+their+categorical+ambiguity.">The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity.</a> Nature Communications. 8, 14821 (2017).</li><li>Minxha, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Fixations+Gate+Species-Specific+Responses+to+Free+Viewing+of+Faces+in+the+Human+and+Macaque+Amygdala.">Fixations Gate Species-Specific Responses to Free Viewing of Faces in the Human and Macaque Amygdala.</a> Cell Reports. 18, 878-891 (2017).</li><li>Wang, S., Mamelak, A. N., Adolphs, R., Rutishauser, U. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Encoding+of+Target+Detection+during+Visual+Search+by+Single+Neurons+in+the+Human+Brain.">Encoding of Target Detection during Visual Search by Single Neurons in the Human Brain.</a> Current Biology. 28, 2058-2069 (2018).</li><li>Holmqvist, K., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Eye tracking: A comprehensive guide to methods and measures. , (2011).</li><li>Liversedge, S. P., Findlay, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Saccadic+eye+movements+and+cognition.">Saccadic eye movements and cognition.</a> Trends in Cognitive Sciences. 4, 6-14 (2000).</li><li>Rehder, B., Hoffman, A. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Eyetracking+and+selective+attention+in+category+learning.">Eyetracking and selective attention in category learning.</a> Cognitive Psychology. 51, 1-41 (2005).</li><li>Blair, M. R., Watson, M. R., Walshe, R. C., Maj, F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Extremely+selective+attention:+Eye-tracking+studies+of+the+dynamic+allocation+of+attention+to+stimulus+features+in+categorization.">Extremely selective attention: Eye-tracking studies of the dynamic allocation of attention to stimulus features in categorization.</a> Journal of Experimental Psychology: Learning, Memory, and Cognition. 35, 1196 (2009).</li><li>Rutishauser, U., Koch, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Probabilistic+modeling+of+eye+movement+data+during+conjunction+search+via+feature-based+attention.">Probabilistic modeling of eye movement data during conjunction search via feature-based attention.</a> Journal of Vision. 7, (2007).</li><li>Wang, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Autism+spectrum+disorder,+but+not+amygdala+lesions,+impairs+social+attention+in+visual+search.">Autism spectrum disorder, but not amygdala lesions, impairs social attention in visual search.</a> Neuropsychologia. 63, 259-274 (2014).</li><li>Wang, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Atypical+Visual+Saliency+in+Autism+Spectrum+Disorder+Quantified+through+Model-Based+Eye+Tracking.">Atypical Visual Saliency in Autism Spectrum Disorder Quantified through Model-Based Eye Tracking.</a> Neuron. 88, 604-616 (2015).</li><li>Wang, S., Tsuchiya, N., New, J., Hurlemann, R., Adolphs, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Preferential+attention+to+animals+and+people+is+independent+of+the+amygdala.">Preferential attention to animals and people is independent of the amygdala.</a> Social Cognitive and Affective Neuroscience. 10, 371-380 (2015).</li><li>Fried, I., MacDonald, K. A., Wilson, C. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Single+Neuron+Activity+in+Human+Hippocampus+and+Amygdala+during+Recognition+of+Faces+and+Objects.">Single Neuron Activity in Human Hippocampus and Amygdala during Recognition of Faces and Objects.</a> Neuron. 18, 753-765 (1997).</li><li>Kreiman, G., Koch, C., Fried, I. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Category-specific+visual+responses+of+single+neurons+in+the+human+medial+temporal+lobe.">Category-specific visual responses of single neurons in the human medial temporal lobe.</a> Nature Neuroscience. 3, 946-953 (2000).</li><li>Squire, L. R., Stark, C. E. L., Clark, R. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Medial+Temporal+Lobe.">The Medial Temporal Lobe.</a> Annual Review of Neuroscience. 27, 279-306 (2004).</li><li>Chelazzi, L., Miller, E. K., Duncan, J., Desimone, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+neural+basis+for+visual+search+in+inferior+temporal+cortex.">A neural basis for visual search in inferior temporal cortex.</a> Nature. 363, 345-347 (1993).</li><li>Schall, J. D., Hanes, D. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neural+basis+of+saccade+target+selection+in+frontal+eye+field+during+visual+search.">Neural basis of saccade target selection in frontal eye field during visual search.</a> Nature. 366, 467-469 (1993).</li><li>Wolfe, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=What+Can+1+Million+Trials+Tell+Us+About+Visual+Search?.">What Can 1 Million Trials Tell Us About Visual Search?.</a> Psychological Science. 9, 33-39 (1998).</li><li>Wolfe, J. M., Horowitz, T. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=What+attributes+guide+the+deployment+of+visual+attention+and+how+do+they+do+it?.">What attributes guide the deployment of visual attention and how do they do it?.</a> Nature Review Neuroscience. 5, 495-501 (2004).</li><li>Sheinberg, D. L., Logothetis, N. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Noticing+Familiar+Objects+in+Real+World+Scenes:+The+Role+of+Temporal+Cortical+Neurons+in+Natural+Vision.">Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision.</a> The Journal of Neuroscience. 21, 1340-1350 (2001).</li><li>Bichot, N. P., Rossi, A. F., Desimone, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Parallel+and+Serial+Neural+Mechanisms+for+Visual+Search+in+Macaque+Area+V4.">Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4.</a> Science. 308, 529-534 (2005).</li><li>Rutishauser, U., Schuman, E. M., Mamelak, A. N. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Online+detection+and+sorting+of+extracellularly+recorded+action+potentials+in+human+medial+temporal+lobe+recordings,+in+vivo.">Online detection and sorting of extracellularly recorded action potentials in human medial temporal lobe recordings, in vivo.</a> Journal of Neuroscience Methods. 154, 204-224 (2006).</li></ol>

In this protocol, we described how to employ single-neuron recordings with concurrent eye tracking and described how we used this method to identify target neurons in the human MTL.
The setup involves three computers: one executing the task (stimulus computer), one running the eye tracker, and one running the acquisition system. To synchronize between the three systems, the parallel port is used to send TTL triggers from the stimulus computer to the electrophysiology system (<strong class="xfi...

Human single-neuron recordings are a unique and powerful tool to explore the function of the human brain with extraordinary spatial and temporal resolution1. Recently, single-neuron recordings have gained wide use in the field of cognitive neuroscience because they permit the direct investigation of cognitive processes central to human cognition. These recordings are made possible by the clinical need to determine the position of epileptic foci, for which depth electrodes are temporarily implanted into the brains of patients with suspected focal epilepsy. With this setup, single-neuron recordings can be obtained using microwires protruding from the tip of the hybrid depth electrode (a detailed description of the surgical methodology involved in the insertion of hybrid depth electrodes is provided in the previous protocol2). Among others, this method has been used to study human memory3,4, emotion5,6, and attention7,8.
Eye tracking measures gaze position and eye movements (fixations and saccades) during cognitive tasks. Video-based eye trackers typically use the corneal reflection and the center of the pupil as features to track over time9. Eye tracking is an important method to study visual attention because the gaze location indicates the focus of attention during most natural behaviors10,11,12. Eye tracking has been used extensively to study visual attention in healthy individuals13 and neurological populations14,15,16.
While both single-neuron recordings and eye tracking are individually used extensively in humans, few studies have used both simultaneously. As a result, it still remains largely unknown how neurons in the human brain respond to eye movements and/or whether they are sensitive to the currently fixated stimulus. This is in contrast to studies with macaques, where eye-tracking with simultaneous single-neuron recordings has become a standard tool. In order to directly investigate the neuronal response to eye movements, we combined human single-neuron recordings and eye tracking. Here we describe the protocol to conduct such experiments and then illustrate the results through a concrete example.
Despite the established role of the human medial temporal lobe (MTL) in both object representation17,18 and memory3,19, it remains largely unknown whether MTL neurons are modulated as a function of top-down attention to behaviorally relevant goals. Studying such neurons is important to start to understand how goal-relevant information influences bottom-up visual processes. Here, we demonstrate the utility of eye tracking while recording neurons using guided visual search, a well-known paradigm to study goal-directed behavior20,21,22,23,24,25. Using this method, we recently described a class of neurons called target neurons, which signals whether the currently attended stimulus is the goal of an ongoing search8. In the below, we present the study protocol needed to reproduce this previous scientific study. Note that along this example, the protocol can easily be adjusted to study an arbitrary visual attention task.

<table>
	<tbody>
		<tr>
			<td>Cedrus Response Box</td>
			<td>Cedrus (https://cedrus.com/)</td>
			<td>RB-844</td>
			<td>Button box</td>
		</tr>
		<tr>
			<td>Dell Laptop</td>
			<td>Dell (https://dell.com)</td>
			<td>Precision 7520</td>
			<td>Stimulus Computer</td>
		</tr>
		<tr>
			<td>EyeLink Eye Tracker</td>
			<td>SR Research (https://www.sr-research.com)</td>
			<td>1000 Plus Remote with laptop host computer and LCD arm mount</td>
			<td>Eye tracking</td>
		</tr>
		<tr>
			<td>MATLAB</td>
			<td>MathWorks Inc</td>
			<td>R2016a (RRID: SCR_001622)</td>
			<td>Data analysis</td>
		</tr>
		<tr>
			<td>Neuralynx Neurophysiology System</td>
			<td>Neuralynx (https://neuralynx.com)</td>
			<td>ATLAS 128</td>
			<td>Electrophysiology</td>
		</tr>
		<tr>
			<td>Osort</td>
			<td>Open source</td>
			<td>v4.1 (RRID: SCR_015869)</td>
			<td>Spike sorting algorithm</td>
		</tr>
		<tr>
			<td>Psychophysics Toolbx</td>
			<td>Open source</td>
			<td>PTB3 ( RRID: SCR_002881)</td>
			<td>Matlab toolbox to implement psychophysical experiments</td>
		</tr>
	</tbody>
</table>

simultaneous eye tracking and single-neuron recordings in human epilepsy patients

Intracranial recordings from patients with intractable epilepsy provide a unique opportunity to study the activity of individual human neurons during active behavior. An important tool for quantifying behavior is eye tracking, which is an indispensable tool for studying visual attention. However, eye tracking is challenging to use concurrently with invasive electrophysiology and this approach has consequently been little used. Here, we present a proven experimental protocol to conduct single-neuron recordings with simultaneous eye tracking in humans. We describe how the systems are connected and the optimal settings to record neurons and eye movements. To illustrate the utility of this method, we summarize results that were made possible by this setup. This data shows how using eye tracking in a memory-guided visual search task allowed us to describe a new class of neurons called target neurons, whose response was reflective of top-down attention to the current search target. Lastly, we discuss the significance and solutions to potential problems of this setup. Together, our protocol and results suggest that single-neuron recordings with simultaneous eye tracking in humans are an effective method to study human brain function. It provides a key missing link between animal neurophysiology and human cognitive neuroscience.

To illustrate the usage of the above-mentioned method, we next briefly describe a use-case that we recently published8. We recorded 228 single neurons from the human medial temporal lobe (MTL; amygdala and hippocampus) while the patients were performing a visual search task (Figure 3A, B). During this task, we investigated whether the activity of neurons differentiated between fixations on targets and distractors.
...

Watch this Scientific Journal Video about Simultaneous Eye Tracking and Single-Neuron Recordings in Human Epilepsy Patients at JoVE.com

Simultaneous Eye Tracking and Single-Neuron Recordings in Human Epilepsy Patients

We describe a method to conduct single-neuron recordings with simultaneous eye tracking in humans. We demonstrate the utility of this method and illustrate how we used this approach to obtain neurons in the human medial temporal lobe that encode targets of a visual search.

Intracranial recordings from patients with intractable epilepsy provide a unique opportunity to study the activity of individual human neurons during ...

A principle advantage of our technique is that it allows the simultaneous recording of case position, pupil size, and single neurons in patients implanted with depth electrodes at the bedside. This allows us to determine whether there are neurons in the human brain whose activity is sensitive to eye movements and to the identity of the currently fixated stimulus. While this technique is not designed to study a particular disease, it is well-suited to study neurological diseases that result in abnormal eye movements or other ocular motor abnormalities.Demonstrating the procedure will be Nand Chandravadia and James Lee, research associates from my laboratory. And Erika Quan, a neurodiagnostic technician at Cedars-Sinai. To begin, connect the electrodes to the recording system and position the patient sitting upright.Then, connect the stimulus computer to the electrophysiology system and eye tracker. Place the remote non-invasive infrared eye tracking system on a robust mobile cart. Then, attach a flexible arm that holds an LCD display to the cart.Place a fully charged uninterrupted power supply on the eye tracking cart and connect all devices related to eye tracking to the power supply rather than to an external power source. Make sure the IV device connected to the patient is running on battery and is not plugged into the wall. Start the eye tracking software.Adjust the distance between the patient and the LCD screen to between 60 and 70 centimeters. Also adjust the angle of the LCD screen so that the surface of the screen is approximately parallel to the patient's face. Place a sticker on the patient's forehead so that the eye tracker can adjust for head movements.Now, adjust the height of the screen relative to the patient's head such that the camera of the eye tracker is approximately at the height of the patient's nose. Provide the patient with a button box or keyboard. Verify that triggers and button press are recorded properly before starting the experiment.Start the acquisition software. First visually inspect the broadband local field potentials and make sure they are not contaminated by line noise. Otherwise follow standard procedures to remove noise.To identify single-neurons, band pass filter the signal from 300 hertz to eight kilohertz. Select one of the eight microwires as a reference for each microwire bundle. Enable saving the data as an nrd file before recording.Adjust the distance and angle between the eye tracker and the patient so that the target marker, head distance, pupil, and corneal reflection are marked as ready. This is shown in green in the eye tracking software. Click on the eye to be recorded and set the sampling rate to 500 hertz.Use the auto adjustment of the pupil and corneal reflection threshold. Calibrate the eye tracker with the built-in grid method at the beginning of each block. Confirm the eye positions register nicely as a grid.Otherwise, redo the calibration. Accept the calibration and do the validation. Accept the validation if the maximal validation error is less than two degrees and the average validation error is less than one degree.Otherwise, redo the validation. Then, perform drift correction and proceed to the actual experiment. In this visual search task, use the stimuli from a previous study performed by this group and follow the task procedure as described before.Provide task instructions to the participants. Instruct the participants to find a target item in the search array and respond as soon as possible. Instruct the participants to press the left button of a response box if they find the target and press the right button if they think the target is absent.Explicitly instruct the participants that there will be target-present and target-absent trials. Start stimulus presentation software and run the task. Present a target cue for one second and present the search array using the stimulus presentation software.Record the button presses and provide trial by trial feedback to the participants. To illustrate the usage of this method, 228 single neurons were recorded from the human medial temporal lobe while patients were performing a visual search task as shown here. During this task, it was investigated whether the activity of neurons differentiated between fixations on targets and distractors.When responses were aligned at the button press, neurons were found that showed differential activity between target-present trials and target-absent trials. Black lines represent the onset and offset of the search queue. This neuron increased its firing rate for target-present trials but not for target-absent trials.Conversely, this neuron decreased its firing rate for target-present trials but not for target-absent trials. A subset of medial temporal lobe neurons showed significantly different activities between fixations on targets versus distractors. Furthermore, one type of such target neuron had a greater response to targets relative to distractors whereas the other had a greater response to distractors relative to targets.Together, this result demonstrates that a subset of medial temporal lobe neurons encode whether the present fixation landed on a target or not. It is critical to make sure that the eye tracker does not introduce noise into the recording. Any noise must be removed before the experiments are performed.If noise persists, ensure the screen used to display the stimulus to the subject has an external power supply. Exchange power supplies for more high quality power supplies typically used for high-end audio applications. Following this procedure, analysis of spikes and eye movements are performed to extract information from the data that will allow researcher to investigate the neuronal responses to eye movements.This method paves the way to explore many unanswered questions that require analysis of fixations, such as how neurons collectively drive fixations to interesting objects in a scene.

simultaneous-eye-tracking-single-neuron-recordings-human-epilepsy

Research

JoVE Journal

Behavior

7.6K 조회수.  West Virginia University. 우리의 기술의 원리 장점은 침대 옆에서 깊이 전극으로 이식 된 환자에서 케이스 위치, 동공 크기 및 단일 뉴런의 동시 기록을 허용한다는 것입니다. 이것은 우리가 그의 활동이 눈 의 움직임과 현재 고정 된 자극의 정체성에 민감한 인간의 두뇌에 있는 뉴런이 있는지 여부를 결정할 수 있습니다. 이 기술은 특정 질병을 연구하기 위하여 디자인되지 않는 동안, 이상한 눈 운동...