Name: combining computer game-based behavioural experiments with high-density eeg and infrared gaze tracking
Uploaded: 2010-12-16T17:00:00
Description: Watch this Scientific Journal Video about Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking at JoVE.com

This project is funded by Autism Speaks Pilot Research Grant #2597 and by US National Science Foundation Faculty Early Career Development Award #BCS-0846892.

1. Design an Entertaining and Scientifically Informative Video Game
<ol>
<li>Apply an iterative game design process in which concerns of scientific value and playability inform each other. As an experimenter, you have ideas as to the stimuli and behavioural paradigms that you want to see built into a computer game. Because you are not a game designer, the task of building these paradigms into games may seem a detail that can be addressed after most of the work has been completed. Nothing could be ...

<ol>
	<li>Bell, A. J., Sejnowski, T. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+information+maximisation+approach+to+blind+separation+and+blind+deconvolution.">An information maximisation approach to blind separation and blind deconvolution.</a> Neural Computation. 7, 1129-1159 (1995).</li><li>Belmonte, M. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Shifts+of+visual+spatial+attention+modulate+a+steady-state+visual+evoked+potential.">Shifts of visual spatial attention modulate a steady-state visual evoked potential.</a> Cognitive Brain Research. 6, 295-307 (1998).</li><li>Belmonte, M. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Abnormal+attention+in+autism+shown+by+steady-state+visual+evoked+potentials.">Abnormal attention in autism shown by steady-state visual evoked potentials.</a> Autism. 4, 269-285 (2000).</li><li>Benton, A. L., Sivan, A. B., Hamsher, K., Varney, N. R., Spreen, O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Contributions to Neuropsychological Assessment. , (1994).</li><li>Berka, C., Levendowski, D. J., Cvetinovic, M. M., Petrovic, M. M., Davis, G., Lumicao, M. N., Zivkovic, V. T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Real-time+analyses+of+EEG+indexes+of+alertness,+cognition+and+memory+acquired+with+a+wireless+EEG+headset.">Real-time analyses of EEG indexes of alertness, cognition and memory acquired with a wireless EEG headset.</a> International Journal of Human-Computer Interaction. 17, 151-170 (2004).</li><li>Bradley, M. M., Miccoli, L., Escrig, M. A., Lang, P. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+pupil+as+a+measure+of+emotional+arousal+and+autonomic+activation.">The pupil as a measure of emotional arousal and autonomic activation.</a> Psychophysiology. 45, 602-607 (2008).</li><li>Brookings, J. B., Wilson, G. F., Swain, C. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Psychophysiological+responses+to+changes+in+work-load+during+simulated+air+traffic+control.">Psychophysiological responses to changes in work-load during simulated air traffic control.</a> Biological Psychology. 42, 361-377 (1996).</li><li>Castel, A. D., Pratt, J., Drummond, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+effects+of+action+video+game+experience+on+the+time+course+of+inhibition+of+return+and+the+efficiency+of+visual+search.">The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search.</a> Acta Psychologica. 119, 217-230 (2005).</li><li>Chaytor, N., Schmitter-Edgecombe, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+ecological+validity+of+neuropsychological+tests:+a+review+of+the+literature+on+everyday+cognitive+skills.">The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills.</a> Neuropsychology Review. 13, 181-197 (2003).</li><li>Dalton, K. M., Nacewicz, B. M., Johnstone, T., Schaefer, H. S., Gernsbacher, M. A., Goldsmith, H. H., Alexander, A. L., Davidson, R. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gaze+fixation+and+the+neural+circuitry+of+face+processing+in+autism.">Gaze fixation and the neural circuitry of face processing in autism.</a> Nature Neuroscience. 8, 519-526 (2005).</li><li>Delorme, A., Makeig, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=EEGLAB:+an+open+source+toolbox+for+analysis+of+single-trial+EEG+dynamics.">EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics.</a> Journal of Neuroscience Methods. 134, 9-21 (2004).</li><li>Ebisawa, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Improved+video-based+eye-gaze+detection+method.">Improved video-based eye-gaze detection method.</a> IEEE Transactions on Instrumentation and Measurement. 47, 948-955 (1998).</li><li>Feng, J., Spence, I., Pratt, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Playing+an+action+video+game+reduces+gender+differences+in+spatial+cognition.">Playing an action video game reduces gender differences in spatial cognition.</a> Psychological Science. 18, 850-855 (2007).</li><li>Ferree, T. C., Luu, P., Russell, G. S., Tucker, D. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Scalp+electrode+impedance,+infection+risk,+and+EEG+data+quality.">Scalp electrode impedance, infection risk, and EEG data quality.</a> Clinical Neurophysiology. 112, 536-544 (2001).</li><li>Golan, O., Baron-Cohen, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Systemizing+empathy:+teaching+adults+with+Asperger+syndrome+or+high-functioning+autism+to+recognize+complex+emotions+using+interactive+media.">Systemizing empathy: teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive media.</a> Development and Psychopathology. 18, 591-617 (2006).</li><li>Graner Ray, S., S, <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gender+inclusive+game+design:+Expanding+the+market.">Gender inclusive game design: Expanding the market.</a> , (2004).</li><li>Green, C. S., Bavelier, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Action+video+game+modifies+visual+selective+attention.">Action video game modifies visual selective attention.</a> Nature. 423, 534-537 (2003).</li><li>Green, C. S., Bavelier, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Enumeration+versus+multiple+object+tracking:+the+case+of+action+video+game+players.">Enumeration versus multiple object tracking: the case of action video game players.</a> Cognition. 101, 217-245 .</li><li>Green, C. S., Bavelier, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effect+of+action+video+games+on+the+spatial+distribution+of+visuospatial+attention.">Effect of action video games on the spatial distribution of visuospatial attention.</a> Journal of Experimental Psychology Human Perception and Performance. 32, 1465-1478 (2006).</li><li>Green, C. S., Bavelier, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Action-video-game+experience+alters+the+spatial+resolution+of+vision.">Action-video-game experience alters the spatial resolution of vision.</a> Psychological Science. 18, 88-94 (2007).</li><li>Hafed, Z. M., Clark, J. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Microsaccades+as+an+overt+measure+of+covert+attention+shifts.">Microsaccades as an overt measure of covert attention shifts.</a> Vision Research. 42, 2533-2545 (2002).</li><li>Lieberman, H. R., Pentland, A. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Microcomputer-based+estimation+of+psychophysical+thresholds:+the+best+PEST.">Microcomputer-based estimation of psychophysical thresholds: the best PEST.</a> Behavior Research Methods and Instrumentation. 14, 21-25 (1982).</li><li>Luck, S. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> An Introduction to the Event-Related Potential Technique. , (2005).</li><li>Lykken, D. T., Venables, P. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Direct+measurement+of+skin+conductance:+a+proposal+for+standardization.">Direct measurement of skin conductance: a proposal for standardization.</a> Psychophysiology. 8, 656-672 (1971).</li><li>Makeig, S., Delorme, A., Westerfield, M., Jung, T., Townsend, J., Courchesne, E., Sejnowski, T. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Electroencephalographic+brain+dynamics+following+manually+responded+visual+targets.">Electroencephalographic brain dynamics following manually responded visual targets.</a> PLoS Biology. 2, e176-e176 (2004).</li><li>Makeig, S., Jung, T., Bell, A. J., Ghahremani, D., Sejnowski, T. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Blind+separation+of+auditory+event-related+brain+responses+into+independent+components.">Blind separation of auditory event-related brain responses into independent components.</a> Proceedings of the National Academy of Sciences of the United States of America. 94, 10979-10984 (1997).</li><li>Makeig, S., Westerfield, M., Jung, T. P., Enghoff, S., Townsend, J., Courchesne, E., Sejnowski, T. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dynamic+brain+sources+of+visual+evoked+responses.">Dynamic brain sources of visual evoked responses.</a> Science. 295, 690-694 (2002).</li><li>Morgan, S. T., Hansen, J. C., Hillyard, S. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Selective+attention+to+stimulus+location+modulates+the+steady-state+visual+evoked+potential.">Selective attention to stimulus location modulates the steady-state visual evoked potential.</a> Proceedings of the National Academy of Sciences of the United States of America. 93, 4770-4774 (1996).</li><li>Pentland, A. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Maximum+likelihood+estimation:+the+best+PEST.">Maximum likelihood estimation: the best PEST.</a> Perception and Psychophysics. 28, 377-379 (1980).</li><li>Plaisted, K., Swettenham, J., Rees, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Children+with+autism+show+local+precedence+in+a+divided+attention+task+and+global+precedence+in+a+selective+attention+task.">Children with autism show local precedence in a divided attention task and global precedence in a selective attention task.</a> Journal of Child Psychology and Psychiatry. 40, 733-742 (1999).</li><li>Posner, M. I. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Orienting+of+attention.">Orienting of attention.</a> Quarterly Journal of Experimental Psychology. 32, 3-25 (1980).</li><li>Smith, M. E., McEvoy, L. K., Gevins, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neurophysiological+indices+of+strategy+development+and+skill+acquisition.">Neurophysiological indices of strategy development and skill acquisition.</a> Cognitive Brain Research. 7, 389-404 (1999).</li><li>St John, M., Kobus, D. A., Morrison, J. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+multi-tasking+environment+for+manipulating+and+measuring+neural+correlates+of+cognitive+workload.">A multi-tasking environment for manipulating and measuring neural correlates of cognitive workload.</a> , (2002).</li><li>St John, M., Kobus, D. A., Morrison, J. G., Schmorrow, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Overview+of+the+DARPA+augmented+cognition+technical+integration+experiment.">Overview of the DARPA augmented cognition technical integration experiment.</a> International Journal of Human-Computer Interac-tion. 17, 131-149 (2004).</li><li>Thorell, L. B., Lindqvist, S., Nutley, S. B., Bohlin, G., Klingberg, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Training+and+transfer+effects+of+executive+functions+in+preschool+children.">Training and transfer effects of executive functions in preschool children.</a> Developmental Science. 12, 106-113 (2009).</li><li>Valla, J. M., Ganzel, B. L., Yoder, K. J., Chen, G. M., Lyman, L. T., Sidari, A. P., Keller, A. E., Maendel, J. W., Perlman, J. E., Wong, S. K. L., Belmonte, M. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=More+than+maths+and+mindread-ing:+sex+differences+in+empathising/systemising+covariance.">More than maths and mindread-ing: sex differences in empathising/systemising covariance.</a> Autism Research. , (2010).</li><li>Witkin, H. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Individual+differences+in+ease+of+perception+of+embedded+figures.">Individual differences in ease of perception of embedded figures.</a> Journal of Personality. 19, 1-15 (1950).</li><li>Witkin, H. A., Lewis, H. B., Hertzman, M., Machover, K., Meissner, P. B., Wapner, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Personality through Perception. , (1954).</li><li>Wimmer, H., Perner, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Beliefs+about+beliefs:+Representation+and+constraining+function+of+wrong+beliefs+in+young+children's+understanding+of+deception.">Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception.</a> Cognition. 13, 103-128 (1983).</li><li>von Ahn, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Games+with+a+purpose.">Games with a purpose.</a> Computer. 39, 92-94 (2006).</li></ol>

Perhaps the single most important obstacle to integrative studies is the practical limit on the amount of time that a single experimental subject (especially one from a clinical population) can reasonably be expected to perform before becoming fatigued. Unfortunately, often the more controlled a stimulus is from the scientist's point of view, the more repetitive and tedious the experiment can seem from the subject's point of view. Behavioural research on neuropsychiatric disorders in recent years has highlighted the im...

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">	
		
		<div>
		<table border="1">
		<thead>
		<tr>
		<th>Material Name</th>
		<th>Type</th>
		<th>Company</th>
		<th>Catalogue Number</th>
		<th>Comment</th>
		</tr>
		</thead>
		<tbody>
		
<tr>
<td>128-channel BioSemi ActiveTwo measurement system</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>&nbsp;</td>
<td><a href="http://www.biosemi.com">http://www.biosemi.com</a></td>
</tr>
<tr>
<td>32 channel A-set + CMS/DRL</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>P32-ABC-ACMS</td>
<td>&nbsp;</td>
<tr>
<td>32 channel B-set</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>P32-ABC-B</td>
<td>&nbsp;</td>
<tr>
<td>32 channel C-set</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>P32-ABC-C</td>
<td>&nbsp;</td>
<tr>
<td>32 channel D-set</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>P32-ABC-D</td>
<td>&nbsp;</td>
<tr>
<td>EX1-EX8 electrodes</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>8 x TP PIN</td>
<td>&nbsp;</td>
<tr>
<td>128-channel cap</td>
<td>&nbsp;</td>
<td>BioSemi</td>
<td>CAP M 128</td>
<td>&nbsp;</td>
<tr>
<td>EyeLink 1000 infrared gaze tracker</td>
<td>&nbsp;</td>
<td>SR Research</td>
<td>&nbsp;</td>
<td>&nbsp;</td>
<tr>
<td>EyeLink 1000 Remote Camera Upgrade</td>
<td>&nbsp;</td>
<td>SR Research</td>
<td>n/a</td>
<td>Allows for target sticker tracking</td>
</tr>
<tr>
<td>SignaGel electrode gel</td>
<td>&nbsp;</td>
<td>Parker Labs</td>
<td>n/a</td>
<td>&nbsp;</td>
<tr>
<td>0.05% KCl electrolytic (NaCl) gel</td>
<td>&nbsp;</td>
<td>n/a</td>
<td>n/a</td>
<td>Purchased from compounding pharmacy</td>
</tr>
<tr>
<td>Intensity Pro</td>
<td>&nbsp;</td>
<td>Blackmagic Design</td>
<td>&nbsp;</td>
<td>&nbsp;</td>		</tbody>
		</table>
		</div>

combining computer game-based behavioural experiments with high-density eeg and infrared gaze tracking

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they yield data relevant to the cognitive processing that occurs under ecologically valid conditions. These two goals often are at odds, since well controlled stimuli often are too repetitive to sustain subjects' motivation. Studies employing electroencephalography (EEG) are often especially sensitive to this dilemma between ecological validity and experimental control: attaining sufficient signal-to-noise in physiological averages demands large numbers of repeated trials within lengthy recording sessions, limiting the subject pool to individuals with the ability and patience to perform a set task over and over again. This constraint severely limits researchers' ability to investigate younger populations as well as clinical populations associated with heightened anxiety or attentional abnormalities. Even adult, non-clinical subjects may not be able to achieve their typical levels of performance or cognitive engagement: an unmotivated subject for whom an experimental task is little more than a chore is not the same, behaviourally, cognitively, or neurally, as a subject who is intrinsically motivated and engaged with the task. A growing body of literature demonstrates that embedding experiments within video games may provide a way between the horns of this dilemma between experimental control and ecological validity. The narrative of a game provides a more realistic context in which tasks occur, enhancing their ecological validity (Chaytor &amp; Schmitter-Edgecombe, 2003). Moreover, this context provides motivation to complete tasks. In our game, subjects perform various missions to collect resources, fend off pirates, intercept communications or facilitate diplomatic relations. In so doing, they also perform an array of cognitive tasks, including a Posner attention-shifting paradigm (Posner, 1980), a go/no-go test of motor inhibition, a psychophysical motion coherence threshold task, the Embedded Figures Test (Witkin, 1950, 1954) and a theory-of-mind (Wimmer &amp; Perner, 1983) task. The game software automatically registers game stimuli and subjects' actions and responses in a log file, and sends event codes to synchronise with physiological data recorders. Thus the game can be combined with physiological measures such as EEG or fMRI, and with moment-to-moment tracking of gaze. Gaze tracking can verify subjects' compliance with behavioural tasks (e.g. fixation) and overt attention to experimental stimuli, and also physiological arousal as reflected in pupil dilation (Bradley et al., 2008). At great enough sampling frequencies, gaze tracking may also help assess covert attention as reflected in microsaccades - eye movements that are too small to foveate a new object, but are as rapid in onset and have the same relationship between angular distance and peak velocity as do saccades that traverse greater distances. The distribution of directions of microsaccades correlates with the (otherwise) covert direction of attention (Hafed &amp; Clark, 2002).

Watch this Scientific Journal Video about Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking at JoVE.com

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Procedures for recording high-density EEG and gaze data during computer game-based cognitive tasks are described. Using a video game to present cognitive tasks enhances ecological validity without sacrificing experimental control.

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they ...

combining-computer-game-based-behavioural-experiments-with-high

Research

JoVE Journal

Neuroscience

Functional Mapping with Simultaneous MEG and EEG

We use magnetoencephalography (MEG) and electroencephalography (EEG) to locate and determine the temporal evolution in brain areas involved in the processing of simple sensory stimuli. We will use somatosensory stimuli to locate the hand somatosensory areas, auditory stimuli to locate the auditory cortices, visual stimuli in four quadrants of the visual field to locate the early visual areas. These type of experiments are used for functional mapping in epileptic and brain tumor patients to locate eloquent cortices. In basic neuroscience similar experimental protocols are used to study the orchestration of cortical activity. The acquisition protocol includes quality assurance procedures, subject preparation for the combined MEG/EEG study, and acquisition of evoked-response data with somatosensory, auditory, and visual stimuli. We also demonstrate analysis of the data using the equivalent current dipole model and cortically-constrained minimum-norm estimates. Anatomical MRI data are employed in the analysis for visualization and for deriving boundaries of tissue boundaries for forward modeling and cortical location and orientation constraints for the minimum-norm estimates.

We use magnetoencephalography (MEG) and electroencephalography (EEG) to map brain areas involved in the processing of simple sensory stimuli.

We use magnetoencephalography (MEG) and electroencephalography (EEG) to locate and determine the temporal evolution in brain areas involved in the ...

High Density Event-related Potential  Data Acquisition in Cognitive Neuroscience

Functional magnetic resonance imaging (fMRI) is currently the standard method of evaluating brain function in the field of Cognitive Neuroscience, in part because fMRI data acquisition and analysis techniques are readily available. Because fMRI has excellent spatial resolution but poor temporal resolution, this method can only be used to identify the spatial location of brain activity associated with a given cognitive process (and reveals virtually nothing about the time course of brain activity). By contrast, event-related potential (ERP) recording, a method that is used much less frequently than fMRI, has excellent temporal resolution and thus can track rapid temporal modulations in neural activity. Unfortunately, ERPs are under utilized in Cognitive Neuroscience because data acquisition techniques are not readily available and low density ERP recording has poor spatial resolution. In an effort to foster the increased use of ERPs in Cognitive Neuroscience, the present article details key techniques involved in high density ERP data acquisition. Critically, high density ERPs offer the promise of excellent temporal resolution and good spatial resolution (or excellent spatial resolution if coupled with fMRI), which is necessary to capture the spatial-temporal dynamics of human brain function.

Event-related potential (ERP) recording is under utilized in Cognitive Neuroscience because data acquisition techniques are not readily available and this method often has poor spatial resolution. To foster the increased use of ERPs in Cognitive Neuroscience, the present article details key techniques involved in high density ERP data acquisition.

Functional magnetic resonance imaging (fMRI) is currently the standard method of evaluating brain function in the field of Cognitive Neuroscience, in part ...

High-density EEG Recordings of the Freely Moving Mice using Polyimide-based Microelectrode

Electroencephalogram (EEG) indicates the averaged electrical activity of the neuronal populations on a large-scale level. It is widely utilized as a noninvasive brain monitoring tool in cognitive neuroscience as well as a diagnostic tool for epilepsy and sleep disorders in neurology. However, the underlying mechanism of EEG rhythm generation is still under the veil. Recently introduced polyimide-based microelectrode (PBM-array) for high resolution mouse EEG1 is one of the trials to answer the neurophysiological questions on EEG signals based on a rich genetic resource that the mouse model contains for the analysis of complex EEG generation process. This application of nanofabricated PBM-array to mouse skull is an efficient tool for collecting large-scale brain activity of transgenic mice and accommodates to identify the neural correlates to certain EEG rhythms in conjunction with behavior. However its ultra-thin thickness and bifurcated structure cause a trouble in handling and implantation of PBM-array. In the presented video, the preparation and surgery steps for the implantation of PBM-array on a mouse skull are described step by step. Handling and surgery tips to help researchers succeed in implantation are also provided.

In this article, we described the surgery procedure and handling tips for implantation of ultra-thin polyimide-based microelectrode array (PBM-array) on the mouse skull for acquisition of high-density encephalography (EEG) in a mouse model.

Electroencephalogram (EEG) indicates the averaged electrical activity of the neuronal populations on a large-scale level. It is widely utilized as a ...

Recording Large-scale Neuronal Ensembles with Silicon Probes in the Anesthetized Rat

Large scale electrophysiological recordings from neuronal ensembles offer the opportunity to investigate how the brain orchestrates the wide variety of behaviors from the spiking activity of its neurons. One of the most effective methods to monitor spiking activity from a large number of neurons in multiple local neuronal circuits simultaneously is by using silicon electrode arrays1-3.
Action potentials produce large transmembrane voltage changes in the vicinity of cell somata. These output signals can be measured by placing a conductor in close proximity of a neuron. If there are many active (spiking) neurons in the vicinity of the tip, the electrode records combined signal from all of them, where contribution of a single neuron is weighted by its 'electrical distance'. Silicon probes are ideal recording electrodes to monitor multiple neurons because of a large number of recording sites (+64) and a small volume. Furthermore, multiple sites can be arranged over a distance of millimeters, thus allowing for the simultaneous recordings of neuronal activity in the various cortical layers or in multiple cortical columns (Fig. 1). Importantly, the geometrically precise distribution of the recording sites also allows for the determination of the spatial relationship of the isolated single neurons4. Here, we describe an acute, large-scale neuronal recording from the left and right forelimb somatosensory cortex simultaneously in an anesthetized rat with silicon probes (Fig. 2).

Extracellular recordings of neuronal activity using silicon probes in the anesthetized rat will be described. This technique allows information to be obtained across multiple brain areas from more than 100 neurons simultaneously. It provides information with single cell resolution about neuronal ensembles dynamics in multiple local circuits.

Large scale electrophysiological recordings from neuronal ensembles offer the opportunity to investigate how the brain orchestrates the wide variety of ...

Visualizing the Effects of a Positive Early Experience, Tactile Stimulation, on Dendritic Morphology and Synaptic Connectivity with Golgi-Cox Staining

To generate longer-term changes in behavior, experiences must be producing stable changes in neuronal morphology and synaptic connectivity. Tactile stimulation is a positive early experience that mimics maternal licking and grooming in the rat. Exposing rat pups to this positive experience can be completed easily and cost-effectively by using highly accessible materials such as a household duster. Using a cross-litter design, pups are either stroked or left undisturbed, for 15 min, three times per day throughout the perinatal period. To measure the neuroplastic changes related to this positive early experience, Golgi-Cox staining of brain tissue is utilized. Owing to the fact that Golgi-Cox impregnation stains a discrete number of neurons rather than all of the cells, staining of the rodent brain with Golgi-Cox solution permits the visualization of entire neuronal elements, including the cell body, dendrites, axons, and dendritic spines. The staining procedure is carried out over several days and requires that the researcher pay close attention to detail. However, once staining is completed, the entire brain has been impregnated and can be preserved indefinitely for ongoing analysis. Therefore, Golgi-Cox staining is a valuable resource for studying experience-dependent plasticity.

This paper describes the procedures for tactile stimulation of rat pups and subsequent Golgi-Cox staining of neuronal morphology. Tactile stimulation is a positive experience that is administered in the perinatal period by stroking pups with a household duster. Golgi-cox staining is a reliable procedure permitting the visualization of entire neurons.

To generate longer-term changes in behavior, experiences must be producing stable changes in neuronal morphology and synaptic connectivity. Tactile ...

Olfactory Behaviors Assayed by Computer Tracking Of Drosophila in a Four-quadrant Olfactometer

A key challenge in neurobiology is to understand how neural circuits function to guide appropriate animal behaviors. Drosophila melanogaster is an excellent model system for such investigations due to its complex behaviors, powerful genetic techniques, and compact nervous system. Laboratory behavioral assays have long been used with Drosophila to simulate properties of the natural environment and study the neural mechanisms underlying the corresponding behaviors (e.g. phototaxis, chemotaxis, sensory learning and memory)1-3. With the recent availability of large collections of transgenic Drosophila lines that label specific neural subsets, behavioral assays have taken on a prominent role to link neurons with behaviors4-11. Versatile and reproducible paradigms, together with the underlying computational routines for data analysis, are indispensable for rapid tests of candidate fly lines with various genotypes. Particularly useful are setups that are flexible in the number of animals tested, duration of experiments and nature of presented stimuli. The assay of choice should also generate reproducible data that is easy to acquire and analyze. Here, we present a detailed description of a system and protocol for assaying behavioral responses of Drosophila flies in a large four-field arena. The setup is used here to assay responses of flies to a single olfactory stimulus; however, the same setup may be modified to test multiple olfactory, visual or optogenetic stimuli, or a combination of these. The olfactometer setup records the activity of fly populations responding to odors, and computational analytical methods are applied to quantify fly behaviors. The collected data are analyzed to get a quick read-out of an experimental run, which is essential for efficient data collection and the optimization of experimental conditions.

Olfactory Behaviors Assayed by Computer Tracking Of Drosophila in a Four-quadrant Olfactometer

We describe here a behavioral setup and data analysis method for assaying olfactory responses of up to 100 vinegar flies (Drosophila melanogaster). This system may be used with single or multiple olfactory stimuli, and adaptable for optogenetic activation or silencing of neuronal subsets.

A key challenge in neurobiology is to understand how neural circuits function to guide appropriate animal behaviors. Drosophila melanogaster is an ...

Visual Evoked Potential Recordings in Mice Using a Dry Non-invasive Multi-channel Scalp EEG Sensor

For scalp EEG research environments with laboratory mice, we designed a dry-type 16 channel EEG sensor which is non-invasive, deformable, and re-usable because of the plunger-spring-barrel structural facet and mechanical strengths resulting from metal materials. The whole process for acquiring the VEP responses in vivo from a mouse consists of four steps: (1) sensor assembly, (2) animal preparation, (3) VEP measurement, and (4) signal processing. This paper presents representative measurements of VEP responses from multiple mice with a submicro-voltage signal resolution and sub-hundred millisecond temporal resolution. Although the proposed method is safer and more convenient compared to other previously reported animal EEG acquiring methods, there are remaining issues including how to enhance the signal-to-noise ratio and how to apply this technique with freely moving animals. The proposed method utilizes easily available resources and shows a repetitive VEP response with a satisfactory signal quality. Therefore, this method could be utilized for longitudinal experimental studies and reliable translational research exploiting non-invasive paradigms.

We designed a dry-type 16 channel EEG sensor which is non-invasive, deformable, and re-usable. This paper describes the whole process from manufacturing the proposed EEG electrode to signal processing of visual evoked potential (VEP) signals measured on a mouse scalp using a dry non-invasive multi-channel EEG sensor.

For scalp EEG research environments with laboratory mice, we designed a dry-type 16 channel EEG sensor which is non-invasive, deformable, and re-usable ...

Analyzing Neural Activity and Connectivity Using Intracranial EEG Data with SPM Software

Measuring neural activity and connectivity associated with cognitive functions at high spatial and temporal resolutions is an important goal in cognitive neuroscience. Intracranial electroencephalography (EEG) can directly record electrical neural activity and has the unique potential to accomplish this goal. Traditionally, averaging analysis has been applied to analyze intracranial EEG data; however, several new techniques are available for depicting neural activity and intra- and inter-regional connectivity. Here, we introduce two analytical protocols we recently applied to analyze intracranial EEG data using the Statistical Parametric Mapping (SPM) software: time-frequency SPM analysis for neural activity and dynamic causal modeling of induced responses for intra- and inter-regional connectivity. We report our analysis of intracranial EEG data during the observation of faces as representative results. The results revealed that the inferior occipital gyrus (IOG) showed gamma-band activity at very early stages (110 ms) in response to faces, and both the IOG and amygdala showed rapid intra- and inter-regional connectivity using various types of oscillations. These analytical protocols have the potential to identify the neural mechanisms underlying cognitive functions with high spatial and temporal profiles.

We present two analytical protocols that can be used to analyze intracranial electroencephalography data using the Statistical Parametric Mapping (SPM) software: time-frequency statistical parametric mapping analysis for neural activity, and dynamic causal modeling of induced responses for intra- and inter-regional connectivity.

Measuring neural activity and connectivity associated with cognitive functions at high spatial and temporal resolutions is an important goal in cognitive ...

Conducting Hyperscanning Experiments with Functional Near-Infrared Spectroscopy

Concurrent brain recordings of two or more interacting persons, an approach termed hyperscanning, are gaining increasing importance for our understanding of the neurobiological underpinnings of social interactions, and possibly interpersonal relationships. Functional near-infrared spectroscopy (fNIRS) is well suited for conducting hyperscanning experiments because it measures local hemodynamic effects with a high sampling rate and, importantly, it can be applied in natural settings, not requiring strict motion restrictions. In this article, we present a protocol for conducting fNIRS hyperscanning experiments with parent-child dyads and for analyzing brain-to-brain synchrony. Furthermore, we discuss critical issues and future directions, regarding the experimental design, spatial registration of the fNIRS channels, physiological influences and data analysis methods. The described protocol is not specific to parent-child dyads, but can be applied to a variety of different dyadic constellations, such as adult strangers, romantic partners or siblings. To conclude, fNIRS hyperscanning has the potential to yield new insights into the dynamics of the ongoing social interaction, which possibly go beyond what can be studied by examining the activities of individual brains.

The present protocol describes how to conduct fNIRS hyperscanning experiments and analyze brain-to-brain synchrony. Further, we discuss challenges and possible solutions.

Concurrent brain recordings of two or more interacting persons, an approach termed hyperscanning, are gaining increasing importance for our understanding ...

Lipid Bilayer Experiments with Contact Bubble Bilayers for Patch-Clampers

Lipid bilayers provide a unique experimental platform for functional studies of ion channels, allowing the examination of channel-membrane interactions under various membrane lipid compositions. Among them, the droplet interface bilayer has gained popularity; however, the large membrane size hinders the recording of low electrical background noise. We have established a contact bubble bilayer (CBB) method that combines the benefits of planar lipid bilayer and patch-clamp methods, such as the ability to vary the lipid composition and to manipulate the bilayer mechanics, respectively. Using the setup for conventional patch-clamp experiments, CBB-based experiments can be readily performed. In brief, an electrolyte solution in a glass pipette is blown into an organic solvent phase (hexadecane), and the pipette pressure is maintained to obtain a stable bubble size. The bubble is spontaneously lined with a lipid monolayer (pure lipids or mixed lipids), which is provided from liposomes in the bubbles. Next, the two monolayer-lined bubbles (~50 &#181;m in diameter) at the tip of the glass pipettes are docked for bilayer formation. Introduction of channel-reconstituted liposomes into the bubble leads to the incorporation of channels in the bilayer, allowing for single-channel current recording with a signal-to-noise ratio comparable to that of patch-clamp recordings. CBBs with an asymmetric lipid composition are readily formed. The CBB is renewed repeatedly by blowing out the previous bubbles and forming new ones. Various chemical and physical perturbations (e.g., membrane perfusion and bilayer tension) can be imposed on the CBBs. Herein, we present the basic procedure for CBB formation.

Here, we present a protocol for the formation of lipid bilayers using a contact bubble bilayer method. A water bubble is blown into an organic solvent, whereby a monolayer is formed at the water-oil interface. Two pipettes are manipulated to dock the bubbles to form a bilayer.

Lipid bilayers provide a unique experimental platform for functional studies of ion channels, allowing the examination of channel-membrane interactions ...