Name: methods to explore the influence of top-down visual processes on motor behavior
Uploaded: 2014-04-16T16:00:00
Description: Watch this Scientific Journal Video about Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior at JoVE.com

The authors would like to acknowledge the members of the Laboratory of Vision Research and the Sensory-Motor Integration Laboratory for helping run participants in this study, Polina Yanovich, Joshua Dobias, and Robert W. Isenhower for help in the initial design phase, and Tom Grace for his help in building the stimulus. This work was supported by the following sources: the NSF Graduate Research Fellowship Program: Award #DGE-0937373, the NSF CyberEnabled Discovery and Innovation Type I (Idea): Grant #094158, and the Rutgers-UMDNJ NIH Biotechnology Training Program: Grant # 5T32GM008339-22.

1. Building the Stimulus Apparatus
<ol>
	<li>Construct a moveable platform on a sliding track. Each stimulus will be placed on the moveable platform depending on the type of trial called for.</li>
	<li>Secure the track onto a table at an appropriate height that allows for the stimulus platform to be at eye-level with the participant to be seated in front of the table.</li>
	<li>Attach a retractable spring mechanism to the stimulus platform. Connect the input to the spring mechanism to a circuit board.</li>
	<li>Place a...

<ol>
	<li>Schneider, G. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Two+visual+systems.">Two visual systems.</a> Science. 163, 895-902 (1969).</li><li>Ingle, D., Goodale, M. A., Mansfield, R. J. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Analysis of visual behavior. , (1982).</li><li>Goodale, M. A., Milner, A. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Separate+visual+pathways+for+perception+and+action.">Separate visual pathways for perception and action.</a> Trends Neurosci. 15, 20-25 (1992).</li><li>James, T. W., Culham, J., Humphrey, G. K., Milner, A. D., Goodale, M. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Ventral+occipital+lesions+impair+object+recognition+but+not+object-directed+grasping:+an+fMRI+study.">Ventral occipital lesions impair object recognition but not object-directed grasping: an fMRI study.</a> Brain. 126, 2463-2475 (2003).</li><li>Pisella, L., Binkofski, F., Lasek, K., Toni, I., Rossetti, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=No+double-dissociation+between+optic+ataxia+and+visual+agnosia:+multiple+sub-streams+for+multiple+visuo-manual+integrations.">No double-dissociation between optic ataxia and visual agnosia: multiple sub-streams for multiple visuo-manual integrations.</a> Neuropsychologia. 44, 2734-2748 (2006).</li><li>Westwood, D. A., Goodale, M. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Perceptual+illusion+and+the+real-time+control+of+action.">Perceptual illusion and the real-time control of action.</a> Spat. Vis. 16, 243-254 (2003).</li><li>Schenk, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Visuomotor+robustness+is+based+on+integration+not+segregation.">Visuomotor robustness is based on integration not segregation.</a> Vis. Res. 50, 2627-2632 (2010).</li><li>Schenk, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=No+dissociation+between+perception+and+action+in+patient+DF+when+haptic+feedback+is+withdrawn.">No dissociation between perception and action in patient DF when haptic feedback is withdrawn.</a> J. Neurosci. 32, 2013-2017 (2012).</li><li>Gegenfurtner, K., Henriques, D., Krauzlis, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Recent+advances+in+perception+and+action.">Recent advances in perception and action.</a> Vis. Res. 51, 801-803 (2011).</li><li>Binkofski, F., Buxbaum, L. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Two+action+systems+in+the+human+brain.">Two action systems in the human brain.</a> Brain Lang. , (2012).</li><li>Aglioti, S., DeSouza, J. F., Goodale, M. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Size-contrast+illusions+deceive+the+eye+but+not+the+hand.">Size-contrast illusions deceive the eye but not the hand.</a> Curr. Biol. 5, 679-685 (1995).</li><li>Franz, V. H., Gegenfurtner, K. R., Bulthoff, H. H., Fahle, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Grasping+visual+illusions:+no+evidence+for+a+dissociation+between+perception+and+action.">Grasping visual illusions: no evidence for a dissociation between perception and action.</a> Psychol. Sci. 11, 20-25 (2000).</li><li>Gilster, R., Kuhtz-Buschbeck, J. P., Wiesner, C. D., Ferstl, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Grasp+effects+of+the+Ebbinghaus+illusion+are+ambiguous.">Grasp effects of the Ebbinghaus illusion are ambiguous.</a> Exp. Brain Res. 171, 416-420 (2006).</li><li>Papathomas, T. V. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Art+pieces+that+'move'+in+our+minds+&#8211;+an+explanation+of+illusory+motion+based+on+depth+reversal.">Art pieces that 'move' in our minds &#8211; an explanation of illusory motion based on depth reversal.</a> Spatial Vis. 21, 79-95 (2007).</li><li>Papathomas, T. V., Bono, L. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Experiments+with+a+hollow+mask+and+a+reverspective:+top-down+influences+in+the+inversion+effect+for+3-D+stimuli.">Experiments with a hollow mask and a reverspective: top-down influences in the inversion effect for 3-D stimuli.</a> Perception. 33, 1129-1138 (2004).</li><li>Hill, H., Johnston, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+hollow-face+illusion:+object-specific+knowledge,+general+assumptions+or+properties+of+the+stimulus.">The hollow-face illusion: object-specific knowledge, general assumptions or properties of the stimulus.</a> Perception. 36, 199-223 (2007).</li><li>Hartung, B., Schrater, P. R., Bulthoff, H. H., Kersten, D., Franz, V. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Is+prior+knowledge+of+object+geometry+used+in+visually+guided+reaching.">Is prior knowledge of object geometry used in visually guided reaching.</a> J. Vis. 5, 504-514 (2005).</li><li>Kroliczak, G., Heard, P., Goodale, M. A., Gregory, R. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dissociation+of+perception+and+action+unmasked+by+the+hollow-face+illusion.">Dissociation of perception and action unmasked by the hollow-face illusion.</a> Brain Res. 1080, 9-16 (2006).</li><li>Torres, E. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Two+classes+of+movements+in+motor+control.">Two classes of movements in motor control.</a> Exp. Brain Res. 215, 269-283 (2011).</li><li>Torres, E. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Signatures+of+movement+variability+anticipate+hand+speed+according+to+levels+of+intent.">Signatures of movement variability anticipate hand speed according to levels of intent.</a> Behav. Brain Func. 9. 10, 10 (2013).</li><li>Torres, E. B., Heilman, K. M., Poizner, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Impaired+endogenously+evoked+automated+reaching+in+Parkinson's+disease.">Impaired endogenously evoked automated reaching in Parkinson's disease.</a> J. Neurosci. 31, 17848-17863 (2011).</li><li>Rencher, A. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Methods of multivariate analysis. , (2002).</li><li>Torres, E. B., Zipser, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Simultaneous+control+of+hand+displacements+and+rotations+in+orientation-matching+experiments.">Simultaneous control of hand displacements and rotations in orientation-matching experiments.</a> J. Appl. Physiol. 96, 1978-1987 (2004).</li><li>Yanovich, P., Isenhower, R. W., Sage, J., Torres, E. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Spatial-orientation+priming+impedes+rather+than+facilitates+the+spontaneous+control+of+hand-retraction+speeds+in+patients+with+Parkinson's+disease.">Spatial-orientation priming impedes rather than facilitates the spontaneous control of hand-retraction speeds in patients with Parkinson's disease.</a> PLoS ONE. 8, 1-19 (2013).</li><li>Prime, S. L., Marotta, J. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gaze+strategies+during+visually-guided+versus+memory-guided+grasping.">Gaze strategies during visually-guided versus memory-guided grasping.</a> Exp. Brain Res. 225, 291-305 (2013).</li><li>Schneider, U., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reduced+binocular+depth+inversion+in+schizophrenic+patients.">Reduced binocular depth inversion in schizophrenic patients.</a> Schizophrenia Res. 53, 101-108 (2000).</li><li>Dima, D., Dillo, W., Bonnemann, C., Emrich, H. M., Dietrich, D. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reduced+P300+and+P600+amplitude+in+the+hollow-mask+illusion+in+patients+with+schizophrenia.">Reduced P300 and P600 amplitude in the hollow-mask illusion in patients with schizophrenia.</a> Psychiatry Res. 191, 145-151 (2011).</li><li>Butler, P. D., Silverstein, S. M., Dakin, S. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Visual+perception+and+its+impairment+in+schizophrenia.">Visual perception and its impairment in schizophrenia.</a> Biol. Psychiatry. 64, 40-47 (2008).</li></ol>

Our methods provide a platform to test the validity of perception-action models by analyzing the entire unfolding of movement in relation to the experimental task. The paradigm can be modified to test other types of visual stimuli to broaden this area of research. For example, other 3D DIIs can be tested on the apparatus to see how interactions between top-down and bottom-up processes translate to various stimuli. The methods can also be tailored to test clinical populations that may have perturbations in perception and ...

Vision-for-Perception vs. Vision-for-Action
In order to successfully navigate the environment, information from the visual system is utilized to help coordinate human movement. How visual information is selected and prioritized to influence motor actions remains unclear. Two major anatomical projections arise from the primary visual cortex to form the ventral ("what", or "vision for perception") pathway, extending to the temporal area, and the dorsal ("where", or "vision for action") pathway, to the parietal lobe1-2. The ventral stream is implicated in utilizing visual information for perceptual processes such as object recognition and identification, whereas the dorsal stream is thought to exclusively process signals for action guidance and spatial awareness. The question asked is whether or not top-down processes from the ventral stream shape the way in which movements are executed.
The famous case study of Patient DF, evaluated by Goodale and Milner in 1992, provided strong evidence and support for the visual two-streams hypothesis, which claims that ventral and dorsal stream processes are separable for perception and action3. In theory, bottom-up signals of motion parallax and binocular disparity can override top-down perceptual information such as prior knowledge and familiarity in order to accurately guide our actions, suggesting that motor planning is impervious to ventral stream control. DF, who suffered from visual form agnosia caused by bilateral ventral occipital lesions, retained accurate grasping ability towards objects that she had difficulty recognizing, supporting the premise of the visual two-streams hypothesis3-4. Because of case studies like DF, it was assumed that the functional ventral-dorsal stream dichotomy also existed in healthy, nonpathological individuals. However, whether or not these findings provide evidence for an absolute division of labor for perception and action in neurotypical populations has been hotly debated over the past twenty years5-10.
The Use of Illusions to Segregate Perception and Action
To test the visual two-streams hypothesis in neurotypical subjects, researchers employ visual illusions to investigate how skewed perceptual judgments of the environment affect our motor actions. The Ebbinghaus/Titchener Illusion, for example, uses a disk target surrounded by smaller disks that appears to be larger than another disk of the same size surrounded by larger circles; this is due to a size-contrast effect11. When participants reach to grasp the disk target, if the two-streams hypothesis holds true, then the grip aperture of the hand grabbing at the disk target would be unaffected by the illusion, causing the participant to act on the true geometry of the disk target rather than rely on incorrect perceptual size estimates. Aglioti et al. in fact report this behavior, reasoning that separate visual processes govern skilled actions and conscious perception11. Conversely, other groups have contested these results, finding no dissociation between perception and action processes when carefully controlling the matching of perceptual and grasping tasks, proposing an integration of visual stream information rather than a separation12. Despite several follow-up studies conducted to validate or refute the visual two-streams hypothesis using the Ebbinghaus Illusion, there are competing pieces of evidence to support both sides of the argument13.
To further explore the influence of visual perception on action processes, 3D depth inversion illusions (DII) have also been utilized. DIIs produce illusory motion and perceived depth reversal of scenes in which physically concave angles are perceived as convex and vice versa14. The Hollow Face Illusion is an example of a DII that generates the perception of a normal, convex face although the stimulus is physically concave, implicating the role of top-down influences such as prior knowledge and convexity bias to elicit the illusory percept15-16. Despite efforts to characterize motor behavior in reaching towards targets on the Hollow Face Illusion, evidence remains equivocal: one study reports an effect on motor output17 while another does not18. These studies rely on comparing perceptual depth estimates to endpoint distance calculations of the hand relative to targets located on the Hollow Face Illusion. Conflicting results on actions performed on this type of stimuli may be a result of the variations in methods used by researchers. Because the way in which ventral and dorsal stream information is utilized is still up to debate, this controversy sparks the need for a more robust stimulus with additional advanced measures of motor behavior.
This is precisely why a technique was developed using reverse-perspective stimuli, commonly referred to as "reverspectives", which form another class of DIIs14. Linear perspective cues that are painted on piecewise 3D planar surfaces produce competition between the physical geometry of the stimulus and the actual painted scene. Data-driven sensory signals, such as binocular disparity and motion parallax favor the veridical percept of the physical geometry, whereas experience-based familiarity with perspective favors the depth-inversion percept (Figure 1). The advantage of the reverspective is that it allows for the placement of a target on a stimulus surface whose perceived spatial orientation under the illusion differs by nearly 90 degrees from its physical orientation (Figures 1e and 1f). This huge difference greatly facilitates testing whether reach-for-grasping movements are or are not influenced by the illusion. This notion is key to exploring whether or not motor actions performed on the reverspective are affected by top-down influences from the ventral stream.
Movement Classes in Perception-Action Models
If different motor strategies are employed under illusory and veridical percepts when grabbing towards a target on a reverspective stimulus, then it can be easily tracked by studying the curvature of the hand&#39;s approach. Moreover, an analysis of the entire unfolding movement from initiation of the goal-directed movement to the spontaneous, automatic retraction of the hand back to its resting state may in fact bypass any shortcomings found in past methods of testing for perceptual influence on motor output. Recent studies highlight the significance of studying the balance between these two movement classes as well as the use of the spontaneous segments by the nervous systems for predictive and anticipatory control19-21,23-24. The newly statistically defined class of spontaneous-automatic movements provides new metrics and features that turn out to be as crucial as the goal-directed ones have been thus far to track sensory-motor changes and to quantify subtle aspects of natural behaviors.
To our knowledge, existing research on the visual two-streams hypothesis only focuses on goal-directed acts, thereby ignoring any effects on automatic transitional movements that are significant components to completing the visuomotor action loop. Emphasis therefore must be placed on the importance of automatic motions in order to fully capture both modes of motor behavior in the present paradigm to clarify issues concerning visual perception-action models. Here methods are developed to investigate the role of top-down signaling in the visual ventral stream on modulating motor behavior in the deliberate, goal-directed action domain in conjunction with spontaneous, transitional movements using a robust DII reverse-perspective stimulus.
Rationale
It is hypothesized that, if top-down visual processes influence the sensory-motor system, full movement trajectories toward the embedded target in the 3D reverse-perspective scene under the illusory percept will differ from the target approach elicited by the veridical percept (Figures 1e and 1f). Moreover, since the illusory percept of the reverspective stimulus is very similar to that obtained by a proper ("forced") perspective stimulus, reaches performed toward an embedded target on a reverspective should therefore be similar in characteristics to reaches conducted under the influence of the illusion on the reverspective stimulus (Figures 1c and 1f).
If top-down visual influences do not impact the movement trajectory, then it is hypothesized that reaches made under the illusory percept would exhibit the same characteristics as reaches made under the veridical percept on the reverspective stimulus (Figure 1e). In other words, both illusory and veridical percept reaches would be similar in nature, such that both forward trajectory paths would act on the true geometry of the stimulus. How effects observed in the forward reach translate in the automatic retraction of the hand is unknown. By employing a full motor analysis, we aim to advance our understanding of action and perception loops to clarify the existing issues at hand.

<table border="0" cellpadding="0" cellspacing="0" width="814">
	<tbody>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Laboratory bench</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td style="width:167px;"></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Slidable Track with Retractable Spring</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td>built in-house</td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Retractable Spring</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Adjustable Lamps</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Switch Box</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Circuit Board</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Arduino</td>
			<td style="width:252px;">Smart Projects, Italy</td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="42">
			<td height="42" style="height:42px;width:276px;">MATLAB</td>
			<td style="width:252px;">The MathWorks Inc., Natick, MA, USA</td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Randot-dot Stereo Test</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Reverse-Perspective Stimulus</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td>built in-house</td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Proper-Perspective Stimulus</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td>built in-house</td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Training Stimuli</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td>built in-house</td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Polhemus Motion Capture System</td>
			<td style="width:252px;">Liberty, Colchester, VT, USA</td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="42">
			<td height="42" style="height:42px;width:276px;">The Motion Monitor Motion-Tracking Software</td>
			<td style="width:252px;">Innovative Sports Training, Inc., Chicago, IL</td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">Sport Sweatbands</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
		<tr height="21">
			<td height="21" style="height:21px;width:276px;">De-Focusing Lens</td>
			<td style="width:252px;"></td>
			<td style="width:119px;"></td>
			<td></td>
		</tr>
	</tbody>
</table>

methods to explore the influence of top-down visual processes on motor behavior

Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are deliberately planned, while others spontaneously occur below conscious awareness. The deliberate component of this dichotomy has been studied extensively in several contexts, while the spontaneous component remains largely under-explored. Moreover, how perceptual processes modulate these movement classes is still unclear. In particular, a currently debated issue is whether the visuomotor system is governed by the spatial percept produced by a visual illusion or whether it is not affected by the illusion and is governed instead by the veridical percept. Bistable percepts such as 3D depth inversion illusions (DIIs) provide an excellent context to study such interactions and balance, particularly when used in combination with reach-to-grasp movements. In this study, a methodology is developed that uses a DII to clarify the role of top-down processes on motor action, particularly exploring how reaches toward a target on a DII are affected in both deliberate and spontaneous movement domains.

1. Hand Path Trajectories
Results are shown for Representative Subject VT. The Wilk&#39;s Lambda Test Statistic allows for the reduction of our three-dimensional space data into a scalar value by the use of determinants. The Wilk&#39;s lambda statistic uses the likelihood ratio test <img alt="" fo:content-width=".8in" src="/files/ftp_upload/51422/51422eq1.jpg" width="90" />, in which the &#39;within&#39; sum of squares and products form matrix E, and the &#39;total&#39; sum of squares and product...

Watch this Scientific Journal Video about Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior at JoVE.com

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

It is unclear how top-down signals from the ventral visual stream affect movement. We developed a paradigm to test motor behavior towards a target on a 3D depth inversion illusion. Significant differences are reported in both deliberate, goal-directed movements and automatic actions under illusory and veridical viewing conditions.

Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are ...

methods-to-explore-influence-top-down-visual-processes-on-motor

Research

JoVE Journal

Behavior

Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension

The present article describes how to use eye tracking methodologies to study the cognitive processes involved in text comprehension. Measuring eye movements during reading is one of the most precise methods for measuring moment-by-moment (online) processing demands during text comprehension. Cognitive processing demands are reflected by several aspects of eye movement behavior, such as fixation duration, number of fixations, and number of regressions (returning to prior parts of a text). Important properties of eye tracking equipment that researchers need to consider are described, including how frequently the eye position is measured (sampling rate), accuracy of determining eye position, how much head movement is allowed, and ease of use. Also described are properties of stimuli that influence eye movements that need to be controlled in studies of text comprehension, such as the position, frequency, and length of target words. Procedural recommendations related to preparing the participant, setting up and calibrating the equipment, and running a study are given. Representative results are presented to illustrate how data can be evaluated. Although the methodology is described in terms of reading comprehension, much of the information presented can be applied to any study in which participants read verbal stimuli.

The present article describes how to use eye tracking methodologies to study the cognitive processes involved in text comprehension. Descriptions of eye tracking equipment, how to develop experimental stimuli, and procedural recommendations are included. The information presented can be applied to most any study using verbal stimuli.

The present article describes how to use eye  tracking methodologies to study the cognitive processes involved in text  comprehension. Measuring eye ...

Methods to Test Visual Attention Online

Online data collection methods have particular appeal to behavioral scientists because they offer the promise of much larger and much more representative data samples than can typically be collected on college campuses. However, before such methods can be widely adopted, a number of technological challenges must be overcome &#8211; in particular in experiments where tight control over stimulus properties is necessary. Here we present methods for collecting performance data on two tests of visual attention. Both tests require control over the visual angle of the stimuli (which in turn requires knowledge of the viewing distance, monitor size, screen resolution, etc.) and the timing of the stimuli (as the tests involve either briefly flashed stimuli or stimuli that move at specific rates). Data collected on these tests from over 1,700 online participants were consistent with data collected in laboratory-based versions of the exact same tests. These results suggest that with proper care, timing/stimulus size dependent tasks can be deployed in web-based settings.

To replicate laboratory settings, online data collection methods for visual tasks require tight control over stimulus presentation. We outline methods for the use of a web application to collect performance data on two tests of visual attention.

Online data collection methods have particular appeal to behavioral scientists because they offer the promise of much larger and much more representative ...

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Skilled reaching tasks are commonly used in studies of motor skill learning and motor function under healthy and pathological conditions, but can be time-intensive and ambiguous to quantify beyond simple success rates. Here, we describe the training procedure for reach-and-pull tasks with ETH Pattus, a robotic platform for automated forelimb reaching training that records pulling and hand rotation movements in rats. Kinematic quantification of the performed pulling attempts reveals the presence of distinct temporal profiles of movement parameters such as pulling velocity, spatial variability of the pulling trajectory, deviation from midline, as well as pulling success. We show how minor adjustments in the training paradigm result in alterations in these parameters, revealing their relation to task difficulty, general motor function or skilled task execution. Combined with electrophysiological, pharmacological and optogenetic techniques, this paradigm can be used to explore the mechanisms underlying motor learning and memory formation, as well as loss and recovery of function (e.g. after stroke).

A paradigm is presented for training and analysis of an automated skilled reaching task in rats. Analysis of pulling attempts reveals distinct subprocesses of motor learning.

Skilled reaching tasks are commonly used in studies of motor skill learning and motor function under healthy and pathological conditions, but can be ...

Using a Split-belt Treadmill to Evaluate Generalization of Human Locomotor Adaptation

Understanding the mechanisms underlying locomotor learning helps researchers and clinicians optimize gait retraining as part of motor rehabilitation. However, studying human locomotor learning can be challenging. During infancy and childhood, the neuromuscular system is quite immature, and it is unlikely that locomotor learning during early stages of development is governed by the same mechanisms as in adulthood. By the time humans reach maturity, they are so proficient at walking that it is difficult to come up with a sufficiently novel task to study de novo locomotor learning. The split-belt treadmill, which has two belts that can drive each leg at a different speed, enables the study of both short- (i.e., immediate) and long-term (i.e., over minutes-days; a form of motor learning) gait modifications in response to a novel change in the walking environment. Individuals can easily be screened for previous exposure to the split-belt treadmill, thus ensuring that all experimental participants have no (or equivalent) prior experience. This paper describes a typical split-belt treadmill adaptation protocol that incorporates testing methods to quantify locomotor learning and generalization of this learning to other walking contexts. A discussion of important considerations for designing split-belt treadmill experiments follows, including factors like treadmill belt speeds, rest breaks, and distractors. Additionally, potential but understudied confounding variables (e.g., arm movements, prior experience) are considered in the discussion.

We describe a protocol for investigating human locomotor adaptation using the split-belt treadmill, which has two belts that can drive each leg at a different speed. We specifically focus on a paradigm designed to test the generalization of adapted locomotor patterns to different walking contexts (e.g., gait speeds, walking environments).

Understanding the mechanisms underlying locomotor learning helps researchers and clinicians optimize gait retraining as part of motor rehabilitation. ...

The "Motor" in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

This protocol describes a modified serial reaction time (SRT) task used to study implicit motor sequence learning. Unlike the classic SRT task that involves finger-pressing movements while sitting, the modified SRT task requires participants to step with both feet while maintaining a standing posture. This stepping task necessitates whole body actions that impose postural challenges. The foot-stepping task complements the classic SRT task in several ways. The foot-stepping SRT task is a better proxy for the daily activities that require ongoing postural control, and thus may help us better understand sequence learning in real-life situations. In addition, response time serves as an indicator of sequence learning in the classic SRT task, but it is unclear whether response time, reaction time (RT) representing mental process, or movement time (MT) reflecting the movement itself, is a key player in motor sequence learning. The foot-stepping SRT task allows researchers to disentangle response time into RT and MT, which may clarify how motor planning and movement execution are involved in sequence learning. Lastly, postural control and cognition are interactively related, but little is known about how postural control interacts with learning motor sequences. With a motion capture system, the movement of the whole body (e.g., the center of mass (COM)) can be recorded. Such measures allow us to reveal the dynamic processes underlying discrete responses measured by RT and MT, and may aid in elucidating the relationship between postural control and the explicit and implicit processes involved in sequence learning. Details of the experimental set-up, procedure, and data processing are described. The representative data are adopted from one of our previous studies. Results are related to response time, RT, and MT, as well as the relationship between the anticipatory postural response and the explicit processes involved in implicit motor sequence learning.

The &quot;Motor&quot; in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

We introduce the foot-stepping serial reaction time (SRT) task. This modified SRT task, complementing the classic SRT task that involves only finger-pressing movement, better approximates daily sequenced activities and allows researchers to study the dynamic processes underlying discrete response measures and disentangle the explicit process operating in implicit sequence learning.

This protocol describes a modified serial reaction time (SRT) task used to study implicit motor sequence learning. Unlike the classic SRT task that ...

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

In a typical eye tracking study using the visual world paradigm, participants' eye movements to objects or pictures in the visual workspace are recorded via an eye tracker as the participant produces or comprehends a spoken language describing the concurrent visual world. This paradigm has high versatility, as it can be used in a wide range of populations, including those who cannot read and/or who cannot overtly give their behavioral responses, such as preliterate children, elderly adults, and patients. More importantly, the paradigm is extremely sensitive to fine grained manipulations of the speech signal, and it can be used to study the online processing of most topics in language comprehension at multiple levels, such as the fine grained acoustic phonetic features, the properties of words, and the linguistic structures. The protocol described in this article illustrates how a typical visual world eye tracking study is conducted, with an example showing how the online processing of some semantically complex statements can be explored with the visual world paradigm.

The visual world paradigm monitors participants' eye movements in the visual workspace as they are listening to or speaking a spoken language. This paradigm can be used to investigate the online processing of a wide range of psycholinguistic questions, including semantically complex statements, such as disjunctive statements.

In a typical eye tracking study using the visual world paradigm, participants' eye movements to objects or pictures in the visual workspace are recorded ...

Assessing the Influence of Personality on Sensitivity to Magnetic Fields in Zebrafish

To orient themselves in their environment, animals integrate a wide array of external cues, which interact with several internal factors, such as personality. Here, we describe a behavioral protocol designed for the study of the influence of zebrafish personality on their orientation response to multiple external environmental cues, specifically water currents and magnetic fields. This protocol aims to understand whether proactive or reactive zebrafish display different rheotactic thresholds (i.e., the flow speed at which the fish start swimming upstream) when the surrounding magnetic field changes its direction. To identify zebrafish with the same personality, fish are introduced in the dark half of a tank connected with a narrow opening to a bright half. Only proactive fish explore the novel, bright environment. Reactive fish do not exit the dark half of the tank. A swimming tunnel with low flow rates is used to determine the rheotactic threshold. We describe two setups to control the magnetic field in the tunnel, in the range of the earth&#8217;s magnetic field intensity: one that controls the magnetic field along the flow direction (one dimension) and one that allows a three-axial control of the magnetic field. Fish are filmed while experiencing a stepwise increase of the flow speed in the tunnel under different magnetic fields. Data on the orientation behavior are collected through a video-tracking procedure and applied to a logistic model to allow the determination of the rheotactic threshold. We report representative results collected from shoaling zebrafish. Specifically, these demonstrate that only reactive, prudent fish show variations of the rheotactic threshold when the magnetic field varies in its direction, while proactive fish do not respond to magnetic field changes. This methodology can be applied to the study of magnetic sensitivity and rheotactic behavior of many aquatic species, both displaying solitary or shoaling swimming strategies.

We describe a behavioral protocol designed to assess how zebrafish&#8217;s personalities influence their response to water currents and weak magnetic fields. Fishes with the same personalities are separated based on their explorative behavior. Then, their rheotactic orientation behavior in a swimming tunnel with a low flow rate and under different magnetic conditions is observed.

To orient themselves in their environment, animals integrate a wide array of external cues, which interact with several internal factors, such as ...

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Multisensory integration research investigates how the brain processes simultaneous sensory information. Research on animals (mainly cats and primates) and humans reveal that intact multisensory integration is crucial for functioning in the real world, including both cognitive and physical activities. Much of the research conducted over the past several decades documents multisensory integration effects using diverse psychophysical, electrophysiological, and neuroimaging techniques. While its presence has been reported, the methods used to determine the magnitude of multisensory integration effects varies and typically faces much criticism. In what follows, limitations of previous behavioral studies are outlined and a step-by-step tutorial for calculating the magnitude of multisensory integration effects using robust probability models is provided.

The current study aims to provide a step-by-step tutorial for calculating the magnitude of multisensory integration effects in an effort to facilitate the production of translational research studies across diverse clinical populations.

Multisensory integration research investigates how the brain processes simultaneous sensory information. Research on animals (mainly cats and primates) ...

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm

We discuss the use of the preferential looking paradigm in eye tracking studies in order to study how infants develop, understand, and attend to the world around them. Eye tracking is a safe and non-invasive way to collect gaze data from infants, and the preferential looking paradigm is simple to design and only requires the infant to be attending to the screen. By simultaneously showing two visual stimuli that differ in one dimension, we can assess whether infants show different looking behavior for either stimulus, thus demonstrating sensitivity to that difference. The challenges in such experimental approaches are that experiments must be kept brief (no more than 10 min) and be carefully controlled such that the two stimuli differ in only one way. The interpretation of null results must also be carefully considered. In this paper, we illustrate a successful example of an infant eye tracking study with a preferential looking paradigm to discover that 6-month-olds are sensitive to linguistic cues in a signed language despite having no prior exposure to signed language, suggesting that infants possess intrinsic or innate sensitivities to these cues.

Eye tracking studies using a preferential looking paradigm can be used to study infants&#39;&#160;emerging understanding of, and attention to, their external visual world.

We discuss the use of the preferential looking paradigm in eye tracking studies in order to study how infants develop, understand, and attend to the world ...

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki

This article presents a protocol for investigating the role of visual imagery in the bouba/kiki-effect, whether training in noticing the bouba/kiki shape-audio regularities affects the bouba/kiki-effect and the recognition of individual bouba and kiki shapes, and finally what mental images these regularities produce. To generate bouba/kiki shape-audio regularities, there were two types of shapes (filled; outlined) and two types of audio (word; non-word sound). Three groups of individuals participated in three experiments: Blind, blindfold, and vision. The experiments were conducted in fixed order across participants, with no break between them. In Experiment 1 (pre-test-post-test design with three repeated within-group measures) the participants were asked to pick out the shape they associated with the auditory bouba/kiki; in Experiment 2 (within-subject design), to name one shape and some audio (sometimes congruous; sometimes incongruous) as &#8216;bouba&#8217; or &#8216;kiki;&#8217; and in Experiment 3 (post-test only design), to draw the shape they associated with the auditory bouba/kiki. The results suggest that the blindfold-group draw upon visual imagery to solve new problems, but not long term; that training in noticing bouba/kiki shape-audio regularities affects the bouba/kiki-effect and the recognition of individual bouba and kiki shapes, but differently in each experimental group; and that all experimental groups create mental images of the most characteristic shape feature of bouba (curve) and kiki (angle). In fact, the effect of visual imagery is robust across tasks, but not long term; the effect of learning shape-audio regularities is robust long term, but not across tasks. The presented protocol is appropriate for investigating the effect of visual imagery and learning shape-audio regularities, when they occur and how robust they are; in specific individuals and groups of individuals. This protocol is unique in that it keeps under control both the visual imagery and the sensory information during training and testing.

The aim of the presented protocol is to investigate the role of visual imagery in the bouba/kiki-effect, whether training in noticing the bouba/kiki shape-audio regularities affects the bouba/kiki-effect and the recognition of individual bouba and kiki shapes, and finally what mental images these regularities produce.

This article presents a protocol for investigating the role of visual imagery in the bouba/kiki-effect, whether training in noticing the bouba/kiki ...