Name: applying incongruent visual-tactile stimuli during object transfer with vibro-tactile feedback
Uploaded: 2019-05-23T14:30:00
Description: Watch this Scientific Journal Video about Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback at JoVE.com

This study was not funded.

The following protocol follows the guidelines of human research ethics committee of the university. See Table of Materials for reference to the commercial products.
NOTE: After receiving approval of the university ethics committee, 20 healthy individuals (7 males and 13 females, mean and standard deviation [SD] of age 30.2 &#177; 16.3 years) were recruited. Each subject read and signed an informed consent form pretrial. Inclusion criteria were right-handed individuals aged 18 ...

<ol>
	<li>Aggelopoulos, N. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Perceptual+inference.">Perceptual inference.</a> Neuroscience and Biobehavioral Reviews. 55, 375-392 (2015).</li><li>van der Groen, O., van der Burg, E., Lunghi, C., Alais, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Touch+influences+visual+perception+with+a+tight+orientation-tuning.">Touch influences visual perception with a tight orientation-tuning.</a> PloS One. 8 (11), e79558 (2013).</li><li>Pei, Y. C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Cross-modal+sensory+integration+of+visual-tactile+motion+information:+instrument+design+and+human+psychophysics.">Cross-modal sensory integration of visual-tactile motion information: instrument design and human psychophysics.</a> Sensors. 13 (6), 7212-7223 (2013).</li><li>Kording, K. P., Wolpert, D. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Bayesian+integration+in+sensorimotor+learning.">Bayesian integration in sensorimotor learning.</a> Nature. 427 (6971), 244-247 (2004).</li><li>Tajadura-Jimenez, A., Banakou, D., Bianchi-Berthouze, N., Slater, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Embodiment+in+a+Child-Like+Talking+Virtual+Body+Influences+Object+Size+Perception,+Self-Identification,+and+Subsequent+Real+Speaking.">Embodiment in a Child-Like Talking Virtual Body Influences Object Size Perception, Self-Identification, and Subsequent Real Speaking.</a> Scientific Reports. 7 (1), (2017).</li><li>Campos, J. L., Butler, J. S., Bulthoff, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Multisensory+integration+in+the+estimation+of+walked+distances.">Multisensory integration in the estimation of walked distances.</a> Experimental Brain Research. 218 (4), 551-565 (2012).</li><li>Sun, H. J., Campos, J. L., Chan, G. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Multisensory+integration+in+the+estimation+of+relative+path+length.">Multisensory integration in the estimation of relative path length.</a> Experimental Brain Research. 154 (2), 246-254 (2004).</li><li>Parmentier, F. B., Ljungberg, J. K., Elsley, J. V., Lindkvist, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+behavioral+study+of+distraction+by+vibrotactile+novelty.">A behavioral study of distraction by vibrotactile novelty.</a> Journal of Experimental Psychology, Human Perception, and Performance. 37 (4), 1134-1139 (2011).</li><li>Sigrist, R., Rauter, G., Riener, R., Wolf, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Augmented+visual,+auditory,+haptic,+and+multimodal+feedback+in+motor+learning:+a+review.">Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review.</a> Psychonomic Bulletin &amp; Review. 20 (1), 21-53 (2013).</li><li>Hebert, J. S., Lewicke, J., Williams, T. R., Vette, A. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Normative+data+for+modified+Box+and+Blocks+test+measuring+upper-limb+function+via+motion+capture.">Normative data for modified Box and Blocks test measuring upper-limb function via motion capture.</a> Journal of Rehabilitation Research and Development. 51 (6), 918-932 (2014).</li><li>Raveh, E., Portnoy, S., Friedman, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Adding+vibrotactile+feedback+to+a+myoelectric-controlled+hand+improves+performance+when+online+visual+feedback+is+disturbed.">Adding vibrotactile feedback to a myoelectric-controlled hand improves performance when online visual feedback is disturbed.</a> Human Movement Science. 58, 32-40 (2018).</li><li>Raveh, E., Friedman, J., Portnoy, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluation+of+the+effects+of+adding+vibrotactile+feedback+to+myoelectric+prosthesis+users+on+performance+and+visual+attention+in+a+dual-task+paradigm.">Evaluation of the effects of adding vibrotactile feedback to myoelectric prosthesis users on performance and visual attention in a dual-task paradigm.</a> Clinical Rehabilitation. 32 (10), 1308-1316 (2018).</li><li>Raveh, E., Portnoy, S., Friedman, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Myoelectric+Prosthesis+Users+Improve+Performance+Time+and+Accuracy+Using+Vibrotactile+Feedback+When+Visual+Feedback+Is+Disturbed.">Myoelectric Prosthesis Users Improve Performance Time and Accuracy Using Vibrotactile Feedback When Visual Feedback Is Disturbed.</a> Archives of Physical Medicine and Rehabilitation. , (2018).</li><li>Raveh, E., Friedman, J., Portnoy, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Visuomotor+behaviors+and+performance+in+a+dual-task+paradigm+with+and+without+vibrotactile+feedback+when+using+a+myoelectric+controlled+hand.">Visuomotor behaviors and performance in a dual-task paradigm with and without vibrotactile feedback when using a myoelectric controlled hand.</a> Assistive Technology: The Official Journal of RESNA. , 1-7 (2017).</li><li>Dienes, Z. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Using+Bayes+to+get+the+most+out+of+non-significant+results.">Using Bayes to get the most out of non-significant results.</a> Frontiers in Psychology. 5, 781 (2014).</li><li>Shams, L., Murray, M. M., Wallace, M. T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Early+Integration+and+Bayesian+Causal+Inference+in+Multisensory+Perception.">Early Integration and Bayesian Causal Inference in Multisensory Perception.</a> The Neural Bases of Multisensory Processes. , (2012).</li><li>D'Amour, S., Pritchett, L. M., Harris, L. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Bodily+illusions+disrupt+tactile+sensations.">Bodily illusions disrupt tactile sensations.</a> Journal of Experimental Psychology, Human Perception, and Performance. 41 (1), 42-49 (2015).</li><li>Tidoni, E., Fusco, G., Leonardis, D., Frisoli, A., Bergamasco, M., Aglioti, S. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Illusory+movements+induced+by+tendon+vibration+in+right-+and+left-handed+people.">Illusory movements induced by tendon vibration in right- and left-handed people.</a> Experimental Brain Research. 233 (2), 375-383 (2015).</li><li>Fuentes, C. T., Gomi, H., Haggard, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Temporal+features+of+human+tendon+vibration+illusions.">Temporal features of human tendon vibration illusions.</a> The European Journal of Neuroscience. 36 (12), 3709-3717 (2012).</li><li>de Vignemont, F., Ehrsson, H. H., Haggard, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Bodily+illusions+modulate+tactile+perception.">Bodily illusions modulate tactile perception.</a> Current Biology. 15 (14), 1286-1290 (2005).</li><li>Marotta, A., Tinazzi, M., Cavedini, C., Zampini, M., Fiorio, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Individual+Differences+in+the+Rubber+Hand+Illusion+Are+Related+to+Sensory+Suggestibility.">Individual Differences in the Rubber Hand Illusion Are Related to Sensory Suggestibility.</a> PloS One. 11 (12), e0168489 (2016).</li><li>Stevenson, R. A., Zemtsov, R. K., Wallace, M. T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Individual+differences+in+the+multisensory+temporal+binding+window+predict+susceptibility+to+audiovisual+illusions.">Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions.</a> Journal of Experimental Psychology, Human Perception, and Performance. 38 (6), 1517-1529 (2012).</li><li>Maravita, A., Spence, C., Driver, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Multisensory+integration+and+the+body+schema:+close+to+hand+and+within+reach.">Multisensory integration and the body schema: close to hand and within reach.</a> Current Biology. 13 (13), R531-R539 (2003).</li><li>Carey, D. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Multisensory+integration:+attending+to+seen+and+felt+hands.">Multisensory integration: attending to seen and felt hands.</a> Current Biology. 10 (23), R863-R865 (2000).</li><li>Tsakiris, M., Haggard, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+rubber+hand+illusion+revisited:+visuotactile+integration+and+self-attribution.">The rubber hand illusion revisited: visuotactile integration and self-attribution.</a> Journal of Experimental Psychology, Human Perception, and Performance. 31 (1), 80-91 (2005).</li></ol>

In this study, a protocol that quantifies the effect of adding VTF on the object transfer kinematics in the presence of incongruent visual-tactile stimuli was presented. To the best of our knowledge, this is the only protocol available to test the effect of VTF on the response to incongruent visual-tactile stimuli. The several critical steps involved in the application of incongruent visual-tactile stimuli during object transfer with VTF include the following: attaching the VTF system to the subject, activating the VTF, ...

Illusions are exploitations of the limitations of our senses, as we mistakenly perceive information that deviates from objective reality. Our perceptual inference is based on our experience in interpreting sensory data and on the calculation of our brain of the most reliable estimate of reality in the presence of ambiguous sensory input1.
A sub-category in the research of illusions is one that combines incongruent sensory signals. The illusion that results from incongruent sensory signals originates from the constant multisensory integration performed by our brain. While there are numerous studies concerning incongruence in visual-auditory signals, incongruence in other sensory pairs is less reported. This difference in the number of reports might be attributed to the higher simplicity in designing a setup that incorporates visual-auditory incongruence. However, studies that report results relating to other sensory pairs modalities, are interesting. For example, the effect of incongruent visual-haptic signals on visual sensitivity2 was studied using a system where the visual and haptic stimuli were matched in spatial frequency; however, the haptic and visual orientation was identical (congruent) or orthogonal (incongruent). In another study, the effect of incongruent visual-tactile motion stimuli on the perceived visual direction of motion was investigated using a visual-tactile cross-modal integration stimulator with a lighted panel that presents visual stimuli and a tactile stimulator that presents tactile motion stimuli with arbitrary motion direction, speed, and indentation depth in the skin3. It was suggested that we internally represent both the statistical distribution of the task and our sensory uncertainty, combining them in a manner consistent with a performance-optimizing Bayesian process4.
Virtual reality has made the ability to deceive the visual feedback to the subject an easy task. Several studies used multisensory virtual reality to misalign visual and somatosensory information. For example, virtual reality was recently used to induce embodiment in a child&#8217;s body, with or without activation of a child-like voice distortion5. In another example, the visual presentation of the walking distance during self-motion was extended and was therefore incongruent with the travel distance felt by body-based cues6. A similar virtual reality setup was designed for a cycling activity7. All of the aforementioned literature, however, did not combine an interference to one of the senses, in addition to the incongruent signal. We chose the tactile sense to receive such a disturbance.
Our tactile sensory system provides direct evidence as to whether an object is being grasped. We therefore expect that when direct visual feedback is distorted or unavailable, the role of the tactile sensory system in object manipulation tasks will be prominent. However, what would happen if the tactile sensory channel was also disturbed? This is a possible outcome of using vibrotactile feedback (VTF) for sensory augmentation, as it captures the attention of the individual8. Today, augmented feedback of different modalities is used as an external tool, meant to enhance our internal sensory feedback and improve performance during motor learning, in sport and in rehabilitation settings9.
The study of incongruent visual-tactile stimuli may enhance our understanding regarding perception of the sensory input. Particularly, quantification of the additive or reductive value of VTF during motor function that involves incongruent visual-tactile stimuli, can assist in future prosthetics design, smart sport-wear, or any other garments that incorporate VTF. Since amputees are deprived of tactile stimuli at the distal aspect of their residuum, their daily usage of the VTF, embedded in the prosthetic to convey knowledge of grasping, for example, might influence how they perceive visual feedback. Understanding of the mechanism of perception under these conditions, will allow engineers to perfect VTF modalities to reduce the negative effect on VTF users.
We aimed to test the effect of VTF on the response to incongruent visual-tactile stimuli. In the presented setup, the tactile feedback is acquired by grasping a block and moving it across a partition; the visual feedback is a real-time virtual presentation of the moving block and the partition (acquired using a motion capture system). Since the subject is prevented from seeing the actual hand movement, the only visual feedback is the virtual one. The congruent feedback is the reliable presentation of the movement of the block, so that the subject feels that the block is grasped and sees it move along with the path of the hand. The incongruent feedback appears as the movement of the block diverts from the actual movement path, so that it seems to drop from the hand when it is actually still held by the subject, thereby contradicting the tactile feedback. Three hypotheses were tested: when moving an object from one place to another using virtual visual feedback, (i) the path and duration of the object&#8217;s transfer motion will increase when incongruent visual-tactile stimuli is presented, (ii) this change will increase when incongruent visual-tactile stimuli is presented and VTF is activated on the moving arm, and (iii) a positive correlation will be found between the perceived difficulty level of performing the task with the VTF activated and the path and duration of the object&#8217;s transfer motion. The first hypothesis originates from aforementioned literature that report that various modalities of incongruent feedback affect our responses. The second hypothesis relates to the previous findings that VTF captures the attention of the individual. For the third hypothesis, we assumed that subjects who were more disturbed by the VTF, will trust the virtual visual feedback more than their tactile sense.

<table>
	<tbody>
		<tr>
			<td>3D printer</td>
			<td>Makerbot</td>
			<td></td>
			<td>https://www.makerbot.com/</td>
		</tr>
		<tr>
			<td>Box and Blocks test</td>
			<td>Sammons Preston</td>
			<td></td>
			<td>https://www.performancehealth.com/box-and-blocks-test</td>
		</tr>
		<tr>
			<td>Flexiforce sensors (1lb)</td>
			<td>Tekscan Inc.</td>
			<td></td>
			<td>https://www.tekscan.com/force-sensors</td>
		</tr>
		<tr>
			<td>JASP</td>
			<td>JASP Team</td>
			<td></td>
			<td>https://jasp-stats.org/</td>
		</tr>
		<tr>
			<td>Labview</td>
			<td>National Instruments</td>
			<td></td>
			<td>http://www.ni.com/en-us/shop/labview/labview-details.html</td>
		</tr>
		<tr>
			<td>Micro Arduino</td>
			<td>Arduino LLC</td>
			<td></td>
			<td>https://store.arduino.cc/arduino-micro</td>
		</tr>
		<tr>
			<td>Motion capture system</td>
			<td>Qualisys</td>
			<td></td>
			<td>https://www.qualisys.com</td>
		</tr>
		<tr>
			<td>Shaftless vibration motor</td>
			<td>Pololu</td>
			<td></td>
			<td>https://www.pololu.com/product/1638</td>
		</tr>
		<tr>
			<td>SPSS</td>
			<td>IBM</td>
			<td></td>
			<td>https://www.ibm.com/analytics/spss-statistics-software</td>
		</tr>
	</tbody>
</table>

applying incongruent visual-tactile stimuli during object transfer with vibro-tactile feedback

The application of incongruent sensory signals that involves disrupted tactile feedback is rarely explored, specifically with the presence of vibrotactile feedback (VTF). This protocol aims to test the effect of VTF on the response to incongruent visual-tactile stimuli. The tactile feedback is acquired by grasping a block and moving it across a partition. The visual feedback is a real-time virtual presentation of the moving block, acquired using a motion capture system. The congruent feedback is the reliable presentation of the movement of the block, so that the subject feels that the block is grasped and see it move along with the path of the hand. The incongruent feedback appears as the movement of the block diverts from the actual movement path, so that it seems to drop from the hand when it is actually still held by the subject, thereby contradicting the tactile feedback. Twenty subjects (age 30.2 &#177; 16.3) repeated 16 block transfers, while their hand was hidden. These were repeated with VTF and without VTF (total of 32 block transfers). Incongruent stimuli were presented randomly twice within the 16 repetitions in each condition (with and without VTF). Each subject was asked to rate the difficulty level of performing the task with and without the VTF. There were no statistically significant differences in the length of the hand paths and durations between transfers recorded with congruent and incongruent visual-tactile signals &#8211; with and without the VTF. The perceived difficulty level of performing the task with the VTF significantly correlated with the normalized path length of the block with VTF (r = 0.675, p = 0.002). This setup is used to quantify the additive or reductive value of VTF during motor function that involves incongruent visual-tactile stimuli. Possible applications are prosthetics design, smart sport-wear, or any other garments that incorporate VTF.

We used the described technique to test the three hypotheses that when moving an object from one place to another using virtual visual feedback: (i) the path and duration of the object&#8217;s transfer motion will increase when incongruent visual-tactile stimuli is presented; (ii) this change will increase when incongruent visual-tactile stimuli is presented and VTF is activated on the moving arm; and (iii) a positive correlation will be found between the perceived difficulty level of performing the task with the VTF act...

Watch this Scientific Journal Video about Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback at JoVE.com

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

We present a protocol to apply incongruent visual-tactile stimuli during an object transfer task. Specifically, during block transfers, performed while the hand is hidden, a virtual presentation of the block shows random occurrences of false block drops. The protocol also describes adding vibrotactile feedback while performing the motor task.

The application of incongruent sensory signals that involves disrupted tactile feedback is rarely explored, specifically with the presence of vibrotactile ...

The protocol tests the effect of vibro-tactile feedback on the response to incongruent visual-tactile stimuli. A motion capture system calculates the 3D coordinates of a block transferred across a partition. So the analysis of the movement time and path of the block in each repetition can be performed efficiently and precisely at the end of the trial.The reaction of the subject to the incongruent visual-tactile stimuli in the presence of vibro-tactile feedback can be easily quantified. Quantification of the positive or negative contribution of vibro-tactile feedback during motor function that involves incongruent visual-tactile stimuli can assist in future design of operative prostheses, haptics, and surgical tools, smart sportswear, or any other garments that incorporate vibro-tactile feedback. Any motion capture system and vibro-tactile feedback system can be used to replicate our protocol.Begin by obtaining a wooden box with a 15.2 centimeter high partition in the center. Place a soft sponge layer on both sides of the partition. Then, place six passive reflective markers on the aspect opposite to the screen at the four corners and on both ends of the partition.Use a 3D printer to manufacture a cube with the dimensions of 2.5 centimeters by 2.5 centimeters by 2.5 centimeters attached to a base with the dimensions of 4.5 centimeters by 4.5 centimeters by one centimeter. Next, place a large screen, approximately 1.5 meters, in front of a table and place the box on the table, 10 centimeters from the edge opposite to the screen. Finally, use a six-camera motion capture system activated at 100 hertz to visualize the partition and the movement of the block in real time.Calibrate the motion capture system with an instrumented wand so that the block and the partition of the box are recognized as rigid bodies. Then, place the box on the table 10 centimeters from the edge opposite to the screen. First, instruct the subject to remove any watches, bracelets, and rings.Attach the VTF system controller to their forearm. Then, attach two thin and flexible force sensors to the palmar aspect of the thumb and index fingers over a thin, spongy layer. Place a cuff on the skin of the upper arm of the subject and ensure it sits comfortably.Press the button to activate the battery attached to the controller. And then ask the subject to press their thumb and index fingers together lightly. Instruct the subject to train for 10 minutes in grasping the block as lightly as possible, using only the two instrumented fingers.Have them lift the block, move it, and place it back on the table several times, attempting to apply a minimal amount of force on the block. Next, instruct the subject to stand close to the table where the box and partition are placed. Place a divider at the edge of the table near the subject and above the box so that the subject is unable to see the box, but can easily see the screen in front of him or her.Then, place the block in the middle of the right compartment of the box and guide the hand of the subject to it. Start the software controlling the cameras of the motion capture system. In the control panel of the visual feedback software, select with/without VTF, type the code of the subject, click run, connect, open, and start.Instruct the subject to transfer the block 16 times with the force sensors instrumented hand, while viewing the movement of the virtual block on the screen. After each transfer, move the block back across the partition to its starting location. After the subject completes all 16 repetitions, click stop in the software.Finally, ask the subject to rate the difficulty level of performing the task of transferring the block 16 times twice, with and without the VTF, according to the following scale. Zero is not difficult at all, one is slightly difficult, two is moderately difficult, three is very difficult, and four is extremely difficult. Results indicated that the perceived difficulty level from zero to four of performing the task with the VTF significantly correlated with the normalized path length of the block with VTF.The normalized path length in the presence of incongruent visual-tactile signals was longer for subjects who perceived the task as more difficult when using the VTF. Further, the normalized path length was significantly longer for subjects who perceived the task as more difficult when using the VTF. It is critical that the subject is not aware of the possibility of misleading feedback during the trial.To ensure this, the bottom of the box is lined with a soft sponge layer and the subject wears circum-ear earphones to eliminate auditory feedback of the block falling and hitting the wooden box. Also, the two transfers with incongruent feedback should be chosen randomly out of the 16 transfers performed.

applying-incongruent-visual-tactile-stimuli-during-object-transfer

Research

JoVE Journal

Behavior

Irrelevant Stimuli and Action Control: Analyzing the Influence of Ignored Stimuli via the Distractor-Response Binding Paradigm

Selection tasks in which simple stimuli (e.g. letters) are presented and a target stimulus has to be selected against one or more distractor stimuli are frequently used in the research on human action control. One important question in these settings is how distractor stimuli, competing with the target stimulus for a response, influence actions. The distractor-response binding paradigm can be used to investigate this influence. It is particular useful to separately analyze response retrieval and distractor inhibition effects. Computer-based experiments are used to collect the data (reaction times and error rates). In a number of sequentially presented pairs of stimulus arrays (prime-probe design), participants respond to targets while ignoring distractor stimuli. Importantly, the factors response relation in the arrays of each pair (repetition vs. change) and distractor relation (repetition vs. change) are varied orthogonally. The repetition of the same distractor then has a different effect depending on response relation (repetition vs. change) between arrays. This result pattern can be explained by response retrieval due to distractor repetition. In addition, distractor inhibition effects are indicated by a general advantage due to distractor repetition. The described paradigm has proven useful to determine relevant parameters for response retrieval effects on human action.

The distractor-response binding paradigm is described. It can be used to shed light on the influence irrelevant stimuli, competing with targets for a response, can have on human action. Both response retrieval effects and distractor inhibition effects can be analyzed within the paradigm.

Selection tasks in which simple stimuli (e.g. letters) are presented and a target stimulus has to be selected against one or more distractor stimuli are ...

Applying Stereotactic Injection Technique to Study Genetic Effects on Animal Behaviors

Stereotactic injection is a useful technique to deliver high titer lentiviruses to targeted brain areas in mice. Lentiviruses can either overexpress or knockdown gene expression in a relatively focused region without significant damage to the brain tissue. After recovery, the injected mouse can be tested on various behavioral tasks such as the Open Field Test (OFT) and the Forced Swim Test (FST). The OFT is designed to assess locomotion and the anxious phenotype in mice by measuring the amount of time that a mouse spends in the center of a novel open field. A more anxious mouse will spend significantly less time in the center of the novel field compared to controls. The FST assesses the anti-depressive phenotype by quantifying the amount of time that mice spend immobile when placed into a bucket of water. A mouse with an anti-depressive phenotype will spend significantly less time immobile compared to control animals. The goal of this protocol is to use the stereotactic injection of a lentivirus in conjunction with behavioral tests to assess how genetic factors modulate animal behaviors.

Stereotactic injection of lentiviruses expressing cDNAs or shRNAs can modulate gene expression in specific brain areas of mice. Here, we present a protocol to combine stereotactic injections with behavioral tasks, such as the Open Field Test (OFT) and the Forced Swim Test (FST).

Stereotactic injection is a useful technique to deliver high titer lentiviruses to targeted brain areas in mice. Lentiviruses can either overexpress or ...

Force and Position Control in Humans - The Role of Augmented Feedback

During motor behaviour, humans interact with the environment by for example manipulating objects and this is only possible because sensory feedback is constantly integrated into the central nervous system and these sensory inputs need to be weighted in order meet the task specific goals. Additional feedback presented as augmented feedback was shown to have an impact on motor control and motor learning. A number of studies investigated whether force or position feedback has an influence on motor control and neural activation. However, as in the previous studies the presentation of the force and position feedback was always identical, a recent study assessed whether not only the content but also the interpretation of the feedback has an influence on the time to fatigue of a sustained submaximal contraction and the (inhibitory) activity of the primary motor cortex using subthreshold transcranial magnetic stimulation. This paper describes one possible way to investigate the influence of the interpretation of feedback on motor behaviour by investigating the time to fatigue of submaximal sustained contractions together with the neuromuscular adaptations that can be investigated using surface EMG. Furthermore, the current protocol also describes how motor cortical (inhibitory) activity can be investigated using subthreshold TMS, a method known to act solely on the cortical level. The results show that when participants interpret the feedback as position feedback, they display a significantly shorter time to fatigue of a submaximal sustained contraction. Furthermore, subjects also displayed an increased inhibitory activity of the primary cortex when they believed to receive position feedback compared when they believed to receive force feedback. Accordingly, the results show that interpretation of feedback results in differences on a behavioural level (time to fatigue) that is also reflected in interpretation-specific differences in the amount of inhibitory M1 activity.

Controlling an identical movement with position or force feedback results in different neural activation and motor behavior. This protocol describes how to investigate behavioral changes by looking at neuromuscular fatigue and how to evaluate motor cortical (inhibitory) activity using subthreshold TMS with respect to the interpretation of augmented feedback.

During motor behaviour, humans interact with the environment by for example manipulating objects and this is only possible because sensory feedback is ...

A Method for Manipulating Blood Glucose and Measuring Resulting Changes in Cognitive Accessibility of Target Stimuli

Much research in social psychology has investigated the impact of bodily energy need on cognition and decision-making. As such, blood glucose, the body's primary energy source, has been of special interest to researchers for years. Fluctuations in blood glucose have been linked to a variety of changes in cognitive and behavioral processes, such as self-control, political attitudes, and eating behavior. To help meet growing interest in the links between bodily energy need and these processes, this manuscript offers a simple methodology to experimentally manipulate blood glucose using a fasting procedure followed by administration of a sugar-sweetened, unsweetened, or artificially-sweetened beverage. This is followed by presentation of a method for measuring resulting changes in implicit cognition using a lexical decision-task. In this task, participants are asked to identify whether strings of letters are words or non-words and response latencies are recorded. Sample results from a recent publication are presented as an example of the applications for the experimental manipulation of blood glucose and the lexical decision task measures.

The authors introduce a method for manipulating blood glucose and measuring resulting changes in cognitive accessibility of target words using a lexical decision task.

Much research in social psychology has investigated the impact of bodily energy need on cognition and decision-making.  As such, blood glucose, the body's ...

Novel Object Recognition Test for the Investigation of Learning and Memory in Mice

The object recognition test (ORT) is a commonly used behavioral assay for the investigation of various aspects of learning and memory in mice. The ORT is fairly simple and can be completed over 3 days: habituation day, training day, and testing day. During training, the mouse is allowed to explore 2 identical objects. On test day, one of the training objects is replaced with a novel object. Because mice have an innate preference for novelty, if the mouse recognizes the familiar object, it will spend most of its time at the novel object. Due to this innate preference, there is no need for positive or negative reinforcement or long training schedules. Additionally, the ORT can also be modified for numerous applications. The retention interval can be shortened to examine short-term memory, or lengthened to probe long-term memory. Pharmacological intervention can be used at various times prior to training, after training, or prior to recall to investigate different phases of learning (i.e., acquisition, early or late consolidation, or recall). Overall, the ORT is a relatively low-stress, efficient test for memory in mice, and is appropriate for the detection of neuropsychological changes following pharmacological, biological, or genetic manipulations.

The object recognition test (ORT) is a simple and efficient assay for evaluating learning and memory in mice. The methodology is described below.

The object recognition test (ORT) is a commonly used behavioral assay for the investigation of various aspects of learning and memory in mice. The ORT is ...

Control of Eating Behavior Using a Novel Feedback System

Subjects eat food from a plate that sits on a scale connected to a computer that records the weight loss of the plate during the meal and makes up a curve of food intake, meal duration and rate of eating modeled by a quadratic equation. The purpose of the method is to change eating behavior by providing visual feedback on the computer screen that the subject can adapt to because her/his own rate of eating appears on the screen during the meal. The data generated by the method is automatically analyzed and fitted to the quadratic equation using a custom made algorithm. The method has the advantage of recording eating behavior objectively and offers the possibility of changing eating behavior both in experiments and in clinical practice. A limitation may be that experimental subjects are affected by the method. The same limitation may be an advantage in clinical practice, as eating behavior is more easily stabilized by the method. A treatment that uses this method has normalized body weight and restored the health of several hundred patients with anorexia nervosa and other eating disorders and has reduced the weight and improved the health of severely overweight patients.

Subjects eat food from a plate placed on a scale connected to a computer that records the weight loss of the plate during the meal. Feedback on the computer screen allows the subject to adapt her/his eating behavior to reference curves thus normalizing body weight.

Subjects eat food from a plate that sits on a scale connected to a computer that records the weight loss of the plate during the meal and makes up a curve ...

Novel Object Recognition and Object Location Behavioral Testing in Mice on a Budget

Ethologically relevant behavioral testing is a critical component of any study that uses mouse models to study the cognitive effects of various physiological or pathological changes. The object location task (OLT) and the novel object recognition task (NORT) are two effective behavioral tasks commonly used to reveal the function and relative health of specific brain regions involved in memory. While both of these tests exploit the inherent preference of mice for the novelty to reveal memory for previously encountered objects, the OLT primarily evaluates spatial learning, which relies heavily on hippocampal activity. The NORT, in contrast, evaluates non-spatial learning of object identity, which relies on multiple brain regions. Both tasks require an open-field-testing arena, objects with equivalent intrinsic value to mice, appropriate environmental cues, and video recording equipment and the software. Commercially available systems, while convenient, can be costly. This manuscript details a simple, cost-effective method for building the arenas and setting up the equipment necessary to perform the OLT and NORT. Furthermore, the manuscript describes an efficient testing protocol that incorporates both OLT and NORT and provides typical methods for data acquisition and analysis, as well as representative results. Successful completion of these tests can provide valuable insight into the memory function of various mouse model systems and appraise the underlying neural regions that support these functions.

Here we provide a protocol which includes comprehensive instructions for the economical establishment of murine object location and novel object recognition behavioral testing, including the design, cost, and construction of required equipment as well as execution of behavioral testing, data collection, and analysis.

Ethologically relevant behavioral testing is a critical component of any study that uses mouse models to study the cognitive effects of various ...

A Vibrotactile Feedback Device for Seated Balance Assessment and Training

Postural perturbations, motion tracking, and sensory feedback are modern techniques used to challenge, assess, and train upright sitting, respectively. The goal of the developed protocol is to construct and operate a sitting platform that can be passively destabilized while an inertial measurement unit quantifies its motion and vibrating elements deliver tactile feedback to the user. Interchangeable seat attachments alter the stability level of the device to safely challenge sitting balance. A built-in microcontroller allows fine-tuning of the feedback parameters to augment sensory function. Posturographic measures, typical of balance assessment protocols, summarize the motion signals acquired during timed balance trials. No dynamic sitting protocol to date provides variable challenge, quantification, and sensory feedback free of laboratory constraints. Our results demonstrate that non-disabled users of the device exhibit significant changes in posturographic measures when balance difficulty is altered or vibrational feedback provided. The portable, versatile device has potential applications in rehabilitation (following skeletal, muscular, or neurological injury), training (for sports or spatial awareness), entertainment (via virtual or augmented reality), and research (of sitting-related disorders).

A sitting platform has been developed and assembled that passively destabilizes sitting posture in humans. During the user&#39;s stabilizing task, an inertial measurement unit records the device&#39;s motion, and vibrating elements deliver performance-based feedback to the seat. The portable, versatile device may be used in rehabilitation, assessment, and training paradigms.

Postural perturbations, motion tracking, and sensory feedback are modern techniques used to challenge, assess, and train upright sitting, respectively. ...

Multi-Modal Signals for Analyzing Pain Responses to Thermal and Electrical Stimuli

The assessment of pain relies mostly on methods that require a person to communicate. However, for people with cognitive and verbal impairments, existing methods are not sufficient as they lack reliability and validity. To approach this problem, recent research focuses on an objective pain assessment facilitated by parameters of responses derived from physiology, and video and audio signals. To develop reliable automated pain recognition systems, efforts have been made in creating multimodal databases in order to analyze pain and detect valid pain patterns. While the results are promising, they only focus on discriminating pain or pain intensities versus no pain. In order to advance this, research should also consider the quality and duration of pain as they provide additional valuable information for more advanced pain management. To complement existing databases and the analysis of pain regarding quality and length, this paper proposes a psychophysiological experiment to elicit, measure, and collect valid pain reactions. Participants are subjected to painful stimuli that differ in intensity (low, medium, and high), duration (5 s / 1 min), and modality (heat / electric pain) while audio, video (e.g., facial expressions, body gestures, facial skin temperature), and physiological signals (e.g., electrocardiogram [ECG], skin conductance level [SCL], facial electromyography [EMG], and EMG of M. trapezius) are being recorded. The study consists of a calibration phase to determine a subject&#8217;s individual pain range (from low to intolerable pain) and a stimulation phase in which pain stimuli, depending on the calibrated range, are applied. The obtained data may allow refining, improving, and evaluating automated recognition systems in terms of an objective pain assessment. For further development of such systems and to investigate pain reactions in more detail, additional pain modalities such as pressure, chemical, or cold pain should be included in future studies. Recorded data of this study will be released as the &#8220;X-ITE Pain Database&#8221;.

This article focuses on the experimental elicitation of pain through heat (thermal) and electrical stimulation while recording physiological, visual, and paralinguistic responses. It aims at collecting valid multimodal data for analyzing pain based on its intensity, quality, and duration.&#160;

The assessment of pain relies mostly on methods that require a person to communicate. However, for people with cognitive and verbal impairments, existing ...

Generating Strictly Controlled Stimuli for Figure Recognition Experiments

This protocol introduces a method for generating strictly controlled and objectively defined stimuli for figure recognition experiments. A (6, n) figure consists of n line segments that are spanned between n pairs of points located at the vertices of an invisible regular hexagon. The structural properties (graph invariants) and superficial features (non-graph invariants) of each (6, n) figure with n values ranging from 1 to 6 are calculated and stored in a database. Using this database, experimenters can systematically extract appropriate figures depending on the purpose of the experiment. Furthermore, if the database does not contain necessary information, new feature values can sometimes be calculated ad hoc from the formation of a specific (6, n) figure. Let us call a mirror-reflected pair of figures an axisymmetric (Ax) pair. An Ax pair of figures is known to be more difficult to discriminate than a non-identical pair in the decision of whether the shapes of a given pair are rotated-to-be-identical (Idr). The purpose of the present experiment is to examine whether the sameness of line lengths between two figures in a pair causes the discrimination of the pair to be as difficult as that of an Ax pair. Mutually isomorphic figures share common structural properties despite differences in shape. Ax pairs and Idr pairs are special cases of isomorphic pairs. Furthermore, an Ax pair and Idr pair share most of the superficial feature values, except the relative direction from one location to another location across an axis of symmetry is opposite for an Ax pair. Three types of mutually isomorphic (6, 4) figure pairs were generated: Idr; Ax; and non-identical, non-axisymmetric, isomorphic (Nd) pairs. Nd pairs were further classified into three subcategories according to the superficial feature values of the degree of line length differences.

This protocol describes a method for an experiment that examines whether specific graph and non-graph properties (features) are relevant to the recognition of figures. The method uses a database that stores various feature values of respective figures called (6 point, n line) figures.

This protocol introduces a method for generating strictly controlled and objectively defined stimuli for figure recognition experiments. A (6, n) figure ...