We would like to thank Kun Lu and Ronald Kurz for technical assistance. This work was supported by ONR MURI Award No.:N00014-10-1-0072, NSF grant #SBE-0542013 to the Temporal Dynamics of Learning Center, an NSF Science of Learning Center, and NIH grant #2 R01 NS036449-11.

1. Outside the scanner room
<ol>
<li>Place the rolling table with the free end supported and the exterior end of the long handle detached.</li>
<li>Check that the robot is switched off.</li>
<li>Place the robot in the table socket and secure the aluminum safety plate over the robot with 2 screws.</li>
<li>Attach the end effecter to the robot handle with the aluminum adapter and check that it moves freely.</li>
<li>Attach the 10' parallel cable with aluminum shielding to the robot and check that the shielding is intact. Add extra foil if needed.</li>
<li>Place the aluminum shielding box over the robot being careful to place the parallel and power cables into the groove on the back.</li>
<li>Carefully screw on the shielding box.</li>
<li>Pack aluminum foil into the cable groove on the shielding box and be sure the foil makes contact with the shielding on the parallel cable.</li>
</ol>
2. Moving into the scanner room with two people, A and B
<ol>
<li>Prepare to enter a high magnetic field environment by removing any and all metallic objects including non-ferrous ones, e.g., cell phones, keys, coins, etc...</li>
<li>With person A holding the free end of the robot table and person B stabilizing the box end, roll it free end first until the robot just enters the door of the room.</li>
<li>Person B clips the security rope tethered to an anchor hole on the back of the shielding case and checks that the other end is firmly attached to a wall anchor.</li>
<li>Working together, roll the table into the room and attach it with Velcro straps to the foot of the fMRI table. The robot end of the table must stay as far from the scanner as possible.</li>
<li>Attach the robot's parallel cable to the custom filter on the pass through to the control room, and plug in the robot. The shielding foil on the parallel cable should make contact with the filter.</li>
<li>Attach the exterior part of the long handle (end effecter) and verify that it will enter the bore of the fMRI cleanly.</li>
</ol>
3. In the control room
<ol>
<li>Start the control computer and attach the 6' parallel cable to the robot. Be sure to remove any extra filters that may be on the interior part of the pass through.</li>
<li>Verify that the robot motors are turned off, start up the Phantom calibration routine and verify that the position readouts of the motors from the robot's calibration routine are stable.</li>
<li>Double check the parallel cable connection and that only the large custom filter is attached if the calibration routine cannot see the robot or there are large variations in the motor readout.</li>
<li>Turn on the robot by opening the port on the back of the shielding box and press the switches with a stick.</li>
<li>Restart the calibration routine with the end effecter approximately centered at the end of the conical waveguide. Step through the calibration and check that the box calibration box has the appropriate
haptic interaction.</li>
<li>Attach the TTL output from the fMRI (BNC connector) to the Labjack ADC on the control computer.</li>
</ol>
4. The subject
<ol>
<li>Prepare the subject for a high magnetic field environment with the standard fMRI protocols.</li>
<li>Set up any extra equipment for the experiment, e.g., visual display system. We use the NordicNeuro Lab, Inc. Vision System which provides stereo viewing of visual displays, a feature that is particularly helpful when presenting virtual environments.</li>
<li>After the subject lies down on the table and the head coil is situated, adjust the distance of the robot by loosening the hand screws and sliding the top of the table until the subject can move comfortably.</li>
<li>Guide the table manually by holding onto the robot end while the fMRI table is moving in and out of the bore to prevent the casters from wobbling. Make sure the end effecter goes into the bore and does not catch on the outside.</li>
<li>Run the experiment.</li>
</ol>
5. Break down the setup with two people A and B
<ol>
<li>After the patient exits, remove the exterior end of the long handle and detach the robot table from the fMRI table by undoing the Velcro strap.</li>
<li>From the robot, undo the shielded parallel cable and unplug the power cable.</li>
<li>With person A holding the free end of the robot table and person B guiding the robot end, move the table to the door. At the door, undo the tether, and roll the robot table out to the hall.</li>
<li>Undo all the screws from the shielding box and the two screws from the safety plate and remove the robot.</li>
</ol>
6. Representative results: 
Ideally, the haptic robot and fMRI should not affect each other. We can tell online if the robot is being affected by the fMRI. Generally, if the robot's parallel cable is not properly shielded and filtered, then the readout of the motors will oscillate rapidly. This can be fixed by double checking the aluminum shielding on the cable, that the ferrous core is properly placed on the parallel cable near the robot, and that the only filter to the robot is the custom filter on the scanner room side of the pass through. Detecting errors in the fMRI is really only possible after the data have been reduced and analyzed, but an anatomical scan should be taken early in the study and checked for zipper effects or other artifacts indicative of correlated noise (e.g. spike noise) 7. Frequently, such noise comes from metal on metal contact and can be cleaned up by tightening all the screws on the robot table, especially the hand adjustment screws on the side of the table. From our tests the baseline fMRI signal to noise ratio (SNR) is &tilde;380 and with the robot fully shielded in the room that drops to a still reasonable &tilde;330. If the shield is not in place on the robot, then the SNR drop further to &tilde;250, and noise effects become very significant.
As shown in 4, the 3 degree of freedom joint in the center of the handle has little effect on the dynamics of the robot/hand interaction except to shift it away from the robot. The joint in the center of the handle acts like a fulcrum and reverses the apparent motion in two of the directions (left-right and up-down) but not the third (forward-back). Since the Phantom and the hand are at opposite ends of the lever like handle with its fulcrum in the middle, gains are applied in software in each of the three Euclidean directions: negative gains in the two directions controlled by the swivel joint and a positive gain in the direction of the slider joint. The net effect of the handle and swivel reproduces the full 3 degrees of freedom of the Phantom robot, just 9' away.
<img src="/files/ftp_upload/3364/3364fig1.jpg" alt="Figure 1"/> Figure 1&nbsp;The apparatus used to mount the haptic robot for use in the fMRI environment. Top shows the haptic robot mounted in the case prior to enclosure (top, left) and the gimbal/slider joint at the midpoint of the handle (top, right). Bottom, left shows a subject in the scanner manipulating the handle. Bottom, right is a cartoon of the shielding and end effecter.
<img src="/files/ftp_upload/3364/3364fig2.jpg" alt="Figure 2"/> Figure 2&nbsp;Results of the BIRN test for the fully shielded robot with movement. The three images with crosses show sections of the spherical head model, and the bottom right shows a three dimensional view. The small dots are bubbles in the static head model and are always present. The lack of large stripes or zippers indicates that the noise from the robot is uncorrelated.

<ol>
	<li>Ogawa, S., Lee, T. M., Kay, A. R., Tank, D. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Brain+magnetic+resonance+imaging+with+contrast+dependent+on+blood+oxygenation.">Brain magnetic resonance imaging with contrast dependent on blood oxygenation.</a> Proc. Natl. Acad. Sci. U.S.A. 87, 9868-9872 (1990).</li><li>Heeger, D. J., Ress, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=What+does+fMRI+tell+us+about+neuronal+activity.">What does fMRI tell us about neuronal activity.</a> Nat. Rev. Neurosci. 3, 142-151 (2002).</li><li>deCharms, R. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Applications+of+real-time+fMRI.">Applications of real-time fMRI.</a> Nat. Rev. Neurosci. 9, 720-729 (2008).</li><li>Hribar, A., Koritnik, B., Munih, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phantom+haptic+device+upgrade+for+use+in+fMRI.">Phantom haptic device upgrade for use in fMRI.</a> Medical and Biological Engineering and Computing. 47, 677-684 (2009).</li><li>Trommershauser, J., Gepshtein, S., Maloney, L. T., Landy, M. S., Banks, M. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Optimal+compensation+for+changes+in+task-relevant+movement+variability.">Optimal compensation for changes in task-relevant movement variability.</a> J. Neurosci. 25, 7169-7178 (2005).</li><li>Konczak, J., Li, K. Y., Tuite, P. J., Poizner, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Haptic+perception+of+object+curvature+in+Parkinson's+disease.">Haptic perception of object curvature in Parkinson's disease.</a> PLoS ONE. 3, e2625-e2625 (2008).</li><li>Lipton, M. L., Lipton, M. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Artifacts:+When+things+go+wrong,+it's+not+necessarily+all+bad.">Artifacts: When things go wrong, it's not necessarily all bad.</a> Totally Accessible MRI. , 139-153 (2008).</li><li>Rajh, M., Glodez, S., Flasker, J., Gotlih, K., Kostanjevec, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Design+and+analysis+of+an+fMRI+compatible+haptic+robot.">Design and analysis of an fMRI compatible haptic robot.</a> Robotics and Computer-Integrated Manufacturing. 27, 267-275 (2011).</li><li>Burdet, E., Gassert, R., Gowrishankar, G., Chapuis, D., Bleuler, H., Ang, M., Khatib, O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=fMRI+compatible+haptic+interfaces+to+investigate+human+motor+control.">fMRI compatible haptic interfaces to investigate human motor control.</a> Experimental Robotics IX, of Springer Tracts in Advanced Robotics. 21, 25-34 (2006).</li><li>Nakamura, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Functional+networks+in+motor+sequence+learning:+abnormal+topographies+in+Parkinson's+disease.">Functional networks in motor sequence learning: abnormal topographies in Parkinson's disease.</a> Hum Brain Mapp. 12, 42-60 (2001).</li></ol>

No conflicts of interest declared.

The fMRI compatible robot opens up new possibilities for experiments in the neuroscience of motor control. The most critical step in the setup is the shielding of the robot to prevent artifacts in the fMRI, which we do in two steps. First, the robot itself is about 9' away from the bore with a long, lightweight, handle supported in its middle with a 3 degree of freedom joint . Second, the robot is encased in a 1/16&quot;-1/4&quot; aluminum box with a plastic conical (13&quot; base diameter, 6&quot; top diameter x 42&quo...

<table border="1">
<tbody>
<tr>
<td>Phantom premium 1.5/6dof, high force model</td>
<td>Sensable</td>
<td><a href="www.sensable.com">www.sensable.com</a></td>
</tr>
</tbody>
</table>

adaptation of a haptic robot in a 3t fmri

Functional magnetic resonance imaging (fMRI) provides excellent functional brain imaging via the BOLD signal 1 with advantages including non-ionizing radiation, millimeter spatial accuracy of anatomical and functional data 2, and nearly real-time analyses 3. Haptic robots provide precise measurement and control of position and force of a cursor in a reasonably confined space. Here we combine these two technologies to allow precision experiments involving motor control with haptic/tactile environment interaction such as reaching or grasping. The basic idea is to attach an 8 foot end effecter supported in the center to the robot 4 allowing the subject to use the robot, but shielding it and keeping it out of the most extreme part of the magnetic field from the fMRI machine (Figure 1).
The Phantom Premium 3.0, 6DoF, high-force robot (SensAble Technologies, Inc.) is an excellent choice for providing force-feedback in virtual reality experiments 5, 6, but it is inherently non-MR safe, introduces significant noise to the sensitive fMRI equipment, and its electric motors may be affected by the fMRI's strongly varying magnetic field. We have constructed a table and shielding system that allows the robot to be safely introduced into the fMRI environment and limits both the degradation of the fMRI signal by the electrically noisy motors and the degradation of the electric motor performance by the strongly varying magnetic field of the fMRI. With the shield, the signal to noise ratio (SNR: mean signal/noise standard deviation) of the fMRI goes from a baseline of &tilde;380 to &tilde;330, and &tilde;250 without the shielding. The remaining noise appears to be uncorrelated and does not add artifacts to the fMRI of a test sphere (Figure 2). The long, stiff handle allows placement of the robot out of range of the most strongly varying parts of the magnetic field so there is no significant effect of the fMRI on the robot. The effect of the handle on the robot's kinematics is minimal since it is lightweight (&tilde;2.6 lbs) but extremely stiff 3/4" graphite and well balanced on the 3DoF joint in the middle. The end result is an fMRI compatible, haptic system with about 1 cubic foot of working space, and, when combined with virtual reality, it allows for a new set of experiments to be performed in the fMRI environment including naturalistic reaching, passive displacement of the limb and haptic perception, adaptation learning in varying force fields, or texture identification 5, 6.

Watch this Scientific Journal Video about Adaptation of a Haptic Robot in a 3T fMRI at JoVE.com

Adaptation of a Haptic Robot in a 3T fMRI

The adaptation and use of a haptic robot in a 3T fMRI is described.

Functional magnetic resonance imaging (fMRI) provides excellent functional brain imaging via the BOLD signal 1 with advantages including non-ionizing ...

adaptation-of-a-haptic-robot-in-a-3t-fmri

Research

JoVE Journal

Bioengineering

9.6K Views.  University of California. The adaptation and use of a haptic robot in a 3T fMRI is described.