This work was supported by Waseda University.

All methods described here were approved to follow the Code of Ethics of the World Medical Association (Declaration of Helsinki) and approved by the Independent Ethics Committee of Nagaoka University of Technology. No identifying information was collected from the undergraduates. Participants were given detailed information about the experiments before participating and were required to sign a written acceptance statement. Written informed consent was obtained from all subjects and was stored at Nagaoka University of Technology.
1. Preparing seven kinds of videos
NOTE: In total, create seven videos for a pre-experimental session (one video) and for experimental sessions in the &#8220;stable&#8221;, &#8220;slow&#8221; and &#8220;fast&#8221; conditions (Figure 1) for each gender (three times two videos).
<ol>
	<li>In an experiment room, set a table and two chairs, a hand rest (approximately 35 x 60 cm white cushion tilted approximately 25 degrees) and a display on the table (Figure 2). Mark these positions to be able to reproduce accurately in the experimental session.</li>
	<li>Place a 360&#176; camera at eye level when the participants are sitting in the chair (Figure 2).</li>
	<li>Start to record the camera with nobody in the video for approximately 20&#8211;30 s for a pre-experimental session to ensure that there is reasonable visibility for each participant.</li>
	<li>For the video to show male participants, let a male experimenter (Experimenter A) wear a lab coat, sit in the chair and put on his left hand on the hand rest with the palm up, taking care that the fingers do not touch each other nor touch the hand rest.</li>
	<li>Play a 60 bpm 4-beat reference tone using a metronome application and a smartphone.</li>
	<li>Let another experimenter (Experimenter B) sit facing Experimenter A, with a paint brush in Experimenter B&#8217;s hand (Figure 3).</li>
	<li>Start to record the camera for the video to use the &#8220;stable&#8221; condition.</li>
	<li>Using the reference tone, let Experimenter B stroke all of Experimenter A&#8217;s fingers for 80 s. At the same time, let Experimenter B memorize the trajectory to reproduce it later.</li>
	<li>By the third experimenter, show an action that an approximately 30 cm kitchen knife (20 cm blade) appears, slashes Experimenter A&#8217;s left wrist and disappears, taking 5 s (Figure 4).</li>
	<li>After 5 s of margin duration, stop the camera.</li>
	<li>Start to record the camera for the video to use the &#8220;slow&#8221; condition.</li>
	<li>Repeat step 1.8 while changing the brush trajectory to avoid monotony.</li>
	<li>60 s after the start, let Experimenter A close and open the five fingers at a consistent slow speed for 20 s (20 s/close and open cycle, approximately 1.3 mm/s; Figure 5(A)).</li>
	<li>Repeat steps 1.9 and 1.10.</li>
	<li>Start to record the camera for the video to use the &#8220;fast&#8221; condition.</li>
	<li>Repeat steps 1.12 to 1.14 while changing the finger speed from slow to fast (2 s/open and close cycle, approximately 35 mm/s; Figure 5(B)).</li>
	<li>Repeat steps 1.4 to 1.16 while changing from a male Experimenter A to a female Experimenter A to produce another three videos for the female participants.</li>
	<li>Remove the camera. Check that the videos do not diverge from the real world, using the HMD and sitting the chair and putting left hand on the hand rest.</li>
	<li>If necessary, practice reproducing the trajectory of the brush accurately.</li>
</ol>
2. Experimental procedure
<ol>
	<li>Use more than 18 participants who are healthy adults (approximate ages of 18&#8211;25 and a gender ratio of 50% are better) without history of major illness and na&#239;ve to the experiment and speaking the same native language to collect subjective reports. Experiment with each participant separately.</li>
	<li>RHI with/without finger movement sessions and SCR measurements
	<ol>
		<li>Conduct the following steps that include the role of interacting with the participant by the same experimenter with the same looks as Experimenter B in the videos to use. Use assistance if necessary.</li>
		<li>Ask a participant to wear a lab coat and sit the chair. Attach Ag&#8211;AgCl electrodes connected with an SCR data acquisition&#160;device to the index and ring fingers of the participant&#8217;s right hand after polishing those fingers. Keep the hand down while not touching anything. Set the sampling rate at 500 samples/s, and start to record the SCR data.</li>
		<li>Give to the participant the following three instructions: 
		1. &#8220;Your task is put your left hand on the hand rest with the palm facing up and keeping the hand stable&#8221; 
		2. &#8220;Please try to relax.&#8221; 
		3. &#8220;When wearing the HMD, please look at your left hand&#8221;.</li>
		<li>Have the participant wear an HMD with a black screen. Mirror the screen on the HMD to the display on the table until the end of the experiment.</li>
		<li>Show the video for the pre-experimental session on the HMD after announcing that. Ask the participant to look around and ensure that the view is natural. If something is wrong, adjust the HMD or the seat height until the participant is comfortable.</li>
		<li>Show a black screen on the HMD, and ask the participant to put his/her left hand on the hand rest with the palm up. Help the participant, and take care that the fingers are not touching each other or the hand rest.</li>
		<li>Sit facing the participant with headphones and a paintbrush. Prepare for one video for one of the three conditions with the left hand of the same gender as the participant.</li>
		<li>Begin the first trial with one condition randomly selected from the three. After announcing that the session is beginning, start the video. Brush the participant&#8217;s left hand with the same timing and position as s/he is watching, checking the mirroring display on the desk and the reference tone, until the knife cuts in (Figure 3(B)).</li>
		<li>Show a black screen on the HMD 2 minutes to allow SCR to return to normal.</li>
		<li>Repeat steps 2.2.8 to 2.2.10 for the remaining five times (a total of six times; two trials of each of the three conditions) in random order. Ask the participant after every two trials whether anything is wrong with the physical condition.</li>
		<li>Stop recording the SCR data. Remove the HMD and SCR data acquisition device.</li>
	</ol>
	</li>
	<li>Face-to-face interviews: Pose the following questions to the participant and collect the answers orally while recording them.
	<ol>
		<li>Ask &#8220;Did you see that the hand was moved?&#8221; [Q1: For confirmation] 
		If the answer is not &#8220;Yes&#8221;, go to step 2.3.4.</li>
		<li>Ask &#8220;Did you see the movement of the two speeds? [Q2: For confirmation] 
		If the answer is not &#8220;Yes&#8221;, go to step 2.3.4.</li>
		<li>Ask &#8220;What did you think about the slower hand movement?&#8221; [Q3: For SoA evaluation]</li>
		<li>Ask &#8220;Could you tell me if you felt anything during the experiment.&#8221; [Q4: Free report]</li>
	</ol>
	</li>
</ol>
3. Data analysis
<ol>
	<li>SCR data
	<ol>
		<li>Identify the SCRs for each trial in the following manner19,21,22: the difference in amplitude between the maximal and minimal value that occurred during all of 2&#8211;10 s in the last 5 s (knife threat; for evaluation of SoO) and immediately after 5 s.</li>
		<li>Calculated the magnitude of amplitudes according to a pre-established method23 as: 
		<img alt="Equation 1" src="/files/ftp_upload/61755/61755equ01.jpg" /></li>
		<li>Conduct the Shapiro&#8211;Wilk test on all data. If it is confirmed that some data were not normally distributed, use nonparametric statistical tests to process the data; otherwise, use parametric statistical tests. In all statistical tests, set alpha to 5%.</li>
		<li>Evaluate the difference among the three conditions with a multiple comparison.</li>
	</ol>
	</li>
	<li>Face-to-face interviews
	<ol>
		<li>Divide the data of those who answered &#8220;No&#8221; to Q1 and/or 2.</li>
		<li>Compare the answers to Q3 with the following three statements that have been used to measure participants&#8217; SoA in the RHI study13. 
		Statement 1: The hand moved just like I wanted it to, as if it was obeying my will. 
		Statement 2: I felt as if I could control the movements of the hand. 
		Statement 3: I felt as if I could cause the movement I saw.</li>
		<li>Classify the answers to Q3 from a summary of each, and analyze the overall trend.</li>
	</ol>
	</li>
</ol>

<ol>
	<li>Gallagher, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Philosophical+conceptions+of+the+self:+Implications+for+cognitive+science.">Philosophical conceptions of the self: Implications for cognitive science.</a> Trends in Cognitive Sciences. 4, 14-21 (2000).</li><li>Frith, U., De Vignemont, F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Egocentrism,+allocentrism,+and+Asperger+syndrome.">Egocentrism, allocentrism, and Asperger syndrome.</a> Consciousness and Cognition. 14, 719-738 (2005).</li><li>Von Helmholtz, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Handbuch der Physiologischen Optik. , (1866).</li><li>Sperry, R. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Neural+basis+of+the+spontaneous+optokinetic+response+produced+by+visual+inversion.">Neural basis of the spontaneous optokinetic response produced by visual inversion.</a> Journal of Comparative and Physiological Psychology. 43, 482-489 (1950).</li><li>Richard, H., Sanford, J. F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Plasticity+in+human+sensorimotor+control.">Plasticity in human sensorimotor control.</a> Science. 142, 45 (1963).</li><li>Synofzik, M., Vosgerau, G., Newen, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Beyond+the+comparator+model:+A+multifactorial+two-step+account+of+agency.">Beyond the comparator model: A multifactorial two-step account of agency.</a> Consciousness and Cognition. 17, 219-239 (2008).</li><li>Botvinick, M., Cohen, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Rubber+hands+'feel'+touch+that+eyes+see.">Rubber hands 'feel' touch that eyes see.</a> Nature. 391, 756 (1998).</li><li>Nishiyama, Y., Tatsumi, S., Nomura, S., Gunji, Y. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=My+hand+is+not+my+own!+Experimental+elicitation+of+body+disownership.">My hand is not my own! Experimental elicitation of body disownership.</a> Psychology &amp; Neuroscience. 8, 425-434 (2015).</li><li>Asai, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Agency+elicits+body-ownership:+proprioceptive+drift+toward+a+synchronously+acting+external+proxy.">Agency elicits body-ownership: proprioceptive drift toward a synchronously acting external proxy.</a> Experimental Brain Research. 234, 1163-1174 (2016).</li><li>Tsakiris, M., Longo, M. R., Haggard, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Having+a+body+versus+moving+your+body:+How+agency+structures+body-ownership.">Having a body versus moving your body: How agency structures body-ownership.</a> Consciousness and Cognition. 15, 423-432 (2006).</li><li>Dummer, T., Picot-Annand, A., Neal, T., Moore, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Movement+and+the+rubber+hand+illusion.">Movement and the rubber hand illusion.</a> Perception. 38, 271-280 (2009).</li><li>Kalckert, A., Ehrsson, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Moving+a+rubber+hand+that+feels+like+your+own+a+dissociation+of+ownership+and+agency.">Moving a rubber hand that feels like your own a dissociation of ownership and agency.</a> Frontiers in Human Neuroscience. 6, (2012).</li><li>Kalckert, A., Ehrsson, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+moving+rubber+hand+illusion+revisited:+Comparing+movements+and+visuotactile+stimulation+to+induce+illusory+ownership.">The moving rubber hand illusion revisited: Comparing movements and visuotactile stimulation to induce illusory ownership.</a> Consciousness and Cognition. 26, 117-132 (2014).</li><li>Libet, B., Gleason, C. A., Wright, E. W., Pearl, D. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Time+of+Conscious+Intention+To+Act+in+Relation+To+Onset+of+Cerebral+Activity+(Readiness-Potential).">Time of Conscious Intention To Act in Relation To Onset of Cerebral Activity (Readiness-Potential).</a> Brain. 106, 623-642 (1983).</li><li>Gunji, Y. P., Minoura, M., Kojima, K., Horry, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Free+will+in+Bayesian+and+inverse+Bayesian+inference-driven+endo-consciousness.">Free will in Bayesian and inverse Bayesian inference-driven endo-consciousness.</a> Progress in Biophysics and Molecular Biology. 131, (2017).</li><li>Synofzik, M., Vosgerau, G., Voss, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+experience+of+agency:+An+interplay+between+prediction+and+postdiction.">The experience of agency: An interplay between prediction and postdiction.</a> Frontiers in Psychology. 4, (2013).</li><li>Shimojo, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Postdiction:+Its+implications+on+visual+awareness,+hindsight,+and+sense+of+agency.">Postdiction: Its implications on visual awareness, hindsight, and sense of agency.</a> Frontiers in Psychology. 5, 1-19 (2014).</li><li>Armel, K. C., Ramachandran, V. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Projecting+sensations+to+external+objects:+evidence+from+skin+conductance+response.">Projecting sensations to external objects: evidence from skin conductance response.</a> Proceedings. Biological Sciences/The Royal Society. 270, 1499-1506 (2003).</li><li>Petkova, V. I., Ehrsson, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=If+I+were+you:+Perceptual+illusion+of+body+swapping.">If I were you: Perceptual illusion of body swapping.</a> PLoS ONE. 3, (2008).</li><li>Yuan, Y., Steed, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Is+the+rubber+hand+illusion+induced+by+immersive+virtual+reality.">Is the rubber hand illusion induced by immersive virtual reality.</a> Proceedings - IEEE Virtual Reality. , 95-102 (2010).</li><li>Ramachandran, V., Hirstein, W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+perception+of+phantom+limb.">The perception of phantom limb.</a> Brain. 121, 1603-1630 (1998).</li><li>Preston, C., Kuper-Smith, B. J., Henrik Ehrsson, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Owning+the+body+in+the+mirror:+The+effect+of+visual+perspective+and+mirror+view+on+the+full-body+illusion.">Owning the body in the mirror: The effect of visual perspective and mirror view on the full-body illusion.</a> Scientific Reports. 5, 18345 (2015).</li><li>Dawson, M. E., Schell, A. M., Filion, D. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+electrodermal+system.">The electrodermal system.</a> Handbook of Psychophysiology. , (2006).</li><li>Blanke, O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Out-of-Body+Experience:+Disturbed+Self-Processing+at+the+Temporo-Parietal+Junction.">The Out-of-Body Experience: Disturbed Self-Processing at the Temporo-Parietal Junction.</a> The Neuroscientist. 11, 16-24 (2005).</li><li>Ehrsson, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+experimental+induction+of+out-of-body+experiences.">The experimental induction of out-of-body experiences.</a> Science. 317, 1048 (2007).</li><li>Suzuki, K., Wakisaka, S., Fujii, N. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Substitutional+Reality+System:+A+Novel+Experimental+Platform+for+Experiencing+Alternative+Reality.">Substitutional Reality System: A Novel Experimental Platform for Experiencing Alternative Reality.</a> Scientific Reports. 2, 1-9 (2012).</li><li>Rohde, M., Luca, M., Ernst, M. O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+rubber+hand+illusion:+Feeling+of+ownership+and+proprioceptive+drift+Do+not+go+hand+in+hand.">The rubber hand illusion: Feeling of ownership and proprioceptive drift Do not go hand in hand.</a> PLoS ONE. 6, (2011).</li></ol>

The authors have nothing to disclose.

The purpose of this protocol is to highlight the inherent inseparability of whether the origin of action is the participant&#8217;s self or another. It could be supposed that such inseparability causes the participants to accept the movement of alien origin as their own experiences. Here, we proposed a method to collect the sensations in such a situation, referring to the conventional discussion of the SoO/SoA. As a means of achieving this, step 1.13 (preparing the video) and step 2.2.8 (showing it under plausible circumstances) are achieved by appropriately shifting the behavior of the observed body part from that of the actual. Some other steps support this aim from the following two points. The first point is to make the virtual image closer to reality. Thus, the world in the video is visually aligned to the real world regarding the hand features (steps 1.4, 1.17 and 2.2.3), laboratory landscapes (step 1.1), and the facing experimenter (step 2.2.1). In addition, establishing cross-modal interaction would also be effective, as it is considered to be essential, especially in the full body-transfer illusion24,25. Therefore, it would be effective to use a 360-degree image (step 1.2; matching the visual information and head movement control) and to accurately trace the trajectories (step 2.2.8; matching of visual and tactile sensation). The second point is to broaden the interpretation of (virtual) visual information. This point was also emphasized in another study that made participants uncertain of whether their view in HMD was virtual or real26. While the authors achieved this goal by reducing the virtual and real visual resolution equally, in this protocol, we applied the following two methods in step 2.2.3, to give no information about what would be shown and to make themselves relax. These cares seemed to work considering the reaction to a question &#8220;Guess what hand you were looking at?&#8221; that we asked to all participants after Q3 to confirm the validity of this protocol (this is an extra question that does not need to appear in the protocol). Then, rather than having no one correctly answer that it was a prerecorded video, it was found that the majority of them were experimenting with uncertainties and allowing various possibilities.
Additionally, step 2.3 is considered to be important in evaluating such feelings that the bodily movement originating from others is perceived as one&#8217;s own and that may also contain contradictions when viewed objectively. While in the typical method using a questionnaire about SoO/SoA, participants are presented the preprepared expressions about the feelings first, in this protocol, they are requested to describe their feelings in words of their own. This way enables us to avoid reinterpretation of their experience by the given expressions by the experimenter and to collect contradictory answers. Actually, as shown above, the majority of our participants reported that the observed move was compatible with what was relevant to them. Moreover, we could collect the answers &#8220;it was like mine and not mine&#8221; from three participants in step 2.3.4. In addition, it is also notable that illusory sensory feedback was reported in Type 3, although the number was small. Those points that had not been observed in previous RHI studies might offer us new insight.
Regarding possibilities to improve and troubleshoot this method, a common problem is that accurately tracing the paintbrush trajectory is important but difficult. Indeed, the illusion disappears as soon as the movement of the brush is asynchronous7,27. Our subjects also reported that the sense of ownership suddenly disappeared at the moment when the experimenter failed to trace by accident. While it has been reported that the illusion intensity increases with increasing complexity and randomness of the brush movement, we recommend taking a simple trajectory that is not easily mistaken rather than taking the risk. In addition, regarding SCR measurement, one could be concerned that the participants may get used to the repeated knife threat. In some previous studies19,22, however, the experiment was conducted many more times (for example, thirty times19). This protocol proposes two trials for each condition, for a total of six times per participant to reduce their burden, as the minimum number of times that would reveal the difference between the three conditions. Furthermore, it is possible to consider increasing the number of trials for more statistically reliable data collection and to study the effect of iteration of the trial. Another point, our materials table shows the set of equipment that we used to obtain our representative results. However, especially since the head-mounted display manufacturers are frequently updated to new products, the catalog number (Oculus DK2) in the table is now discontinued. Currently, the same experiment can be performed by using the latest model (Oculus Rift S or Quest 2; in this case the corresponding display is a PC with Windows OS instead of Mac OS), and we recommend carrying out with the product available at that time.
A considerable limitation of this protocol is that the estimation of SoA depends on the retrospective method. The reason that the face-to-face interview is set as the last step of the experimental procedure part and not just after the target trials (the trail in the &#8220;slow&#8221; condition), such as general methods13, is to prevent the participants from focusing their attention on the question in the subsequent trials. Considering that this risk had a greater impact on the entire experiment, we set the current order. On the other hand, this case in which other trials are inserted between the target trial and the interview arises the risks that the acquired feeling would be mixed or forgotten. Here, that issue was mitigated by using questions 1 and 2. Furthermore, the use of general questionnaires is still retrospective. Therefore, developing a measurement method that can be performed in parallel with the experiment using physiological indexes such as SCR could be said as a common issue. Moreover, it may be possible to observe some differences when comparing the trends of the subjective reports against slow and fast conditions. While repeating questions has a risk of affecting participants&#8217; retrospective subjective reports, a possible approach is a comparison between groups, to ask about only one condition to each.
In summary, this protocol has implemented a situation in which the SoO coexists with the SoA that is inconsistent on one body part, creating a good balance of difference and consistency between the shown state and the actual state. This time, for the sake of simplification, the participants&#8217; real hand is made to be stable and the shown hand is made to move slightly, but the opposite case is also applicable. In that case, it is important for each participant to move their fingers at a uniform speed and distance; thus, it is necessary to confirm and practice this process well in advance instructions. Moreover, a wide range of applications can be imagined, such as the case with a change in the shape and/or the number of shown fingers or the case with intervention and/or interaction with the obvious hands of others.

How does one perceive one&#8217;s body or the actions one has performed as one&#8217;s own? These sensations constitute our bodily self-consciousness and our own experience. Such an issue, particularly in terms of &#8220;minimal self&#8221;, has been considered to comprise a sense of ownership (SoO), the sense to feel the body as one&#8217;s own, and a sense of agency (SoA), the sense of authorship over bodily movement1. Many studies on SoO/SoA have been based on the comparator model2, in which one&#8217;s actions are subjected to internal comparison processes3,4,5,6. The comparator model describes a feed-forward loop linking intention with a prediction of one&#8217;s motion and a feedback loop relating sensory feedback to the prediction; these loops have been recognized as the SoA and SoO, respectively1,6.
As a means of experimental investigation, body transfer illusions have been employed. A typical approach is the rubber hand illusion (RHI), in which synchronous stroking of participants&#8217; hidden hands and fake hands located in front of them evokes illusory ownership of the fake hand7. While the original RHI refers only to the SoO, recent implementations of the RHI equipped with a movable hand have allowed assessment of the mechanism of SoA as giving experiences of feed-forward loop matching to the participants. Although the SoO and SoA coincide in normal behavior1, they can be independent of each other, and both can be evoked separately. For example, if participants are shown an avatar, they feel only a weak SoO but not an SoA, or if participants see their hand hiding their thumb from a third person&#8217;s perspective, they feel only an SoA but not an SoO8. An SoO elicited by an SoA has also been reported9, and the relationship between the two and how both together produce bodily consciousness are still open questions.
Although SoA is a broad term, it is commonly regarded as a sensation of a generated action while self-detached from the external world. In this sense, in order to evaluate the SoA experimentally, it is assumed that the participants themselves manipulate the real body or the fake body, for example, using a hand image projected on a screen10, a fake hand located on a wooden pole11, or a hand located on a cover above the participant&#8217;s hand12,13. In these studies, when the visible fake hand was synchronized with participant-generated movement, the emergence of the SoA was confirmed. Additionally, when the movements were externally generated not by a participant but by an experimenter using a physical connection to the hand, it was confirmed that the absence of the SoA could occur, while the SoO was retained. In those studies, a pair of absence and presence of the agency was implemented by a pair of other- and self-origin movements for the participant.
The question arises: does the absence of the SoA imply that body movement is made by others except for the one? Is there a clear separation between me and others? However, myself could involve unconsciousness which could be others in myself. Concerning unconsciousness, one cannot determine whether a movement originates from the one&#8217;s self or others. Although the sensation of autonomous convulsion is destined to be relevant for unconsciousness, the previous experimental setups have not paid attention to the ambiguity of the self and others. To involve unconscious movement in an experiment, one has to implement a virtual move that cannot be readily determined as originating from the participant or others. Such ambiguity of the participant and others is also observed in the discussion of &#8220;readiness potential&#8221;14. The readiness potential preceding free will and intentional consciousness can be compared to others and me in a brain, respectively15. In other words, the self and others in one&#8217;s self are inseparable from each other. In fact, behaviorally, it has been pointed out that SoA could be acquired in a postdictive manner16,17. Considering that our SoA or bodily self-consciousness could be acquired in such a self/other ambiguity, while previous research on SoO/SoA has been carried out after making them perceptually distinguishable, it is necessary to investigate what kind of subjective experience occurs when both parties are ambiguous.
Here, we introduce a protocol that enables us to evaluate SoO/SoA effects on a virtual hand with slight movements such that it is unclear whether the movement is self- or other-originated. Specifically, using virtual reality (VR), our participants were made to see a virtual hand from the first person&#8217;s perspective through a head-mounted display (HMD) without telling who the hand belongs to. Their hand was given a tactile stimulus (stroking with a paintbrush) in sync with the brush movement on the hand shown in HMD, and then, after one minute, the fingers in the video suddenly start moving slowly. For comparison, we conducted six trials for each participant, following three conditions (in duplicate): no hand movement, slow movement (ambiguity between self- and other-origin), and fast movement (clearly not self- but other-origin). To evaluate the SoO, skin conductance response (SCR) measurements were adopted. The change in SCR during a presentation of a threat was used as an indicator of bodily self18,19,20, as it provides an online and objective estimation. In this study, we defined SCR arising from a knife threat following hand movement as the intensity of the SoO18,19. Moreover, for evaluating the SoA, subjective reports were collected using face-to-face interviews after all RHI procedures. Here, it could be supposed that such an ambiguous movement between self- and other-origin would cause the bodily movement originating from another to be perceived as the participant&#8217;s own. Such a rewriting of the causal relationship in SoA cannot be captured by the pre-established method to simply evaluate the consistency between one&#39;s intention and one&#8217;s action. Therefore, while in conventional RHI studies, the participants were required to score given statements describing the sensation13, this protocol allows participants to describe their sensations in their own words. After the subjective reports are collected in such a manner, the steps for classifying and evaluating them are prepared. These series enable us not only to determine whether SoA was present or absent but also to observe how their sensations, which were accepted as their own experience, differed from the stereotypical SoA.

<table><tbody><tr><td>display</td><td>Apple Inc.</td><td>MacBookAir</td><td>for mirroring the screen which is shown to the participants in the HMD</td></tr><tr><td>head mounted display</td><td>Oculus VR Inc.</td><td>Oculus DK2</td><td>for dispaying the 360&amp;deg; videos</td></tr><tr><td>metronome apptication</td><td>ihara-product</td><td>Smart Metronome</td><td>for generate reference tones</td></tr><tr><td>SCR data acquisition device</td><td>Biopac Systems inc.</td><td>Biopac System MP150</td><td>for SCR data mesurement</td></tr><tr><td>SCR data processing software</td><td>Biopac Systems inc.</td><td>AcqKnowledge 4.1</td><td>for SCR data processing</td></tr><tr><td>smart phone</td><td>Apple Inc.</td><td>iPhone SE</td><td>for playing reference tones</td></tr><tr><td>statistical analyzing software</td><td>The R Foundation</td><td>R 3.4.2.</td><td>for statistical analyzing</td></tr><tr><td>360&amp;deg; camera</td><td>RICOH Company Ltd.</td><td>RICOH THETA S</td><td>for preparing the videos</td></tr></tbody></table>

virtual hand with ambiguous movement between the self and other origin: sense of ownership and 'other-produced' agency

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will and action (sense of agency; SoA) have been recognized as the basis of our bodily self-consciousness. Previously, the illusory SoO over a fake body part (e.g., rubber hand) was introduced as the rubber hand illusion (RHI). Furthermore, it was determined that one could also evoke a SoA over an object with movements linked to the one&#8217;s prior intention. On the other hand, the postdictivity of our spontaneity implies that it is essentially inseparable whether actions originate from self or others. In other words, our SoA or daily experiences are obtained in such as inseparable scenario. Previous research, however, has maintained the premise that self- and other-origin movements are perceptually distinguishable. Here, we implement a protocol to make these aspects ambiguous for the participants and to estimate whether they can feel SoO and/or SoA and how. To this end, we employ an experiment using virtual reality, under which participants observe virtual fingers moving very slowly (or quickly or not moving) while their own fingers do not move. For evaluation of the illusory SoO, measurements of skin conductance responses against a knife threat are adopted. Additionally, we introduce face-to-face interviews to determine whether the feelings regarding the slow movement match the conventional SoA definition. Our representative results suggest that the SoO is evoked over the hand, and various attitudes to accept its movement as the participant&#8217;s own with awareness that they did not originate it are reported by the majority. As the results show, the novelty of this protocol is discovering that in such a situation, the SoO cooperates with an externally produced SoA to establish one&#8217;s own bodily experience rather than the independence of the SoO and SoA.

The participants were 21 healthy students (eleven males; mean age 21.1 years, range 20&#8211;23; 18 right-handed) recruited at the Nagaoka University of Technology. All participants were na&#239;ve to the experimental tasks and native Japanese speakers. Data from 19 participants, including those exhibiting no response (a &#8220;null response&#8221;), were used, but data from 2 participants were excluded because of equipment problems.
As the result of our study, SCR values with a knife threat showed no significant differences between the three conditions (slow vs stable: p = 0.829, t = 0.581; slow vs fast: p = 0.872, t = 0.499; and fast vs stable: p = 0.988, t = 0.145, Steel&#8211;Dwass test; Figure 7(A)). This result should be recognized as negative to our hypothesis that the fast movement of the shown hand would eliminate SCRs, namely, the intensity of an illusional SoO. However, when the SCR of the first and second duplicates were compared for each condition, a significant decrease in the SCR was observed only in the condition with fast movement (slow: p = 0.984, z = 0.0197; stable: p = 0.922, z = 0.0983; and fast: p = 0.0181, z = 2.36, Wilcoxon signed-rank tests; Figure 7(B)). This indicates that if obvious unpredicted (fast) movements are repeated, the illusory SoO would disappear, but if the movements are slow, then the SoO would be maintained at the same level as that for no movement.
For the face-to-face interviews, all the participants answered &#8220;Yes&#8221; to both Q1 and 2; therefore, it was confirmed that all of them observed slow movements by their eyes. After confirming this, it could be evaluated that their answers to Q3 did not include Statements 1-3. The responses can be divided into the following four types (Table 1). Type 1: six participants answered &#8220;I did not move&#8221; their own hand. Type 2: Another six answered with &#8220;I thought that my hand was moving without my will&#8221; or the equivalent. Type 3: eight answered with &#8220;I was drawn to be moved.&#8221; or the equivalent. Type 4: three claimed &#8220;a feeling of moving my fingers.&#8221; One participant&#8217;s answer included both Types 2 and 3, another included both Types 2 and 4, another included both Types 2, 3 and 4, and the rest contained only one of Types 1-4. Types 1, 2 and 3 are clearly not consistent with any of Statements 1-3 in terms of denying the will to move the hand. Moreover, Type 4 does not include causality; thus, it is also incompatible with any of Statements 1-3. Overall, the results suggest that none of the participants evoked the SoA in the conventional sense. Moreover, it can be considered that while Type 1 simply denied their SoA, Types 2-4 indicated their attitudes to overlap themselves with the observed bodily movement that was generated externally. For example, Type 2 accepted the observed movement as their own, recognizing that it was not accompanied by their will. Type 3 mentioned their motivation to bring consistency with the observed other-origin movement, that is, such external movement was likely to cause their action. Type 4 claimed a feeling of sensory feedback, despite being aware of the lack of their will or their action. Taken together, 13 out of 19 participants described the observed event as their own experience, which was formed by the other originated SoA rather than rejection of the SoA.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/61755/61755fig01.jpg" /> 
Figure 1: Procedural flow chart for one trial in the RHI experiment.&#160;In all three conditions, one trial was completed within 90 s. The SCRs were identified from 80 s to 90 s in each trial. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/61755/61755fig02.jpg" /> 
Figure 2: Prepared setup.&#160;The setup for steps 1.1 to 1.17, preparing the videos. A 360&#176; camera is located in the participants&#8217; point of view. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 3" class="xfigimg" src="/files/ftp_upload/61755/61755fig03.jpg" /> 
Figure 3: A frame from a video shown to participants.&#160;Each participant is shown a virtual hand that is located in the same place as his/her own real hand. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig03large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 4" class="xfigimg" src="/files/ftp_upload/61755/61755fig04.jpg" /> 
Figure 4: The knife threat event.&#160;For the SCR measurement, 80 s after the beginning of the trial, a kitchen knife appears, slides across the shown hand, and is removed. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig04large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 5" class="xfigimg" src="/files/ftp_upload/61755/61755fig05.jpg" /> 
Figure 5: The close and open movements of the virtual hand.&#160;60 s after the beginning of the trial, the open hand shown to the participants starts to close at a consistent speed, taking 10 s in the slow condition (A) or 1 s in the fast condition (B). Soon after that, it opens at the same speed. In the fast condition, this action is repeated 10 times. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig05large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 6" class="xfigimg" src="/files/ftp_upload/61755/61755fig06.jpg" /> 
Figure 6: Experimental setup.&#160;The setup for conducting the trials. Participants face the same background and the experimenter in the actual setup as in the video. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig06large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 7" class="xfigimg" src="/files/ftp_upload/61755/61755fig07.jpg" /> 
Figure 7: Boxplot of the mean SCR following the knife threat for trials involving no hand movement (stable) or slow or fast hand movement.&#160;(A) Division into three groups and (B) into six groups (separated the first and second trials). Error bars indicate standard deviations. When the results of the first and second rounds were combined and multiple comparisons were performed under each of the three conditions, no significant difference was found in any pair. This result contradicts our hypothesis that the fast movement of the shown hand would eliminate SCR (the intensity of illusional SoO) because it was the same level as the other two. However, when tested between the first and second trials within each condition, a significant difference was observed only in the fast condition (the first vs second trial in the fast condition; p &#60; 0.05, Wilcoxon signed-rank tests). Moreover, in the trials with slow movement and no movement (stable), both the first and second trials showed high SCR values that were not significantly different. This suggests that while in the fast condition, the SCR of the second trial was not maintained to the same degree as that of the first, in the slow and stable condition, the SCR was maintained even though the event was repeated two times. <a href="https://www.jove.com/files/ftp_upload/61755/61755fig07large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td></td>
			<td colspan="2">Summary of the answer</td>
			<td>number</td>
			<td colspan="3">overrup</td>
		</tr>
		<tr>
			<td>Type 1</td>
			<td colspan="2">I did not move.</td>
			<td>6</td>
			<td></td>
			<td></td>
			<td></td>
		</tr>
		<tr>
			<td>Type 2</td>
			<td colspan="2">I thought that my hand was moving without my will.</td>
			<td>6</td>
			<td>a</td>
			<td>b</td>
			<td>c</td>
		</tr>
		<tr>
			<td>Type 3</td>
			<td colspan="2">I was drawn to be moved.</td>
			<td>8</td>
			<td>a</td>
			<td></td>
			<td>c</td>
		</tr>
		<tr>
			<td>Type 4</td>
			<td colspan="2">I had a feeling of moving my fingers.</td>
			<td>3</td>
			<td></td>
			<td>b</td>
			<td>c</td>
		</tr>
	</tbody>
</table>
Table 1: The result of typing answers to Q3 from a summary of each. Q3, the question to evaluate illusory SoA, &#8220;What did you think about the slower hand movement?&#8221;, was posed after confirming that the participants had observed the slow movement of the hand. Three participants (a, b and c) made multiple descriptions. Overall, there is no answer type that includes the statements that matched the definition of the SoA. Moreover, Types 2-4 show various attitudes towards accepting the observed movement as their own movement while recognizing it as originating from elsewhere.

Watch this Scientific Journal Video about Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency at JoVE.com

Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

While previous research on bodily self-consciousness assumed that self- and other-origin movements were perceptually distinguishable, this protocol allows them to be ambiguous on a virtual hand with unintentional slight movements. This enables us to observe one&#8217;s experience formed by SoO and other-produced SoA, rather than the absence of SoA.

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will ...

virtual-hand-with-ambiguous-movement-between-self-other-origin-sense

Research

JoVE Journal

Behavior

5.6K Views.  Waseda University. Terwijl eerder onderzoek naar lichamelijk zelfbewustzijn ervan uitging dat bewegingen van zelf- en andere oorsprong waarneembaar waren, stelt dit protocol hen in staat om dubbelzinnig te zijn op een virtuele hand met onbedoelde lichte bewegingen. Dit stelt ons in staat om iemands ervaring te observeren die wordt gevormd door SoO en ander geproduceerde SoA, in plaats van de afwezigheid van SoA.

Video: Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues

Mori's Uncanny Valley Hypothesis1,2 proposes that the perception of humanlike characters such as robots and, by extension, avatars (computer-generated characters) can evoke negative or positive affect (valence) depending on the object's degree of visual and behavioral realism along a dimension of human likeness (DHL) (Figure 1). But studies of affective valence of subjective responses to variously realistic non-human characters have produced inconsistent findings 3, 4, 5, 6. One of a number of reasons for this is that human likeness is not perceived as the hypothesis assumes. While the DHL can be defined following Mori's description as a smooth linear change in the degree of physical humanlike similarity, subjective perception of objects along the DHL can be understood in terms of the psychological effects of categorical perception (CP) 7. Further behavioral and neuroimaging investigations of category processing and CP along the DHL and of the potential influence of the dimension's underlying category structure on affective experience are needed. This protocol therefore focuses on the DHL and allows examination of CP. Based on the protocol presented in the video as an example, issues surrounding the methodology in the protocol and the use in "uncanny" research of stimuli drawn from morph continua to represent the DHL are discussed in the article that accompanies the video. The use of neuroimaging and morph stimuli to represent the DHL in order to disentangle brain regions neurally responsive to physical human-like similarity from those responsive to category change and category processing is briefly illustrated.

Investigation of the Uncanny Valley Hypothesis and affective experience requires an understanding of the hypothesis' dimension of human likeness (DHL). This protocol allows representation of the DHL and examination of categorical perception. Use of the same stimuli and fMRI to distinguish brain regions responsive to physical and category change is illustrated.

Mori's Uncanny Valley Hypothesis1,2 proposes that the perception of humanlike characters such as robots and, by extension, avatars (computer-generated ...

Visualization Method for Proprioceptive Drift on a 2D Plane Using Support Vector Machine

Proprioceptive drift, which is a perceptual shift in body-part position from the unseen real body to a visible body-like image, has been measured as the behavioral correlate for the sense of ownership. Previously, the estimation of proprioceptive drift was limited to one spatial dimension, such as height, width, or depth. As the hand can move freely in 3D, measuring proprioceptive drift in only one dimension is not sufficient for the estimation of the drift in real life situations. In this article, we provide a novel method to estimate proprioceptive drift on a 2D plane using the mirror illusion by combining an objective behavioral measurement (hand position tracking) and subjective, phenomenological assessment (subjective assessment of hand position and questionnaire) with a sophisticated machine learning approach. This technique permits not only an investigation of the underlying mechanisms of the sense of ownership and agency but also assists in the rehabilitation of a missing or paralyzed limb and in the design rules of real-time control systems with a self-body-like usability, in which the operator controls the system as if it were part of his/her own body.

This article describes a novel method to estimate proprioceptive drift on a 2D plane using the mirror illusion and combining a psychophysical procedure with an analysis using machine learning.

Proprioceptive drift, which is a perceptual shift in body-part position from the unseen real body to a visible body-like image, has been measured as the ...

Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

Studies investigating how people represent themselves and their own body often use variants of &#34;ownership illusions&#34;, such as the traditional rubber-hand illusion or the more recently discovered enfacement illusion. However, these examples require rather artificial experimental setups, in which the artificial effector needs to be stroked in synchrony with the participants&#39; real hand or face&#8212;a situation in which participants have no control over the stroking or the movements of their real or artificial effector. Here, we describe a technique to establish ownership illusions in a setup that is more realistic, more intuitive, and of presumably higher ecological validity. It allows creating the virtual-hand illusion by having participants control the movements of a virtual hand presented on a screen or in virtual space in front of them. If the virtual hand moves in synchrony with the participants&#39; own real hand, they tend to perceive the virtual hand as part of their own body. The technique also creates the virtual-face illusion by having participants control the movements of a virtual face in front of them, again with the effect that they tend to perceive the face as their own if it moves in synchrony with their real face. Studying the circumstances that illusions of this sort can be created, increased, or reduced provides important information about how people create and maintain representations of themselves.

Here, we describe virtual-hand and virtual-face illusion paradigms that can be used to study body-related self-perception/-representation. They have already been used in various studies to demonstrate that, under specific conditions, a virtual hand or face can be incorporated into one&#39;s body representation, suggesting that body representations are rather flexible.

Studies investigating how people represent themselves and their own body often use variants of &#34;ownership illusions&#34;, such as the traditional ...

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions

Path integration is a process in which self-motion is integrated over time to obtain an estimate of one's current position relative to a starting point 1. Humans can do path integration based exclusively on visual 2-3, auditory 4, or inertial cues 5. However, with multiple cues present, inertial cues - particularly kinaesthetic - seem to dominate 6-7. In the absence of vision, humans tend to overestimate short distances (&lt;5 m) and turning angles (&lt;30&deg;), but underestimate longer ones 5. Movement through physical space therefore does not seem to be accurately represented by the brain.
Extensive work has been done on evaluating path integration in the horizontal plane, but little is known about vertical movement (see 3 for virtual movement from vision alone). One reason for this is that traditional motion simulators have a small range of motion restricted mainly to the horizontal plane. Here we take advantage of a motion simulator 8-9 with a large range of motion to assess whether path integration is similar between horizontal and vertical planes. The relative contributions of inertial and visual cues for path navigation were also assessed.
16 observers sat upright in a seat mounted to the flange of a modified KUKA anthropomorphic robot arm. Sensory information was manipulated by providing visual (optic flow, limited lifetime star field), vestibular-kinaesthetic (passive self motion with eyes closed), or visual and vestibular-kinaesthetic motion cues. Movement trajectories in the horizontal, sagittal and frontal planes consisted of two segment lengths (1st: 0.4 m, 2nd: 1 m; &plusmn;0.24 m/s2 peak acceleration). The angle of the two segments was either 45&deg; or 90&deg;. Observers pointed back to their origin by moving an arrow that was superimposed on an avatar presented on the screen.
Observers were more likely to underestimate angle size for movement in the horizontal plane compared to the vertical planes. In the frontal plane observers were more likely to overestimate angle size while there was no such bias in the sagittal plane. Finally, observers responded slower when answering based on vestibular-kinaesthetic information alone. Human path integration based on vestibular-kinaesthetic information alone thus takes longer than when visual information is present. That pointing is consistent with underestimating and overestimating the angle one has moved through in the horizontal and vertical planes respectively, suggests that the neural representation of self-motion through space is non-symmetrical which may relate to the fact that humans experience movement mostly within the horizontal plane.

An efficient way to gain insight into how humans navigate themselves in three dimensions is described. The method takes advantage of a motion simulator capable of moving observers in ways unattainable by traditional simulators. Results confirm that movement in the horizontal plane is underestimated, while vertical movement is overestimated.

Path integration is a process in which self-motion is integrated over time to obtain an estimate of one's current position relative to a starting point 1. ...

Neuroscience

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

This work describes a methodological framework that can be used to explicitly and implicitly characterize the sense of agency developed over the neural-machine interface (NMI) control of sensate virtual or robotic prosthetic hands. The formation of agency is fundamental in distinguishing the actions that we perform with our limbs as being our own. By striving to incorporate advanced upper-limb prostheses into these same perceptual mechanisms, we can begin to integrate an artificial limb more closely into the user&#39;s existing cognitive framework for limb control. This has important implications in promoting user acceptance, use, and effective control of advanced upper-limb prostheses. In this protocol, participants control a virtual prosthetic hand and receive kinesthetic sensory feedback through their preexisting NMIs. A series of virtual grasping tasks are performed and perturbations are systematically introduced to the kinesthetic feedback and virtual hand movements. Two separate measures of agency are employed: established psychophysical questionnaires (to capture the explicit experience of agency) and a time interval estimate task to capture the implicit sense of agency (intentional binding). Results of this protocol (questionnaire scores and time interval estimates) can be analyzed to quantify the extent of agency formation.

Here we present a protocol which characterizes the sense of agency developed over the control of sensate virtual or robotic prosthetic hands. Psychophysical questionnaires are employed to capture the explicit experience of agency, and time interval estimates (intentional binding) are employed to implicitly measure the sense of agency.

This work describes a methodological framework that can be used to explicitly and implicitly characterize the sense of agency developed over the ...

The HoneyComb Paradigm for Research on Collective Human Behavior

Collective human behavior such as group movement frequently shows surprising patterns and regularities, such as the emergence of leadership. Recent literature has revealed that these patterns, often visible at the global level of the group, are based on self-organized, individual behaviors that follow several simple local parameters. Understanding the dynamics of human collective behavior can help to improve coordination and leadership in group and crowd scenarios, such as identifying the ideal placement and number of emergency exits in buildings.
In this article, we present the experimental paradigm HoneyComb, which can be used to systematically investigate conditions and effects of human collective behavior. This paradigm uses a computer-based multi-user platform, providing a setting that can be shaped and adapted to various types of research questions. Situational conditions (e.g., cost-benefit ratios for specific behavior, monetary incentives and resources, various degrees of uncertainty) can be set by experimenters, depending on the research question. Each participant's motions are recorded by the server as hexagonal coordinates with timestamps at an accuracy of 50 ms and with individual IDs. Thus, a metric can be defined on the playfield, and movement parameters (e.g., distances, velocity, clustering, etc.) of participants can be measured over time. Movement data can in turn be combined with non-computerized data from questionnaires garnered within the same experiment setup.
The HoneyComb paradigm is paving the way for new types of human movement experiments. We demonstrate here that these experiments can render results with sufficient internal validity to meaningfully deepen our understanding of human collective behavior.

Here, we present the computer-based, multi-agent game HoneyComb, which enables experimental investigations of collective human movement behavior via black-dot-avatars on a virtual 2D hexagonal playfield. Different experimental conditions, like variable&#160;incentives on goal fields or vision radius, can be set, and their effects on human movement behavior can be investigated.

Collective human behavior such as group movement frequently shows surprising patterns and regularities, such as the emergence of leadership. Recent ...

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

The application of incongruent sensory signals that involves disrupted tactile feedback is rarely explored, specifically with the presence of vibrotactile feedback (VTF). This protocol aims to test the effect of VTF on the response to incongruent visual-tactile stimuli. The tactile feedback is acquired by grasping a block and moving it across a partition. The visual feedback is a real-time virtual presentation of the moving block, acquired using a motion capture system. The congruent feedback is the reliable presentation of the movement of the block, so that the subject feels that the block is grasped and see it move along with the path of the hand. The incongruent feedback appears as the movement of the block diverts from the actual movement path, so that it seems to drop from the hand when it is actually still held by the subject, thereby contradicting the tactile feedback. Twenty subjects (age 30.2 &#177; 16.3) repeated 16 block transfers, while their hand was hidden. These were repeated with VTF and without VTF (total of 32 block transfers). Incongruent stimuli were presented randomly twice within the 16 repetitions in each condition (with and without VTF). Each subject was asked to rate the difficulty level of performing the task with and without the VTF. There were no statistically significant differences in the length of the hand paths and durations between transfers recorded with congruent and incongruent visual-tactile signals &#8211; with and without the VTF. The perceived difficulty level of performing the task with the VTF significantly correlated with the normalized path length of the block with VTF (r = 0.675, p = 0.002). This setup is used to quantify the additive or reductive value of VTF during motor function that involves incongruent visual-tactile stimuli. Possible applications are prosthetics design, smart sport-wear, or any other garments that incorporate VTF.

We present a protocol to apply incongruent visual-tactile stimuli during an object transfer task. Specifically, during block transfers, performed while the hand is hidden, a virtual presentation of the block shows random occurrences of false block drops. The protocol also describes adding vibrotactile feedback while performing the motor task.

The application of incongruent sensory signals that involves disrupted tactile feedback is rarely explored, specifically with the presence of vibrotactile ...

Controlled Rotation of Human Observers in a Virtual Reality Environment

The low cost and availability of Virtual Reality (VR) systems have supported a recent acceleration of research into perception and behavior under more naturalistic, multisensory, and immersive conditions. One area of research that has particularly benefited from the use of VR systems is multisensory integration, for example, the integration of visual and vestibular cues to give rise to a sense of self-motion. For this reason, an accessible method for the controlled physical rotation of an observer in a virtual environment represents a useful innovation. This paper presents a method for automating the rotation of an office swivel chair along with a method for integrating that motion into a VR experience. Using an example experiment, it is demonstrated that the physical motion, thus produced, is integrated with the visual experience of an observer in a way consistent with expectations; high integration when the motion is congruent with the visual stimulus and low integration when the motion is incongruent.

The controlled physical rotation of a human observer is desirable for certain experimental, recreational, and educational applications. This paper outlines a method for converting an office swivel chair into a medium for controlled physical rotation in a virtual reality environment.

The low cost and availability of Virtual Reality (VR) systems have supported a recent acceleration of research into perception and behavior under more ...

Motor Imagery Using VR Digital Avatars in a Brain-Computer Interface System

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

This study introduces an innovative framework for neurological rehabilitation by integrating brain-computer interfaces (BCI) and virtual reality (VR) technologies with the customization of three-dimensional (3D) avatars. Traditional approaches to rehabilitation often fail to fully engage patients, primarily due to their inability to provide a deeply immersive and interactive experience. This research endeavors to fill this gap by utilizing motor imagery (MI) techniques, where participants visualize physical movements without actual execution. This method capitalizes on the brain's neural mechanisms, activating areas involved in movement execution when imagining movements, thereby facilitating the recovery process. The integration of VR's immersive capabilities with the precision of electroencephalography (EEG) to capture and interpret brain activity associated with imagined movements forms the core of this system. Digital Twins in the form of personalized 3D avatars are employed to significantly enhance the sense of immersion within the virtual environment. This heightened sense of embodiment is crucial for effective rehabilitation, aiming to bolster the connection between the patient and their virtual counterpart. By doing so, the system not only aims to improve motor imagery performance but also seeks to provide a more engaging and efficacious rehabilitation experience. Through the real-time application of BCI, the system allows for the direct translation of imagined movements into virtual actions performed by the 3D avatar, offering immediate feedback to the user. This feedback loop is essential for reinforcing the neural pathways involved in motor control and recovery. The ultimate goal of the developed system is to significantly enhance the effectiveness of motor imagery exercises by making them more interactive and responsive to the user's cognitive processes, thereby paving a new path in the field of neurological rehabilitation.

Author Spotlight: Enhancing Neurorehabilitation Through EEG, Motor Imagery, and Virtual Reality

Motor imagery in a virtual reality environment has wide applications in brain-computer interface systems. This manuscript outlines the use of personalized digital avatars that resemble the participants performing movements imagined by the participant in a virtual reality environment to enhance immersion and a sense of body ownership.

This study introduces an innovative framework for neurological rehabilitation by integrating brain-computer interfaces (BCI) and virtual reality (VR) ...

Bioengineering

The Rubber Hand Illusion

Source: Laboratory of Jonathan Flombaum&#8212;Johns Hopkins University
Reaching for objects, walking without hitting obstacles, landing on a chair as you sit (instead of falling to the floor), these and all our physical actions depend on an ability to perceive our own bodies in space, to know where our limbs are relative to one another and relative to the rest of the world. One way that the human brain encodes this information is called proprioception, the brain relies on its own control and feedback signals to keep track of limbs. Along with proprioceptive inputs, the human brain incorporates vision, touch, and even sound in order to represent the parts of the body in space. How does it combine all this information? In 1998, Botvinick and Cohen described a striking illusion, called the Rubber Hand Illusion, that has been used to investigate how the human brain integrates sensory and proprioceptive inputs to represent the body in space.1 This video will demonstrate how to induce the Rubber Hand Illusion and it will describe how it has been used by subsequent studies.

Studying Proprioception Using the Rubber Hand Illusion

Source: Laboratory of Jonathan Flombaum&#8212;Johns Hopkins University
Reaching for objects, walking without hitting obstacles, landing on a chair as you ...

Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

Samenvatting

Meer video's verkennen