Name: a networked desktop virtual reality setup for decision science and navigation experiments with multiple participants
Uploaded: 2018-08-26T14:00:00
Description: Watch this Scientific Journal Video about A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants at JoVE.com

The representative study was funded by the Swiss National Science Foundation as part of the grant &#34;Wayfinding in Social Environments&#34; (No. 100014_162428). We want to thank M. Moussaid for insightful discussions. We also want to thank C. Wilhelm, F. Thaler, H. Abdelrahman, S. Madjiheurem, A. Ingold, and A. Grossrieder for their work during the software development.

All methods described here have been approved by Research Ethics Committee of ETH Z&#252;rich as part of the proposal EK 2015-N-37.
1. Recruit Participants for the Planned Experimental Session.
<ol>
	<li>Sample the participants within particular constraints (e.g., age, gender, educational background) using the participant recruitment system.</li>
	<li>Send invitations by email to the randomly selected participants using the contact information provided by the recruitment system.</li...

<ol>
	<li>Waller, D., Nadel, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Handbook of Spatial Cognition. , (2013).</li><li>Denis, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Space and Spatial Cognition: A Multidisciplinary Perspective. , (2017).</li><li>Moussa&#239;d, M., Kapadia, M., Thrash, T., Sumner, R. W., Gross, M., Helbing, D., H&#246;lscher, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Crowd+behaviour+during+high-stress+evacuations+in+an+immersive+virtual+environment.">Crowd behaviour during high-stress evacuations in an immersive virtual environment.</a> Journal of the Royal Society Interface. 13 (122), 20160414 (2016).</li><li>Gr&#252;bel, J., Weibel, R., Jiang, M. H., H&#246;lscher, C., Hackman, D. A., Schinazi, V. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=EVE:+A+Framework+for+Experiments+in+Virtual+Environments.">EVE: A Framework for Experiments in Virtual Environments.</a> Spatial Cognition X: Lecture Notes in Artificial Intelligence. , 159-176 (2017).</li><li>Loomis, J. M., Blascovich, J. J., Beall, A. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Immersive+virtual+environment+technology+as+a+basic+research+tool+in+psychology.">Immersive virtual environment technology as a basic research tool in psychology.</a> Behavior Research Methods, Instruments, &amp; Computers. 31 (4), 557-564 (1999).</li><li>Brooks, F. P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=What's+Real+About+Virtual+Reality?.">What's Real About Virtual Reality?.</a> Proceedings IEEE Virtual Reality. , (1999).</li><li>Moorthy, K., Munz, Y., Jiwanji, M., Bann, S., Chang, A., Darzi, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Validity+and+reliability+of+a+virtual+reality+upper+gastrointestinal+simulator+and+cross+validation+using+structured+assessment+of+individual+performance+with+video+playback.">Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback.</a> Surgical Endoscopy and Other Interventional Techniques. 18 (2), 328-333 (2004).</li><li>Weisberg, S. M., Schinazi, V. R., Newcombe, N. S., Shipley, T. F., Epstein, R. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Variations+in+cognitive+maps:+Understanding+individual+differences+in+navigation.">Variations in cognitive maps: Understanding individual differences in navigation.</a> Journal of Experimental Psychology: Learning Memory and Cognition. 40 (3), 669-682 (2014).</li><li>Schinazi, V. R., Nardi, D., Newcombe, N. S., Shipley, T. F., Epstein, R. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Hippocampal+size+predicts+rapid+learning+of+a+cognitive+map+in+humans.">Hippocampal size predicts rapid learning of a cognitive map in humans.</a> Hippocampus. 23 (6), 515-528 (2013).</li><li>Ruddle, R. A., Payne, S. J., Jones, D. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Navigating+Large-Scale+&amp;#34;Desk-+Top&amp;#34;+Virtual+Buildings:+Effects+of+orientation+aids+and+familiarity.">Navigating Large-Scale &amp;#34;Desk- Top&amp;#34; Virtual Buildings: Effects of orientation aids and familiarity.</a> Presence. 7 (2), 179-192 (1998).</li><li>Riva, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Virtual+Reality+in+Psychotherapy:+Review.">Virtual Reality in Psychotherapy: Review.</a> CyberPsychology &amp; Behavior. 8 (3), 220-230 (2005).</li><li>Ruse, S. A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Development+of+a+Virtual+Reality+Assessment+of+Everyday+Living+Skills.">Development of a Virtual Reality Assessment of Everyday Living Skills.</a> Journal of Visualized Experiments. (86), 1-8 (2014).</li><li>Ploydanai, K., van den Puttelaar, J., van Herpen, E., van Trijp, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Using+a+Virtual+Store+As+a+Research+Tool+to+Investigate+Consumer+In-store+Behavior.">Using a Virtual Store As a Research Tool to Investigate Consumer In-store Behavior.</a> Journal of Visualized Experiments. (125), 1-15 (2017).</li><li>Satava, R. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Virtual+reality+surgical+simulator+-+The+first+steps.">Virtual reality surgical simulator - The first steps.</a> Surgical Endoscopy. 7 (3), 203-205 (1993).</li><li>Stanney, K. M., Hale, K. S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Handbook of virtual environments: Design, implementation, and applications. , 811-834 (2014).</li><li>Ryu, J., Kim, G. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Using+a+vibro-tactile+display+for+enhanced+collision+perception+and+presence.">Using a vibro-tactile display for enhanced collision perception and presence.</a> Proceedings of the ACM symposium on Virtual reality software and technology VRST 04. , 89 (2004).</li><li>Louison, C., Ferlay, F., Mestre, D. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Spatialized+vibrotactile+feedback+contributes+to+goal-directed+movements+in+cluttered+virtual+environments.">Spatialized vibrotactile feedback contributes to goal-directed movements in cluttered virtual environments.</a> 2017 IEEE Symposium on 3D User Interfaces (3DUI). , 99-102 (2017).</li><li>Knierim, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Tactile+Drones+-+Providing+Immersive+Tactile+Feedback+in+Virtual+Reality+through+Quadcopters.">Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters.</a> Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17. , 433-436 (2017).</li><li>Serafin, S., Nordahl, R., De G&#246;tzen, A., Erkut, C., Geronazzo, M., Avanzini, F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Sonic+interaction+in+virtual+environments.">Sonic interaction in virtual environments.</a> 2015 IEEE 2nd VR Workshop on Sonic Interactions for Virtual Environments (SIVE). , 1-2 (2015).</li><li>Gr&#252;bel, J., Thrash, T., H&#246;lscher, C., Schinazi, V. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluation+of+a+conceptual+framework+for+predicting+navigation+performance+in+virtual+reality.">Evaluation of a conceptual framework for predicting navigation performance in virtual reality.</a> PLoS One. 12 (9), (2017).</li><li>Thrash, T., Kapadia, M., Moussaid, M., Wilhelm, C., Helbing, D., Sumner, R. W., H&#246;lscher, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluation+of+control+interfaces+for+desktop+virtual+environments.">Evaluation of control interfaces for desktop virtual environments.</a> Presence. 24 (4), (2015).</li><li>Ruddle, R. A., Volkova, E., B&#252;lthoff, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Learning+to+walk+in+virtual+reality.">Learning to walk in virtual reality.</a> ACM Transactions on Applied Perception. 10 (2), 1-17 (2013).</li><li>Moussa&#239;d, M., Perozo, N., Garnier, S., Helbing, D., Theraulaz, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+walking+behaviour+of+pedestrian+social+groups+and+its+Impact+on+crowd+dynamics.">The walking behaviour of pedestrian social groups and its Impact on crowd dynamics.</a> PLoS One. 5 (4), e10047 (2010).</li><li>Bode, N. W. F., Franks, D. W., Wood, A. J., Piercy, J. J. B., Croft, D. P., Codling, E. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Distinguishing+Social+from+Nonsocial+Navigation+in+Moving+Animal+Groups.">Distinguishing Social from Nonsocial Navigation in Moving Animal Groups.</a> The American Naturalist. 179 (5), 621-632 (2012).</li><li>Kinateder, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Social+influence+on+route+choice+in+a+virtual+reality+tunnel+fire.">Social influence on route choice in a virtual reality tunnel fire.</a> Transportation Research Part F: Traffic Psychology and Behaviour. 26, 116-125 (2014).</li><li>Drury, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Cooperation+versus+competition+in+a+mass+emergency+evacuation:+A+new+laboratory+simulation+and+a+new+theoretical+model.">Cooperation versus competition in a mass emergency evacuation: A new laboratory simulation and a new theoretical model.</a> Behavior Research Methods. 41 (3), 957-970 (2009).</li><li>Helbing, D., Buzna, L., Johansson, A., Werner, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Self-Organized+Pedestrian+Crowd+Dynamics:+Experiments,+Simulations,+and+Design+Solutions.">Self-Organized Pedestrian Crowd Dynamics: Experiments, Simulations, and Design Solutions.</a> Transportation Science. 39 (1), 1-24 (2005).</li><li>Moussa&#239;d, M., Helbing, D., Theraulaz, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=How+simple+rules+determine+pedestrian+behavior+and+crowd+disasters.">How simple rules determine pedestrian behavior and crowd disasters.</a> Proceedings of the National Academy of Sciences of the United States of America. 108 (17), 6884-6888 (2011).</li><li>Singh, S., Kapadia, M., Faloutsos, P., Reinman, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+open+framework+for+developing,+evaluating,+and+sharing+steering+algorithms.">An open framework for developing, evaluating, and sharing steering algorithms.</a> International Workshop on Motion in Games. , 158-169 (2009).</li><li>Singh, S., Kapadia, M., Hewlett, B., Reinman, G., Faloutsos, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+modular+framework+for+adaptive+agent-based+steering.">A modular framework for adaptive agent-based steering.</a> Symposium on Interactive 3D Graphics and Games. , (2011).</li><li>Bode, N., Codling, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Human+exit+route+choice+in+virtual+crowd+evacuations.">Human exit route choice in virtual crowd evacuations.</a> Animal Behaviour. 86, 347-358 (2013).</li><li>Bode, N. W. F., Kemloh Wagoum, A. U., Codling, E. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Human+responses+to+multiple+sources+of+directional+information+in+virtual+crowd+evacuations.">Human responses to multiple sources of directional information in virtual crowd evacuations.</a> Journal of the Royal Society Interface. 11 (91), 20130904 (2014).</li><li>Pandzic, I. S., Capin, T., Lee, E., Thalmann, N. M., Thalmann, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+flexible+architecture+for+virtual+humans+in+networked+collaborative+virtual+environments.">A flexible architecture for virtual humans in networked collaborative virtual environments.</a> Computer Graphics Forum. 16, (1997).</li><li>Joslin, C., Pandzic, I. S., Thalmann, N. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Trends+in+networked+collaborative+virtual+environments.">Trends in networked collaborative virtual environments.</a> Computer Communications. 26 (5), 430-437 (2003).</li><li>Molka-Danielsen, J., Chabada, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Application+of+the+3D+multi+user+virtual+environment+of+Second+Life+to+emergency+evacuation+simulation.">Application of the 3D multi user virtual environment of Second Life to emergency evacuation simulation.</a> System Sciences (HICSS), 2010 43rd Hawaii International Conference. , 1-9 (2010).</li><li>Normoyle, A., Drake, J., Safonova, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Egress online: Towards leveraging massively, multiplayer environments for evacuation studies. , (2012).</li><li>Bock, O., Baetge, I., Nicklisch, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=hroot:+Hamburg+registration+and+organization+online+tool.">hroot: Hamburg registration and organization online tool.</a> European Economic Review. 71, 117-120 (2014).</li><li>Tanvir Ahmed, D., Shirmohammadi, S., Oliveira, J., Bonney, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Supporting+large-scale+networked+virtual+environments.">Supporting large-scale networked virtual environments.</a> Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2007. IEEE Symposium. , 150-154 (2007).</li><li>Cipresso, P., Bessi, A., Colombo, D., Pedroli, E., Riva, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Computational+psychometrics+for+modeling+system+dynamics+during+stressful+disasters.">Computational psychometrics for modeling system dynamics during stressful disasters.</a> Frontiers in Psychology. 8, 1-6 (2017).</li><li>Bernold, E., Gsottbauer, E., Ackermann, K., Murphy, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Social framing and cooperation: The roles and interaction of preferences and beliefs. , 1-26 (2015).</li><li>Balietti, S., Goldstone, R. L., Helbing, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Peer+review+and+competition+in+the+Art+Exhibition+Game.">Peer review and competition in the Art Exhibition Game.</a> Proceedings of the National Academy of Sciences of the United States of America. 113 (30), 8414-8419 (2016).</li><li>Gomez-Marin, A., Paton, J. J., Kampff, A. R., Costa, R. M., Mainen, Z. F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Big+behavioral+data:+Psychology,+ethology+and+the+foundations+of+neuroscience.">Big behavioral data: Psychology, ethology and the foundations of neuroscience.</a> Nature Neuroscience. 17 (11), 1455-1462 (2014).</li></ol>

In this article, we described a multi-user desktop virtual reality laboratory in which up to 36 participants can interact and simultaneously navigate through various virtual environments. The experimental protocol details the steps necessary for this type of research and unique to multi-user scenarios. Considerations specific to these scenarios include the number of participants in attendance, the cost of seemingly small experimenter errors, rendering and networking capacities (both server- and client-side), training wit...

Research on spatial cognition and navigation typically studies the spatial decision-making (e.g., turning left or right at an intersection) and mental representation of individuals in real and virtual environments1,2. The advantages of virtual reality (VR) include the prevention of ethical and safety issues (e.g., during a dangerous evacuation3), the automatic measurement and analysis of spatial data4, and a balanced combination of internal and external validity5,6,7. For example, Weisberg and colleagues extended previous research on individual differences in spatial knowledge acquisition by demonstrating that spatial tasks in VR can provide an objective behavioral measure of spatial ability8. This study also suggested that the navigation behavior in VR approximates real-world navigation because the virtual environment was modeled after the university campus used by Schinazi and colleagues9 (see also the study of Ruddle and colleagues10). VR has also been applied to psychotherapy11, clinical assessment12, consumer behavior13, and surgery14,15. However, most VR systems lack proprioceptive and audio feedback that may improve presence and immersion16,17,18,19, require training with the control interface20,21,22, and lack social cues. Indeed, people in the real world often move in groups23, avoid or follow other people3,24, and make decisions based on social context25,26.
At the same time, research on crowd behavior often focuses on emergent characteristics of crowds (e.g., lane formation, congestion at bottlenecks) that are simulated on a computer or observed in the real world. For example, Helbing and colleagues used a combination of real-world observations and computer simulations in order to suggest improvements to traffic flow in an intersection by separating inflow and outflow with physical barriers and placing an obstacle in the center27. Moussa&#239;d and colleagues used a heuristics-based model to study high-density situations during a crowd disaster28. This approach suggested improvements to an environmental setting for mass events in order to avoid crowd disasters. With the aid of an existing open source framework, the implementation of such simulations could be relatively easy. SteerSuite is an open source framework that allows users to simulate steering algorithms and crowd behavior easily by providing tools for facilitating, benchmarking, and testing29. This framework can provide the core of an agent&#39;s navigation rationale, which is critical for successful crowd simulation. In addition, Singh and colleagues demonstrated a single platform that combines a variety of steering techniques30. While researchers can propose design interventions using such simulations, they are rarely validated with human participants in a controlled setting. Controlled experiments are rare in crowd research because they can be difficult to organize and dangerous to the participants.
VR has been employed to investigate social behavior using simple and complex virtual environments with one or more computer-simulated agents. In the study of Bode and colleagues31,32, the participants were asked to evacuate a simple virtual environment from a top-down perspective among several agents and found that exit choice was affected by static signage and motivation. Presenting participants with a more complex environment from a first-person perspective, Kinateder and colleagues found that the participants were more likely to follow a single computer-simulated agent during the escape from a virtual tunnel fire25. In a complex virtual environment with multiple agents, Drury and colleagues found that the participants tended to assist a fallen agent during an evacuation when they identified with the crowd26. Collectively, these findings suggest that VR can be an effective way of eliciting social behaviors, even with computer-simulated agents. However, some crowd behaviors may only be observed when there is a realistic social signal (i.e., when the participants are aware that the other avatars are controlled by people3). In order to address this shortcoming, the present protocol describes a method for conducting controlled experiments with multiple users in a networked VR setup. This approach has been employed in a recent study by Moussaid and colleagues in order to investigate the evacuation behavior of 36 networked participants3.
Research on networked VR has focused on topics unrelated to navigation strategies33,34 and/or relied on existing online gaming platforms such as Second Life. For example, Molka-Danielsen and Chabada investigated evacuation behavior in terms of exit choice and spatial knowledge of the building using participants recruited among existing users of Second Life35. While the authors provide some descriptive results (e.g., visualizations of trajectories), this study had difficulties with participant recruitment, experimental control, and generalization beyond this specific case. More recently, Normoyle and colleagues found that existing users of Second Life and participants in a laboratory were comparable in terms of evacuation performance and exit choice and different in terms of self-reported presence and frustration with the control interface36. The findings from these two studies highlight some of the challenges and opportunities afforded by online and laboratory experiments. Online studies are capable of drawing from a much larger and motivated population of potential participants. However, laboratory studies allow for more experimental control of the physical environment and potential distractions. In addition, online studies may pose some ethical concerns regarding data anonymity and confidentiality.
As a networked desktop VR laboratory, the Decision Science Laboratory (DeSciL) at ETH Z&#252;rich is primarily used to study economic decision-making and strategic interactions in a controlled environment. The technical infrastructure at the DeSciL consists of hardware, software for laboratory automation, and software that supports the multi-user desktop VR setup. The hardware includes high-performance desktop computers with Microsoft Windows 10 Enterprise operating system, control interfaces (e.g., mouse and keyboard, joysticks), headphones, and eye trackers (Table of Materials). All client computers are connected with Ethernet of one gigabit per second to the university network and the same network file share. There is no visible delay or lag when there are 36 clients connected. The number of frames per second is consistently above 100. The experiments are also managed and controlled with laboratory automation software based on Microsoft PowerShell (i.e., PowerShell Desired State Configuration and PowerShell Remoting). All relevant steps of the protocol are preprogrammed with PowerShell scripts called Cmdlets (e.g., Start-Computer, Stop-Computer). During the experiment, these scripts can be executed simultaneously and remotely on all client computers. This type of laboratory automation ensures an identical state of the client computers, reduces potential errors and complexity during scientific testing, and prevents researchers from having to perform repetitive manual tasks. For the navigation experiments, we use the Unity game engine (&#60;https://unity3d.com/&#62;) in order to support the development of 2D and 3D environments for multi-user, interactive desktop VR. The 36 client computers are connected to a server via an authoritative server architecture. At the start of every experiment, each client sends an instantiation request to the server, and the server responds by instantiating an avatar for that user on all of the connected machines. Each user&#39;s avatar has a camera with a 50 degrees field of view. Throughout the experiment, the clients send user&#39; input to the server, and the server updates the movement of all of the clients.
In the physical laboratory, each computer is contained in a separate cubicle within three semi-independent rooms (Figure 1). The overall size of the laboratory is 170 m2 (150 m2 for experiment room and 20 m2 for control room). Each of these rooms is equipped with audio and video recording devices. Experiments are controlled from a separate adjacent room (i.e., by providing instructions and initiating the experimental program). From this control room, the experimenters can also observe the participants in both physical and virtual environments. Together with the Department of Economics at the University of Z&#252;rich, the DeSciL also maintains the University Registration Center for Study Participants, which was implemented based on h-root37.
Although similar systems have been described in the literature38, the DeSciL is the first functional laboratory that is suitable for multi-user desktop VR experiments on navigation and crowd behavior to our knowledge. Here, we describe the protocol for conducting an experiment in the DeSciL, present representative results from one study on social navigation behavior and discuss the potential and limitations of this system.

<table>
	<tbody>
		<tr>
			<td>PC</td>
			<td>Lenovo</td>
			<td>IdeaCentre AIO 700</td>
			<td>24&#8217;&#8217; screen, 16 GB RAM, and SSDs. CPU: Intel core i7. GPU:NVidia GeForce GTX 950A</td>
		</tr>
		<tr>
			<td>Keyboard</td>
			<td>Lenovo</td>
			<td>LXH-EKB-10YA</td>
			<td></td>
		</tr>
		<tr>
			<td>Mouse</td>
			<td>Lenovo</td>
			<td>SM-8825</td>
			<td></td>
		</tr>
		<tr>
			<td>Eye tracker</td>
			<td>Tobii Technology</td>
			<td>Tobii EyeX</td>
			<td>Data rate: 60 Hz. Tracking screen size: Up to 27&#8243;</td>
		</tr>
		<tr>
			<td>Communication audio system</td>
			<td>Biamp Systems</td>
			<td>Networked paging station - 1</td>
			<td>Ethernet:100BaseTX</td>
		</tr>
	</tbody>
</table>

a networked desktop virtual reality setup for decision science and navigation experiments with multiple participants

Investigating the interactions among multiple participants is a challenge for researchers from various disciplines, including the decision sciences and spatial cognition. With a local area network and dedicated software platform, experimenters can efficiently monitor the behavior of the participants that are simultaneously immersed in a desktop virtual environment and digitalize the collected data. These capabilities allow for experimental designs in spatial cognition and navigation research that would be difficult (if not impossible) to conduct in the real world. Possible experimental variations include stress during an evacuation, cooperative and competitive search tasks, and other contextual factors that may influence emergent crowd behavior. However, such a laboratory requires maintenance and strict protocols for data collection in a controlled setting. While the external validity of laboratory studies with human participants is sometimes questioned, a number of recent papers suggest that the correspondence between real and virtual environments may be sufficient for studying social behavior in terms of trajectories, hesitations, and spatial decisions. In this article, we describe a method for conducting experiments on decision-making and navigation with up to 36 participants in a networked desktop virtual reality setup (i.e., the Decision Science Laboratory or DeSciL). This experiment protocol can be adapted and applied by other researchers in order to set up a networked desktop virtual reality laboratory.

For each client on each trial, the experiment data from the DeSciL typically include trajectories, time stamps, and measures of performance (e.g., whether the participant turned in the &#34;correct&#34; direction at a particular intersection). A representative study investigated the effects of signage complexity on the route choice for a crowd of human participants (with virtual avatars) in a simple Y-shaped virtual environment. In this experiment, 28 participants (12 women and 1...

Watch this Scientific Journal Video about A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants at JoVE.com

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

This paper describes a method for conducting multi-user experiments on decision-making and navigation using a networked computer laboratory.

Investigating the interactions among multiple participants is a challenge for researchers from various disciplines, including the decision sciences and ...

This method can help answer key questions in the decision science and spatial cognition fields, such as how to use desktop virtual reality to conduct wayfinding studies with multiple participants. The main advantage of this technique is that the experimental protocol can be adapted and applied by other researchers in order to set up a network desktop virtual reality laboratory. The implications of this technique extend toward behavioral science and spatial cognition, because experimenters can efficiently monitor the behavior of participants that are simultaneously immersed in a desktop virtual environment.Generally individuals new to this method will struggle because such a laboratory requires maintenance and strict protocols to collect data in a controlled setting. The visual demonstration of this method is critical because of difficulties associated with multi-user desktop virtual reality experiments, such as setting up the experiment and managing participants. Demonstrating this procedure will be Alvaro Ingold, a technician from our laboratory.Begin by turning on the server and the lights in the control room at the lab. Set up the testing rooms according to the required number of participants. Copy the executable experiment program and its corresponding configuration files on the network drive.Then open PowerShell Integrated Scripting Environment on the Windows desktop. In the PowerShell console, specify an array of computer names to create a client pool object. Type Start-Pool pool to start the client computers, and Register-Pool pool to connect the server to the client computers.Next, prepare the computers on the client side before launching the program. Type Invoke-Pool Mount-NetworkShare path}to direct the computers to enter the right folder path. Then, execute the prepared functions on the server by typing in Start-GameServer, and typing on the client's computer Invoke-Pool Start-GameClient}Specify the IP Address of the server as parameter of the function.Wait for a message on the server's monitor that indicates a successful connection. Finally, distribute the consent forms and pens in each cubicle. Shuffle the deck of seating cards that indicate the seating arrangement of the participants.Five minutes before the official start time, start checking each participant's ID to ensure that they match the list of registered participants. Then let the participants pick a card that indicates their seat number. Have the participants walk to the corresponding cubicle, and to read and sign the consent forms.Pick up these before conducting the experiment. Broadcast the instructions with a microphone to all the participants. Inform them of the basic rules, including no communication to other participants, and no personal electronic devices permitted.Ask the participants to raise their hands if they have any questions regarding the experiment. Begin the experiment by presenting the demographic questionnaire. Deploy the training scene to teach the participants how to maneuver through the virtual environment and monitor progress by looking at screenshots from all computers until all participants have finished the training session.After the training session, begin the testing phase of the experiment. Ensure that there is a short waiting period before each trial for loading the next scene and allowing the participants to read the instructions. Observe the participants'behaviors from the birds-eye interface on the server computer.After the experiment is complete, close the server and client program by typing Stop-GameClient and Stop-GameServer in the PowerShell console. Then, ask the participants to remain seated until their number is called over the microphone. Extract the participants'final scores from the file score.txt in the Project Folder on the server's computer, and convert their scores into a monetary payment. Copy and save the experiment data from the server to an external disk for future analysis. Then, call the cubicle numbers one at at time, and meet each participant at the reception desk.Thank the participant and give them the corresponding payment. Finally, examine the empty cubicles and collect any remaining pens or forms. Here, the maximum and minimum times are the times required by the fastest and slowest participants to reach the destination on each trial.These descriptive statistics indicate the extent to which the participants became familiar with the environment over trials. The obtained data also allows for the visualization of trajectories generated but the virtual crowd in Trial 1 and Trial 16. Spatial statistics can then be used to analyze the changes in trajectories over trials.While attempting this procedure, it's important to remember to always follow the strict steps of the designed experiments because of the cost associated with each experimental session.

a-networked-desktop-virtual-reality-setup-for-decision-science

Research

JoVE Journal

Behavior

Two-photon Calcium Imaging in Mice Navigating a Virtual Reality Environment

In recent years, two-photon imaging has become an invaluable tool in neuroscience, as it allows for chronic measurement of the activity of genetically identified cells during behavior1-6. Here we describe methods to perform two-photon imaging in mouse cortex while the animal navigates a virtual reality environment. We focus on the aspects of the experimental procedures that are key to imaging in a behaving animal in a brightly lit virtual environment. The key problems that arise in this experimental setup that we here address are: minimizing brain motion related artifacts, minimizing light leak from the virtual reality projection system, and minimizing laser induced tissue damage. We also provide sample software to control the virtual reality environment and to do pupil tracking. With these procedures and resources it should be possible to convert a conventional two-photon microscope for use in behaving mice.

Here we describe the experimental procedures involved in two-photon imaging of mouse cortex during behavior in a virtual reality environment.

In recent years, two-photon imaging has become an invaluable tool in neuroscience, as it allows for chronic measurement of the activity of genetically ...

Development of a Virtual Reality Assessment of Everyday Living Skills

Cognitive impairments affect the majority of patients with schizophrenia and these impairments predict poor long term psychosocial outcomes.&#160; Treatment studies aimed at cognitive impairment in patients with schizophrenia not only require demonstration of improvements on cognitive tests, but also evidence that any cognitive changes lead to clinically meaningful improvements.&#160; Measures of &#8220;functional capacity&#8221; index the extent to which individuals have the potential to perform skills required for real world functioning. &#160;Current data do not support the recommendation of any single instrument for measurement of functional capacity.&#160; The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) is a novel, interactive gaming based measure of functional capacity that uses a realistic simulated environment to recreate routine activities of daily living. Studies are currently underway to evaluate and establish the VRFCAT&#8217;s sensitivity, reliability, validity, and practicality.&#160;This new measure of functional capacity is practical, relevant, easy to use, and has several features that improve validity and sensitivity of measurement of function in clinical trials of patients with CNS disorders.

A challenge for proving treatment efficacy for cognitive impairments in schizophrenia is finding the optimizing measurement of skills related to everyday functioning.&#160; The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) is an interactive gaming based computerized measure aimed at skills associated with everyday functioning, including baseline impairments and treatment related changes.

Cognitive impairments affect the majority of patients with schizophrenia and these impairments predict poor long term psychosocial outcomes.&#160; ...

Multifunctional Setup for Studying Human Motor Control Using Transcranial Magnetic Stimulation, Electromyography, Motion Capture, and Virtual Reality

The study of neuromuscular control of movement in humans is accomplished with numerous technologies. Non-invasive methods for investigating neuromuscular function include transcranial magnetic stimulation, electromyography, and three-dimensional motion capture. The advent of readily available and cost-effective virtual reality solutions has expanded the capabilities of researchers in recreating &#8220;real-world&#8221; environments and movements in a laboratory setting. Naturalistic movement analysis will not only garner a greater understanding of motor control in healthy individuals, but also permit the design of experiments and rehabilitation strategies that target specific motor impairments (e.g. stroke). The combined use of these tools will lead to increasingly deeper understanding of neural mechanisms of motor control. A key requirement when combining these data acquisition systems is fine temporal correspondence between the various data streams. This protocol describes a multifunctional system&#8217;s overall connectivity, intersystem signaling, and the temporal synchronization of recorded data. Synchronization of the component systems is primarily accomplished through the use of a customizable circuit, readily made with off the shelf components and minimal electronics assembly skills.

Transcranial magnetic stimulation, electromyography, and 3D motion capture are commonly used non-invasive techniques for investigating neuromuscular function in humans. In this paper, we describe a protocol that synchronously samples data generated by all three of these tools along with the unique addition of virtual reality stimulus presentation and feedback.

The study of neuromuscular control of movement in humans is accomplished with numerous technologies. Non-invasive methods for investigating neuromuscular ...

Mobile Game-based Virtual Reality Program for Upper Extremity Stroke Rehabilitation

Stroke rehabilitation requires repetitive, intensive, goal-oriented therapy. Virtual reality (VR) has the potential to satisfy these requirements. Game-based therapy can promote patients&#39; engagement in rehabilitation therapy as a more interesting and a motivating tool. Mobile devices such as smartphones and tablet PCs can provide personalized home-based therapy with interactive communication between patients and clinicians. In this study, a mobile VR upper extremity rehabilitation program using game applications was developed. The findings from the study show that the mobile game-based VR program effectively promotes upper extremity recovery in patients with stroke. In addition, patients completed two weeks of treatment using the program without adverse effects and were generally satisfied with the program. This mobile game-based VR upper extremity rehabilitation program can substitute for some parts of the conventional therapy that are delivered one-on-one by an occupational therapist. This time-efficient, easy to implement, and clinically effective program would be a good candidate tool for tele-rehabilitation for upper extremity recovery in patients with stroke. Patients and therapists can collaborate remotely through these e-health rehabilitation programs while reducing economic and social costs.

Here, we present a protocol to develop and apply a mobile game-based virtual reality program for the recovery of upper limb dysfunction in patients with stroke. The present study shows that the mobile program is feasible and effectively promotes upper limb recovery in stroke patients.

Stroke rehabilitation requires repetitive, intensive, goal-oriented therapy. Virtual reality (VR) has the potential to satisfy these requirements. ...

Measuring the Kinematics of Daily Living Movements with Motion Capture Systems in Virtual Reality

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based assessments of IADL are easy to use but prone to subjective bias. Here, we describe a novel virtual reality (VR) test to assess two complex IADL tasks: handling financial transactions and using public transportation. While a participant performs the tasks in a VR setting, a motion capture system traces the position and orientation of the dominant hand and head in a three-dimensional Cartesian coordinate system. Kinematic raw data are collected and converted into &#39;kinematic performance measures,&#39; i.e., motion trajectory, moving distance, and time to completion. Motion trajectory is the path of a particular body part (e.g., dominant hand or head) in space. Moving distance refers to the total distance of the trajectory, and time to completion is how long it took to complete an IADL task. These kinematic measures could discriminate patients with cognitive impairment from healthy controls. The development of this kinematic measuring protocol allows detection of early IADL-related cognitive impairments.

We designed a virtual reality test to assess instrumental activities of daily living (IADL) with a motion capture system. We propose a detailed kinematic analysis to interpret the participant&#39;s various movements, including trajectory, moving distance, and time to completion to evaluate IADL capabilities.

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based ...

Virtual Reality Experiments with Physiological Measures

Virtual reality (VR) experiments are increasingly employed because of their internal and external validity compared to real-world observation and laboratory experiments, respectively. VR is especially useful for geographic visualizations and investigations of spatial behavior. In spatial behavior research, VR provides a platform for studying the relationship between navigation and physiological measures (e.g., skin conductance, heart rate, blood pressure). Specifically, physiological measures allow researchers to address novel questions and constrain previous theories of spatial abilities, strategies, and performance. For example, individual differences in navigation performance may be explained by the extent to which changes in arousal mediate the effects of task difficulty. However, the complexities in the design and implementation of VR experiments can distract experimenters from their primary research goals and introduce irregularities in data collection and analysis. To address these challenges, the Experiments in Virtual Environments (EVE) framework includes standardized modules such as participant training with the control interface, data collection using questionnaires, the synchronization of physiological measurements, and data storage. EVE also provides the necessary infrastructure for data management, visualization, and evaluation. The present paper describes a protocol that employs the EVE framework to conduct navigation experiments in VR with physiological sensors. The protocol lists the steps necessary for recruiting participants, attaching the physiological sensors, administering the experiment using EVE, and assessing the collected data with EVE evaluation tools. Overall, this protocol will facilitate future research by streamlining the design and implementation of VR experiments with physiological sensors.

Virtual reality (VR) experiments can be difficult to implement and require meticulous planning. This protocol describes a method for the design and implementation of VR experiments that collect physiological data from human participants. The Experiments in Virtual Environments (EVE) framework is employed to accelerate this process.

Virtual reality (VR) experiments are increasingly employed because of their internal and external validity compared to real-world observation and ...

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters

Virtual reality (VR) has shown great educational potential because it makes it possible to simulate any desired situation or event, thus playing an important role in addressing current educational challenges. Despite the unlimited learning possibilities that VR may offer, unless users are willing to apply virtual devices to education, the investment of time, money, and effort will be fruitless. It is therefore crucial to assess the educational interest of the first generation of VR users and to identify their current needs. To this end, in this study we designed an online questionnaire and applied it through the SaaS (Software as a service) of a private server. The sample consisted of 117 early VR adopters recruited via a main portal of communication and information technologies in Spain. In order to engage participants, we posted a thread in the main forum, which is dedicated to the advances and potential uses of VR. Once the responses were gathered, we analyzed the relationship between 12 variables (mean contrasts with Snedecor&#39;s F, and contingency analysis with chi-square and Sommer&#39;s d). The results showed that the current profile of a VR user is a male over 35 years old, with university studies, and who has purchased his viewer recently (&#60;1 year). As for the learning and teaching applications that these users were interested in, only 13.7% of the participants in this study use VR for educational purposes, although 28.2% were interested, indicating that perhaps the lack of applications or learning experiences may be hampering the use of VR within education. Almost half of the early adopters surveyed would like to learn using VR technology and are somehow optimistic about the relationship between VR and education, particularly those who are younger.

This article describes the profile of Spanish early adopters of virtual reality and their interests and preferences regarding learning and educational applications for this technology. To this aim, we designed an online questionnaire and interviewed 117 users of the main virtual reality forum on the Internet.

Virtual reality (VR) has shown great educational potential because it makes it possible to simulate any desired situation or event, thus playing an ...

Using a Virtual Reality Walking Simulator to Investigate Pedestrian Behavior

To cross a road successfully, individuals must coordinate their movements with moving vehicles. This paper describes use of a walking simulator in which people walk on a treadmill to intercept gaps between two moving vehicles in an immersive virtual environment. Virtual reality allows for a safe and ecologically varied investigation of gap crossing behavior. Manipulating the initial starting distance can further the understanding of a participant&#8217;s speed regulation while approaching a gap. The speed profile may be assessed for various gap crossing variables, such as initial distance, vehicle size, and gap size. Each walking simulation results in a position/time series that can inform how velocity is adjusted differently depending on the gap characteristics. This methodology can be used by researchers investigating pedestrian behavior and behavioral dynamics while employing human participants in a safe and realistic setting.

This protocol describes use of a walking simulator that serves as a safe and ecologically valid method to study pedestrian behavior in the presence of moving traffic.

To cross a road successfully, individuals must coordinate their movements with moving vehicles. This paper describes use of a walking simulator in which ...

Controlled Rotation of Human Observers in a Virtual Reality Environment

The low cost and availability of Virtual Reality (VR) systems have supported a recent acceleration of research into perception and behavior under more naturalistic, multisensory, and immersive conditions. One area of research that has particularly benefited from the use of VR systems is multisensory integration, for example, the integration of visual and vestibular cues to give rise to a sense of self-motion. For this reason, an accessible method for the controlled physical rotation of an observer in a virtual environment represents a useful innovation. This paper presents a method for automating the rotation of an office swivel chair along with a method for integrating that motion into a VR experience. Using an example experiment, it is demonstrated that the physical motion, thus produced, is integrated with the visual experience of an observer in a way consistent with expectations; high integration when the motion is congruent with the visual stimulus and low integration when the motion is incongruent.

The controlled physical rotation of a human observer is desirable for certain experimental, recreational, and educational applications. This paper outlines a method for converting an office swivel chair into a medium for controlled physical rotation in a virtual reality environment.

The low cost and availability of Virtual Reality (VR) systems have supported a recent acceleration of research into perception and behavior under more ...

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Efficient and economical performance evaluation of pilots has become critical to the aviation industry. With the development of virtual reality (VR) and the combination of eye-tracking technology, solutions to meet these needs are becoming a reality. Previous studies have explored VR-based flight simulators, focusing mainly on technology validation and flight training. The current study developed a new VR flight simulator to evaluate pilots' flight performance based on eye movement and flight indicators in a 3D immersive scene. During the experiment, 46 participants were recruited: 23 professional pilots and 23 college students without flight experience. The experiment results showed significant differences in flight performance between participants with and without flight experience, the former being higher than the latter. In contrast, those with flight experience showed more structured and efficient eye-movement patterns. These results of the differentiation of flight performance demonstrate the validity of the current VR flight simulator as a flight performance assessment method. The different eye-movement patterns with flight experience provide the basis for future flight selection. However, this VR-based flight simulator has shortcomings like motion feedback compared to traditional flight simulators. This flight simulator platform is highly flexible except for the apparent low cost. It can meet the diverse needs of researchers (e.g., measuring situation awareness, VR sickness, and workload by adding relevant scales).

A new virtual reality flight simulator was built, which enables efficient and low-cost evaluation of flight performance and eye movement patterns. It also provides a high-potential research tool for ergonomics and other research.

Efficient and economical performance evaluation of pilots has become critical to the aviation industry. With the development of virtual reality (VR) and ...