Name: evaluating usability aspects of a mixed reality solution for immersive analytics in industry 4.0 scenarios
Uploaded: 2020-10-06T13:00:00
Description: Watch this Scientific Journal Video about Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios at JoVE.com

The authors have nothing to acknowledge.

All materials and methods were approved by the Ethics Committee of Ulm University, and were carried out in accordance with the approved guidelines. All participants gave their written informed consent.
1. Establish Appropriate Study Environment
NOTE: The study was conducted in a controlled environment&#160;to cope with the complex hardware setting. The used mixed reality smartglasses (see Table of Materials) and the laptop for the 2D application were&...

<ol>
	<li>Korinth, M., Sommer-Dittrich, T., Reichert, M., Pryss, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Design+and+Evaluation+of+a+Virtual+Reality-Based+Car+Configuration+Concept.">Design and Evaluation of a Virtual Reality-Based Car Configuration Concept.</a> Science and Information Conference. , 169-189 (2019).</li><li>Whalen, T. E., No&#235;l, S., Stewart, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Measuring+the+human+side+of+virtual+reality.">Measuring the human side of virtual reality.</a> IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2003. , 8-12 (2003).</li><li>Martens, M. A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=It+feels+real:+physiological+responses+to+a+stressful+virtual+reality+environment+and+its+impact+on+working+memory.">It feels real: physiological responses to a stressful virtual reality environment and its impact on working memory.</a> Journal of Psychopharmacology. 33 (10), 1264-1273 (2019).</li><li>Keim, D. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Information+visualization+and+visual+data+mining.">Information visualization and visual data mining.</a> IEEE transactions on Visualization and Computer Graphics. 8 (1), 1-8 (2002).</li><li>Dwyer, T., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Immersive+analytics:+An+introduction.">Immersive analytics: An introduction.</a> Immersive analytics. , 1-23 (2018).</li><li>Moloney, J., Spehar, B., Globa, A., Wang, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+affordance+of+virtual+reality+to+enable+the+sensory+representation+of+multi-dimensional+data+for+immersive+analytics:+from+experience+to+insight.">The affordance of virtual reality to enable the sensory representation of multi-dimensional data for immersive analytics: from experience to insight.</a> Journal of Big Data. 5 (1), 53 (2018).</li><li>Davis, F. D., Riedl, R., Vom Brocke, J., L&#233;ger, P. M., Randolph, A. B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Information Systems and Neuroscience. , (2018).</li><li>Huckins, J. F., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Fusing+mobile+phone+sensing+and+brain+imaging+to+assess+depression+in+college+students.">Fusing mobile phone sensing and brain imaging to assess depression in college students.</a> Frontiers in Neuroscience. 13, 248 (2019).</li><li>Preece, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Human-computer interaction. , (1994).</li><li>Card, S. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> The psychology of human-computer interaction. , (2018).</li><li>Pelayo, S., Senathirajah, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Human+factors+and+sociotechnical+issues.">Human factors and sociotechnical issues.</a> Yearbook of Medical Informatics. 28 (01), 078-080 (2019).</li><li>Bangor, A., Kortum, P., Miller, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Determining+what+individual+SUS+scores+mean:+adding+an+adjective+rating+scale.">Determining what individual SUS scores mean: adding an adjective rating scale.</a> Journal of Usability Studies. 4 (3), 114-123 (2009).</li><li>Krahmer, E., Ummelen, N. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Thinking+about+thinking+aloud:+A+comparison+of+two+verbal+protocols+for+usability+testing.">Thinking about thinking aloud: A comparison of two verbal protocols for usability testing.</a> IEEE Transactions on Professional Communication. 47 (2), 105-117 (2004).</li><li>Hornb&#230;k, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Current+practice+in+measuring+usability:+Challenges+to+usability+studies+and+research.">Current practice in measuring usability: Challenges to usability studies and research.</a> International Journal of Human-Computer Studies. 64 (2), 79-102 (2006).</li><li>Peppa, V., Lysikatos, S., Metaxas, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Human-Computer+interaction+and+usability+testing:+Application+adoption+on+B2C+websites.">Human-Computer interaction and usability testing: Application adoption on B2C websites.</a> Global Journal of Engineering Education. 14 (1), 112-118 (2012).</li><li>Alwashmi, M. F., Hawboldt, J., Davis, E., Fetters, M. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+iterative+convergent+design+for+mobile+health+usability+testing:+mixed-methods+approach.">The iterative convergent design for mobile health usability testing: mixed-methods approach.</a> JMIR mHealth and uHealth. 7 (4), 11656 (2019).</li><li>System Usability Scale (SUS). Assistant Secretary for Public Affairs Available from: <a target="_blank" href="https://www.hhs.gov/about/agencies/aspa/how-to-and-tools/methods/system-usability-scale.html">https://www.hhs.gov/about/agencies/aspa/how-to-and-tools/methods/system-usability-scale.html</a> (2013)</li><li>Fang, Y. M., Lin, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Usability+Testing+of+VR+Interface+for+Tourism+Apps.">The Usability Testing of VR Interface for Tourism Apps.</a> Applied Sciences. 9 (16), 3215 (2019).</li><li>Pryss, R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Exploring+the+Time+Trend+of+Stress+Levels+While+Using+the+Crowdsensing+Mobile+Health+Platform,+TrackYourStress,+and+the+Influence+of+Perceived+Stress+Reactivity:+Ecological+Momentary+Assessment+Pilot+Study.">Exploring the Time Trend of Stress Levels While Using the Crowdsensing Mobile Health Platform, TrackYourStress, and the Influence of Perceived Stress Reactivity: Ecological Momentary Assessment Pilot Study.</a> JMIR mHealth and uHealth. 7 (10), 13978 (2019).</li><li>Zugal, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Investigating+expressiveness+and+understandability+of+hierarchy+in+declarative+business+process+models.">Investigating expressiveness and understandability of hierarchy in declarative business process models.</a> Software &amp; Systems Modeling. 14 (3), 1081-1103 (2015).</li><li>Schobel, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Learnability+of+a+configurator+empowering+end+users+to+create+mobile+data+collection+instruments:+usability+study.">Learnability of a configurator empowering end users to create mobile data collection instruments: usability study.</a> JMIR mHealth and uHealth. 6 (6), 148 (2018).</li><li>Schobel, J., Probst, T., Reichert, M., Schickler, M., Pryss, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Enabling+Sophisticated+Lifecycle+Support+for+Mobile+Healthcare+Data+Collection+Applications.">Enabling Sophisticated Lifecycle Support for Mobile Healthcare Data Collection Applications.</a> IEEE Access. 7, 61204-61217 (2019).</li><li>Hoppenstedt, B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Dimensionality+Reduction+and+Subspace+Clustering+in+Mixed+Reality+for+Condition+Monitoring+of+High-Dimensional+Production+Data.">Dimensionality Reduction and Subspace Clustering in Mixed Reality for Condition Monitoring of High-Dimensional Production Data.</a> Sensors. 19 (18), 3903 (2019).</li><li>Winter, M., Pryss, R., Probst, T., Reichert, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Towards+the+Applicability+of+Measuring+the+Electrodermal+Activity+in+the+Context+of+Process+Model+Comprehension:+Feasibility+Study.">Towards the Applicability of Measuring the Electrodermal Activity in the Context of Process Model Comprehension: Feasibility Study.</a> Sensors. 20, 4561 (2020).</li><li>Butscher, S., Hubenschmid, S., M&#252;ller, J., Fuchs, J., Reiterer, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Clusters,+trends,+and+outliers:+How+immersive+technologies+can+facilitate+the+collaborative+analysis+of+multidimensional+data.">Clusters, trends, and outliers: How immersive technologies can facilitate the collaborative analysis of multidimensional data.</a> Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. , 1-12 (2018).</li><li>Wagner Filho, J. A., Rey, M. F., Freitas, C. M. D. S., Nedel, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Immersive+analytics+of+dimensionally-reduced+data+scatterplots.">Immersive analytics of dimensionally-reduced data scatterplots.</a> 2nd Workshop on Immersive Analytics. , (2017).</li><li>Batch, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=There+is+no+spoon:+Evaluating+performance,+space+use,+and+presence+with+expert+domain+users+in+immersive+analytics.">There is no spoon: Evaluating performance, space use, and presence with expert domain users in immersive analytics.</a> IEEE Transactions on Visualization and Computer Graphics. 26 (1), 536-546 (2019).</li><li>Towards hmd-based immersive analytics. HAL Available from: <a target="_blank" href="https://hal.archives-ouvertes.fr/hal-01631306">https://hal.archives-ouvertes.fr/hal-01631306</a> (2017)</li><li>Luboschik, M., Berger, P., Staadt, O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=On+spatial+perception+issues+in+augmented+reality+based+immersive+analytics.">On spatial perception issues in augmented reality based immersive analytics.</a> Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces. , 47-53 (2016).</li><li>Fonnet, A., Pri&#233;, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Survey+of+Immersive+Analytics.">Survey of Immersive Analytics.</a> IEEE Transactions on Visualization and Computer. , (2019).</li><li>Spielberger, C. D., Gorsuch, R. L., Lushene, R. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=STAI+Manual+for+the+Stait-Trait+Anxiety+Inventory+(self-evaluation+questionnaire).">STAI Manual for the Stait-Trait Anxiety Inventory (self-evaluation questionnaire).</a> Consulting Psychologist. 22, 1-24 (1970).</li><li>Vandenberg, S. G., Kuse, A. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Mental+rotations,+a+group+test+of+three-dimensional+spatial+visualization.">Mental rotations, a group test of three-dimensional spatial visualization.</a> Perceptual Motor Skills. 47 (2), 599-604 (1978).</li><li>H&#228;rtel, S., Gnam, J. P., L&#246;ffler, S., B&#246;s, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Estimation+of+energy+expenditure+using+accelerometers+and+activity-based+energy+models-Validation+of+a+new+device.">Estimation of energy expenditure using accelerometers and activity-based energy models-Validation of a new device.</a> European Review of Aging and Physical Activity. 8 (2), 109-114 (2011).</li><li>. RPY2: A Simple and Efficient Access to R from Python Available from: <a target="_blank" href="https://sourceforge.net/projects/rpy/">https://sourceforge.net/projects/rpy/</a> (2020)</li><li>Hoppenstedt, B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Applicability+of+immersive+analytics+in+mixed+reality:+Usability+study.">Applicability of immersive analytics in mixed reality: Usability study.</a> IEEE Access. 7, 71921-71932 (2019).</li><li>Hoppenstedt, B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Applicability+of+Immersive+Analytics+in+Mixed+Reality:+Usability+Study.">Applicability of Immersive Analytics in Mixed Reality: Usability Study.</a> IEEE Dataport. , (2019).</li></ol>

Regarding the developed mixed reality smartglasses (see Table of Materials) application, two aspects were particularly beneficial. The use of spatial sounds for the outlier&#8217;s detection task was positively perceived on one hand (see the results of RQ3). On the other, the use of voice commands was also perceived positively (see Figure 10).
Regarding the study participants, although the number of recruited participants was rather small for an e...

Virtual-reality solutions (VR solutions) are increasingly important in different fields. Often, with VR solutions (including Virtual Reality, Mixed Reality, and Augmented Reality), the accomplishment of many daily tasks and procedures shall be eased. For example, in the automotive domain, the configuration procedure of a car can be supported by the use of Virtual Reality1 (VR). Researchers and practitioners have investigated and developed a multitude of approaches and solutions in this context. However, studies that investigate usability aspects are still rare. In general, the aspects should be considered in the light of two major questions. First, it must be evaluated whether a VR solution actually outperforms an approach that does not make use of VR techniques. Second, as VR solutions are mainly relying on heavy and complex hardware devices, parameters like the wearing comfort and mental effort should be investigated more in-depth. In addition, the mentioned aspects should always be investigated with respect to the application field in question. Although many extant approaches see the needs to investigate these questions2, less studies exist that have presented results.
A research topic in the field of VR, which is currently important, is denoted with immersive analytics. It is derived from the research field of visual analytics, which tries to include the human perception into analytics tasks. This process is also well-known as visual data mining4. Immersive analytics includes topics from the fields of data visualization, visual analytics, virtual reality, computer graphics, and human-computer interaction5. Recent advantages in head-mounted displays (HMD) led to improved possibilities for exploring data in an immersive way. Along these trends, new challenges and research questions emerge, like the development of new interaction systems, the need to investigate user fatigue, or the development of sophisticated 3D visualizations6. In a previous publication6, important principles of immersive analytics are discussed. In the light of big data, methods like immersive analytics are more and more needed to enable a better analysis of complex data pools. Only a few studies exist that investigate usability aspects of immersive analytics solutions. Furthermore, the domain or field in question should also be considered in such studies. In this work, an immersive analytics prototype was developed, and based on that, a protocol, which investigates the developed solution for Industry 4.0 scenarios. The protocol thereby exploits the experience method2, which is based on subjective, performance, and physiological aspects. In the protocol at hand, the subjective aspects are measured through perceived stress of the study users. Performance, in turn, is measured through the required time and errors that are made to accomplish analysis tasks. Finally, a skin conductance sensor measured physiological parameters. The first two measures will be presented in this work, while the measured skin conductance requires further efforts to be evaluated.
The presented study involves several research fields, particularly including neuroscience aspects and information systems. Interestingly, considerations on neuroscience aspects of information systems have recently garnered attention of&#160;several research groups7,8, showing the demand to explore the use of IT systems also from a cognitive viewpoint. Another field that is relevant for this work constitutes the investigation of human factors of information systems9,10,11. In the field of human-computer interaction, instruments exist to investigate the usability of a solution. Note that the System Usability Scale is mainly used in this context12. Thinking Aloud Protocols13 are another widely used study technique to learn more about the use of information systems. Although many approaches exist to measure usability aspects of information systems, and some of them have been presented&#160;long ago14, still questions emerge that require to investigate new measures or study methods. Therefore, research in this field is very active12,15,16.
In the following, the reasons will be discussed why two prevalently used methods have not been considered in the current&#160;work. First, the System Usability Scale was not used. The scale is based on ten questions17 and its use can be found in several other VR studies18 as well. As this study mainly aims at the measurement of stress19, a stress-related questionnaire was more appropriate. Second, no Thinking Aloud Protocol20 was used. Although this protocol type has shown its usefulness in general13, it was not used here as the stress level of study users might increase only due to the fact that the think aloud session must be accomplished in parallel to the use of a heavy and complex VR device. Although these two techniques have not been used, results of other recent studies have been incorporated in the study at hand. For example, in previous works21,22, the authors distinguish between novices and experts in their studies. Based on the successful outcome of these studies, the&#160;protocol at hand utilizes this presented separation of study users. The stress measurement, in turn, is based on ideas of the following works15,19,21,22.
At first, for conducting the study, a suitable Industry 4.0 scenario must be found for accomplishing analytical&#160;tasks. Inspired by another work of the authors23, two scenarios (i.e., the analysis tasks) have been identified, (1) Detection of Outliers, and (2) Recognition of Clusters. Both scenarios are challenging, and are highly relevant in the context of the maintenance of high-throughput production machines. Based on this decision, six major considerations have driven the study protocol presented in this work:
<ol>
	<li>The solution developed for the study will be technically based on mixed reality smartglasses (see Table of Materials) and will be developed as a mixed reality application.</li>
	<li>A suitable test must be developed, which is able to distinguish novices from advanced users.</li>
	<li>Performance measures should&#160;consider&#160;time and errors.</li>
	<li>A desktop application must be developed, which can be compared to the immersive analytics solution.</li>
	<li>A measure&#160;must be applied to evaluate the perceived stress level.</li>
	<li>In addition to the latter point, features shall be developed to mitigate the stress level while a user accomplishes the procedure of the two mentioned analysis tasks&#160;(i.e., (1) Detection of Outliers, and (2) Recognition of Clusters).</li>
</ol>
Based on the six mentioned points, the study protocol incorporates the following procedure. Outlier Detection and Cluster Recognition Analysis tasks have to be accomplished in an immersive way using mixed reality smartglasses (see Table of Materials). Therefore, a new application was developed. Spatial sounds shall ease the performing of&#160;analysis tasks without increasing the mental effort. A voice feature shall ease the navigation used for&#160;the developed application of&#160;the mixed reality smartglasses (see Table of Materials). A mental rotation test shall be the basis to distinguish novices from advanced users. The stress level is measured based on a questionnaire. Performance, in turn, is evaluated based on the (1) time a user requires for the analysis tasks, and based on the (2) errors that were made by a user for the analysis tasks. The performance in mixed reality smartglass is compared with the accomplishment of the same tasks in a newly developed and comparable 2D desktop application. In addition, a skin conductance device is used to measure the skin conductance level as a possible indicator for stress. Results to this measurement are subject to further analysis and will not be discussed in this work. The authors revealed in another study with the same device that additional considerations are required24.
Based on this protocol, the following five research questions (RQs) are addressed:
RQ1: Do spatial imagination abilities of the participants affect the performance of tasks significantly? 
RQ2: Is there a significant change of task performance over time? 
RQ3: Is there a significant change of task performance when using spatial sounds in the immersive analytics solution? 
RQ4: Is the developed immersive analytics perceived stressful by the users? 
RQ5: Do users perform better when using an immersive analytics solution compared to an 2D approach?
Figure 1 summarizes the presented protocol with respect to two scales. It shows the developed and used measures and their novelty with respect to the level of interaction. As the interaction level constitutes an important aspect when developing features for a VR setting, Figure 1 shall better show the novelty of the entire protocol developed in this work. Although the evaluation of the aspects within the two used scales is subjective, their overall evaluation is based on the current related work and the following major considerations: One important principle constitutes the use of abstractions of an environment for a natural interaction, in which the user has become attuned to. With respect to the protocol at hand, the visualization of point clouds seems to be intuitive for users and the recognition of patterns in such clouds has been recognized as a manageable task in general. Another important principle constitutes to overlay affordances. Hereby, the use of spatial sounds as used in the protocol at hand is an example, as they correlate with the proximity of a searched object. The authors recommend to tune the representations in a way that most information is located in the intermediate zone, which is most important for human perception. The reason why the authors did not include this principle was to encourage the user to find the best spot by themselves as well as to try to orientate themselves in a data visualization space, which is too large to be shown at once. In the presented approach, no further considerations of the characteristics of the 3D data to be shown were made. For example, if a dimension is assumed to be temporal, scatterplots could have been shown. The authors consider this kind of visualization generally interesting in the context of Industry 4.0. However, it has to been focused on a reasonably small set of visualizations. Moreover, a previous publication already focused on the collaborative analysis of data. In this work, this research question was excluded due to complexity of the other addressed issues in this study. In the presented setup here, the user is able to explore the immersive space by walking around. Other approaches offer controllers to explore the virtual space. In this study, the focus is set on the usability by using the System Usability Scale (SUS). Another previous publication has conducted a study for economic experts, but with VR headsets. In general, and most importantly, this study complains about the limited field of view for other devices like the used mixed reality smartglasses in this work (see Table of Materials). Their findings show that beginners in the field of VR were able to use the analytic tool efficiently. This matches with the experiences of this study, although in this work beginners were not classified to have VR or gaming experiences. In contrast to most VR solutions, mixed reality is not fixed to a position as it allows to track the real environment. VR approaches such as mention the use of special chairs for a 360&#176; experience to free the user from his desktop. The authors of indicate that perception issues influence the performance of immersive analytics; for example, by using shadows. For the study at hand, this is not feasible, as the used mixed reality smartglasses (see table of materials) are not able to display shadows. A workaround could be a virtual floor, but such a setup was out of the scope of this study. A survey study in the field of immersive analytics identified 3D scatterplots as one of the most common representations of multi-dimensional data. Altogether, the aspects shown in Figure 1 cannot be found currently compiled to a protocol that investigates usability aspects of immersive analytics for Industry 4.0 scenarios.

<table>
	<tbody>
		<tr>
			<td>edaMove</td>
			<td>movisens</td>
			<td></td>
			<td></td>
		</tr>
		<tr>
			<td>HoloLens</td>
			<td>Microsoft</td>
			<td></td>
			<td></td>
		</tr>
		<tr>
			<td>Matlab R2017a</td>
			<td>MathWorks</td>
			<td></td>
			<td></td>
		</tr>
		<tr>
			<td>RPY2</td>
			<td>GNU General Public License v2 or later (GPLv2+) (GPLv2+)</td>
			<td></td>
			<td>https://pypi.org/project/rpy2/</td>
		</tr>
		<tr>
			<td>SPSS 25.0</td>
			<td>IBM</td>
			<td></td>
			<td></td>
		</tr>
	</tbody>
</table>

evaluating usability aspects of a mixed reality solution for immersive analytics in industry 4.0 scenarios

In medicine or industry, the analysis of high-dimensional data sets is increasingly required. However, available technical solutions are often complex to use. Therefore, new approaches like immersive analytics are welcome. Immersive analytics promise to experience high-dimensional data sets in a convenient manner for various user groups and data sets. Technically, virtual-reality devices are used to enable immersive analytics. In Industry 4.0, for example, scenarios like the identification of outliers or anomalies in high-dimensional data sets are pursued goals of immersive analytics. In this context, two important questions should be addressed for any developed technical solution on immersive analytics: First, is the technical solutions being helpful or not? Second, is the bodily experience of the technical solution positive or negative? The first question aims at the general feasibility of a technical solution, while the second one aims at the wearing comfort. Extant studies and protocols, which systematically address these questions are still rare. In this work, a study protocol is presented, which mainly investigates the usability for immersive analytics in Industry 4.0 scenarios. Specifically, the protocol is based on four pillars. First, it categorizes users based on previous experiences. Second, tasks are presented, which can be used to evaluate the feasibility of the technical solution. Third, measures are presented, which quantify the learning effect of a user. Fourth, a questionnaire&#160;evaluates the stress level when performing tasks. Based on these pillars, a technical setting was implemented that uses mixed reality smartglasses to apply the study protocol. The results of the conducted study show the applicability of the protocol on the one hand and the feasibility of immersive analytics in Industry 4.0 scenarios on the other. The presented protocol includes a discussion of discovered limitations.

Setting up Measures for the Experiment 
For the outlier detection task, the following performance measures were defined: time, path, and angle. See Figure 6 for the measurements.
Time was recorded until a red-marked point (i.e., the outlier) was found. This performance measure indicates how long a participant needed&#160;to find the red-marked point. Time is denoted as the variable &#34;time&#34; (in milliseconds) in the results.
<p class...

Watch this Scientific Journal Video about Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios at JoVE.com

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

This protocol delineates the technical setting of a developed mixed reality application that is used for immersive analytics. Based on this, measures are presented, which were used in a study to gain insights into usability aspects of the developed technical solution.

In medicine or industry, the analysis of high-dimensional data sets is increasingly required. However, available technical solutions are often complex to ...

Performing data analytics with smart glasses has enormous potential in the context of Industry 4.0, as the data can be analyzed directly at a machine site. Using smart glasses, the operator is able to analyze data, while keeping the hands free for maintenance work. Perform the experiment in a room equipped with a desktop computer and Mixed Reality Smart Glasses.Ask the participant to put on a skin conductance measurement device and have the participant rest for five minutes to acquire a baseline stress level measurement. Then, inform the participant that the experiment will take 40 to 50 minutes and ask the participant to fill out a State-Trait Anxiety Inventory questionnaire for measuring perceived stress during the experiment. To perform a mental rotation test, have the participant sit in front of the desktop computer and inform the participant that they will have to identify similar objects with different positions in a simulated 3D space.Inform the participant that only two of the five shown objects will be similar, and that they will have two minutes to complete seven tasks. To perform a spatial sound ability evaluation, explain to the participant that six sounds will also be played for 13 seconds per sound, and that the participant will have to detect the direction from which the sounds are made. To perform an outlier detection skill evaluation, have the participant put on the Mixed Reality Smart Glasses and explain that eight outliers must be found within the world created for the Mixed Reality Smart Glasses.Explain to the participant that an outlier is a red marked point within a group of white points that will turn green when they detect it by directing their gaze. Further explain that not only will visual help be provided, but that environmental sound cues will also be included to help locate the outliers. Then, inform the participant that the required time for each task, the length of walking, and their final moving position in relation to their starting position will be recorded.To perform a cluster recognition skill evaluation, explain to the participant that they will need to locate six clusters within the world created with the used Mixed Reality Smart Glasses, emphasizing that the participants will have to distinguish between overlapping clusters by navigating around the clusters using voice commands. When all six of the clusters have been located, have the participant sit at the computer without the smart glasses and explain that the same type of clusters must now be detected within the computer software. At the end of the desktop evaluation, ask the participant to fill out a new State-Trait Anxiety Inventory questionnaire, a self-developed questionnaire for gathering subjective feedback, and a demographic questionnaire.Remove participants'skin conductance measurement device and thank the participant for participation. In this representative analysis, low and high performers demonstrated no differences in their baseline variables, although the low performers had a higher percentage of female participants than high performers, and high performers were younger than low performers. For the cluster recognition task, low and high performers did not differ significantly between the 2D application and 3D approach.For the outlier detection task, high performers were significantly faster than low performers and required a shorter walking distance to solve the tasks. Indeed, the BoundingBox, Pathlength, PathVariance, PathMean, AngleVariance, and AngleMean values increased significantly from task to task. Although the recorded time showed little change from task to task using the Mixed Reality Smart Glasses.Based on the spatial sounds, the participants were able to solve the tasks in the outlier detection case quicker than without using spatial sounds. Notably, the State-Trait Anxiety Inventory scores did not demonstrate significant differences between the pre-and post-task assessments. In addition, small but significantly faster cluster recognition times were observed when participants used the Mixed Reality Smart Glasses compared to those observed when the participants used the desktop computer.As filtering for experts in this new domain is essential, we have included many pretests. Although we tested the methods in the neutral room, it would be interesting to see real machine instructors in the factory setting analyzing their data.

Research

JoVE Journal

Engineering

Mechanical Expansion of Steel Tubing as a Solution to Leaky Wellbores

Wellbore cement, a procedural component of wellbore completion operations, primarily provides zonal isolation and mechanical support of the metal pipe ...

Detection and Recovery of Palladium, Gold and Cobalt Metals from the Urban Mine Using Novel Sensors/Adsorbents Designated with Nanoscale Wagon-wheel-shaped Pores

Developing low-cost, efficient processes for recovering and recycling palladium, gold and cobalt metals from urban mine remains a significant challenge in ...

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

Galvanometer mirrors are used for optical applications such as target tracking, drawing, and scanning control because of their high speed and accuracy. ...

Three-electrode Coin Cell Preparation and Electrodeposition Analytics for Lithium-ion Batteries

As lithium-ion batteries find use in high energy and power applications, such as in electric and hybrid-electric vehicles, monitoring the degradation and ...

Application of Design Aspects in Uniaxial Loading Machine Development

In terms of accurate and precise mechanical testing, machines run the continuum. Whereas commercial platforms offer excellent accuracy, they can be ...

3D Printing - Evaluating Particle Emissions of a 3D Printing Pen

Three-dimensional (3D) printing as a type of additive manufacturing shows continuing increase in application and consumer popularity. The fused filament ...

Solution Blow Spinning of Polymeric Nano-Composite Fibers for Personal Protective Equipment

Light-weight, protective armor systems typically consist of high modulus (&#62;109 MPa) and high-strength polymeric fibers held in place with an elastic ...

Evaluating the Electrochemical Properties of Supercapacitors using the Three-Electrode System

The three-electrode system is a basic and general analytical platform for investigating the electrochemical performance and characteristics of energy ...

The Immersive Cleveland Clinic Virtual Reality Shopping Platform for the Assessment of Instrumental Activities of Daily Living

A decline in the performance of instrumental activities of daily living (IADLs) has been proposed as a prodromal marker of neurological disease. Existing ...