Sign In

A subscription to JoVE is required to view this content. Sign in or start your free trial.

In This Article

  • Summary
  • Abstract
  • Introduction
  • Protocol
  • Representative Results
  • Discussion
  • Acknowledgements
  • Materials
  • References
  • Reprints and Permissions

Summary

This study presents an experimental paradigm for a usability test combining subjective and objective evaluations. The objective evaluation adopted Neuro-Information-Systems (NeuroIS) methods, and the subjective evaluation adopted a usability questionnaire and a NASA-Task Load Index (NASA-TLX) scale.

Abstract

This study introduces an experimental paradigm for a usability test of emerging technologies in a management information system (MIS). The usability test included both subjective and objective evaluations. For the subjective evaluation, a usability questionnaire and a NASA-TLX scale were adopted. For the objective evaluation, methods of Neuro-Information-Systems (NeuroIS) were used. From a NeuroIS perspective, this study used mobile fNIRS and eye tracking glasses for multimodal measurements, which solved the problem of ecological validity of cognitive neuroscience tools used in real-world behavior experiments. This study used Augmented Reality (AR) integrated into the Internet of Things (IoT) as an experimental object. Comparing the differences in the neuroimaging data, the physiological data, the usability questionnaire, and the NASA-TLX scale data between the two information-search modes (AR versus a website), information search with AR had a higher efficiency and a lower cognitive load compared with information search with a website during the process of consumption decision-making. The usability experiment results demonstrate that AR, as an emerging technology in retail, can effectively enhance consumer experiences and increase their purchase intention. The experimental paradigm, combining both subjective and objective evaluations in this study, could be applied to a usability test for emerging technologies, such as augmented reality, virtual reality, artificial intelligence, wearable technology, robotics, and big data. It provides a practical experimental solution for the user experience in human-computer-interactions with the adoption of emerging technologies.

Introduction

Six frontier technologies that interact with consumers, typically represented by augmented reality, virtual reality, artificial intelligence, wearable technology, robotics, and big data, are reshaping many theoretical models of consumer behavior1. Augmented Reality (AR) is a new technology that could enhance consumer experience and improve consumer satisfaction. It superimposes textual information, images, videos, and other virtual items onto real scenarios to fuse virtuality and reality, thus enhancing information in the real world through explanation, guidance, evaluation, and prediction2. AR provides a new kind of hum....

Protocol

This study was conducted in accordance with the principles of the Helsinki Declaration. All participants were informed of the purpose and safety of the experiment and signed the informed consent form before participation. This study was approved by the institutional review board of Jiangsu University of Science and Technology.

1. Experiment procedure

  1. Preparation for the experiment
    1. Explain informed consent to the participants and ask them to sign the con.......

Representative Results

The representative results of this study include the usability questionnaire results, eye tracking data analysis, NASA-TLX scale data, fNIRS data analysis, and dynamic cognitive load changes. For the usability questionnaire results, eye tracking data analysis, NASA-TLX scale data and fNIRS data analysis, normality tests, and differences tests were conducted. For dynamic cognitive load changes, this study selected fNIRS and eye tracking data from a single participant to demonstrate the validity of the multimodal measureme.......

Discussion

Critical steps within the protocol
During the experiment, several steps were considered to ensure reliability of the results. First, participants who are familiar with the brands of mineral water used in the experiment were excluded, because these participants would have performed the task based on their knowledge of the brand. Second, the participants completed a pre-experiment using other brands of mineral water, which was employed to ensure that the participants were familiar with AR and website.......

Acknowledgements

This study was supported by the Philosophy and Social Science Research Project of Jiangsu Provincial Department of Education (2018SJA1089), Jiangsu Government Scholarship for Overseas Studies (JS-2018-262), the Natural Science Foundation of Zhejiang Province (LY19G020018) and the National Natural Science Foundation of China (NSFC) (72001096).

....

Materials

NameCompanyCatalog NumberComments
AR EngineUnity Technologies2020.3.1AR development platform
AR SDKPTCVuforia Engine 9.8.5AR development kit
Eye Tracker (eye tracking glasses)SMI, GermanySMI ETGHead-mounted eye tracking
system
Eye Tracker Recording softwareSMI, GermanyiViewETG SoftwareEye Tracker Recording software
fNIRS probesArtinis Medical Systems BV, NetherlandsArtinis PortaLiteLight source: Light emitting diodes
Wavelengths: Standard nominal 760 and 850 nm
fNIRS softwareArtinis Medical Systems BV, NetherlandsOxySoft 3.2.70fNIRS data recording and analysis software
Mineral WaterGroupe DanoneBadoit Experimental material in the AR condition   Capacity: 330ml
Price: figure-materials-12346
Mineral WaterNestléAcqua PannaExperimental material in the website condition Capacity: 250ml
Price: figure-materials-15065.4
Skin Preparation GelWeaver and CompanyNuprepClean the forehead skin of the participants
SmartphoneXiaomiRedmi K30 UltraSmartphone-based AR application and website

References

  1. Ameen, N., Hosany, S., Tarhini, A. Consumer interaction with cutting-edge technologies: Implications for future research. Computers in Human Behavior. 120, 106761 (2021).
  2. Javornik, A.

Explore More Articles

Usability EvaluationAugmented RealityNeuro information systemsMobile FNIRSEye TrackingMultimodal MeasurementsEcological ValidityExperimental ProcedureColor Vision TestMineral Water BrandsPre experimentSkin PreparationEye Tracking GlassesExperimental DesignFNIRS Data Collection

This article has been published

Video Coming Soon

JoVE Logo

Privacy

Terms of Use

Policies

Research

Education

ABOUT JoVE

Copyright © 2024 MyJoVE Corporation. All rights reserved