Name: an application for pairing with wearable devices to monitor personal health status
Uploaded: 2022-02-03T13:00:00
Description: Watch this Scientific Journal Video about An Application for Pairing with Wearable Devices to Monitor Personal Health Status at JoVE.com

The Council of Agriculture of Taiwan funded the research project and the HealthCloud app development from 2018 to 2020 [109 agricultural science - 7.5.4-supplementary-#1(1)] ([109 <img alt="Equation 4" src="/files/ftp_upload/63169/63169eq04.jpg" />-7.5.4-<img alt="Equation 5" src="/files/ftp_upload/63169/63169eq05.jpg" />-#1(1)]).

The whole protocol follows the National Taiwan University Research Ethics Committee Office&#39;s instructions for conducting human-related experiments. During participant recruitment, candidates were informed of their instructions and rights and the experiment&#39;s risks in both speech and writing, and the signed consent forms were collected. The app can be installed on smartphones and smartwatches (see Table of Materials).
1. Preparation of the psychological and physio...

Purposes of the study and significant findings 
Wearable devices, such as smartphones and smartwatches, have been widely used to investigate physiological indicators or syndromes32,33,34, psychological states22,35; environmental information, or behaviors18,36. Most applications of smart devi...

Real-time data collection 
In daily life, people benefit from the physical environment in many ways. For example, positive outcomes, such as psychological1 and heart rate restoration2 have been widely found. In addition, the relationships between ambient factors, such as temperature and humidity, and mental health have been discussed3,4. Studies have also explored the links between physiological and psychological responses, such as heart rate and stress5,6,7,8. A wide range of evidence for psychological and physiological benefits from exposure to nature has been found in well-controlled laboratory studies9,10, which may not have represented the diverse influential factors in the field. Therefore, to measure the relationships among real-time human responses, on-site studies are considered better to reflect the real-life scenario experience and reactions to the environments than laboratory simulations11. Moreover, human reactions to environments may depend on context12. Given the importance of understanding the relationship between people&#39;s psychological and physiological health and environmental quality, a real-time self-tracking measurement that can collect various information measures is urgently needed.
Ecological momentary assessments (EMAs) or experience sampling methods (ESMs) may represent solutions for on-site studies13,14. EMAs and ESMs aim to assess humans&#39; momentary responses on-site in real-life scenarios15. By adopting self-tracking techniques, the responses, reactions, and on-site experiences can be measured freshly14. Participants are notified via signals, such as texts or notifications, to implement assessments in so-called signal-contingent sampling schemes15. The term &#34;EMA&#34; is primarily used in health-related studies13, while &#34;ESM&#34; tends to be used in leisure and outdoor recreation studies16. Nonetheless, the terms have occasionally been used interchangeably12.
The possibility of applying EMAs to environmental research studies was discussed by Beute et al.12, who pointed out that they would allow a greater variety of environments to be addressed than merely &#34;natural&#34; or &#34;urban.&#34; For example, by adopting ambulatory measurement (such as through GPS location tracking), physiological responses during a walk can be matched with real-time location datasets, providing a richer spatial resolution of environment types and environmental characteristics7. Additionally, the real-time data collection allowed by EMAs ensures a high ecological validity, providing a complementary point of view from laboratory studies.
More and more on-site empirical studies have adopted wearable devices and smartphones to monitor personal health status in daily life and research purposes17,18,19,20. Adopting both of these devices may provide more advantages than using only a smartphone12. First, the access time using smartwatches was shorter than that using phones21, which may cause a reduced interruption burden. Second, watches provide a greater body closeness than smartphones22, and phones can be used as momentary databases to save and upload data. Third, smartwatches nowadays offer multiple sensors to different parameters, such as heart rate variability, electrocardiograms (ECG), and blood pressure23,24,25,26,27. The individual and the overall aspects of human responses can infer certain activities12. Finally, smartphones are usually carried in the pocket for smartphone-based studies, and when it comes to the questionnaires, extra work must be done compared to the case using smartwatches.
However, few studies have explored the relationships between psychological and physiological outcomes and environmental information. Therefore, this study showcases adopting a non-commercial self-developed app, the HealthCloud, on wearable devices, such as smartwatches, and smartphones, to collect real-time psychological, physiological, and environmental information.
The self-developed app and wearable devices 
The app for use on wearable devices was developed by the Healthy Landscape and Healthy People Lab, National Taiwan University (HLHP-NTU), to provide more accessible and more flexible ways to track human responses and environmental data, allowing researchers to analyze further the relationships among human health and environmental information (Figure 1).
The app, based on iOS, provides multiple tasks and passive data-collection functions. The app collects self-reported data on the smartwatch, such as psychological-scale items measured through Pop Quiz questions on which users can rate their responses from one to five stars for quick and easy assessment. This type of question intervention may be considered a type of Micro interaction-EMA (&#181;EMA)-an in situ data collection method requiring less attention and having a greater response rate than smartwatch-EMA28. Sensor-monitored physiological response data, including heart rate, heart rate variability, and blood oxygen saturation level, can be measured using the functions of the iOS. Heart rate is measured through the smartwatch&#39;s optical heart sensor using a technique called photoplethysmography29. The app detects the amount of blood flow using green LED lights with light-sensitive photodiodes, and the heartbeats per minute are also calculated. The heart rate variability (HRV) and blood oxygen concentration (SpO2) can be detected using apps. For the smartphone, the tasks, such as the Stroop Test (Figure 2B), and Image Capture task (Figure 2C), and the Environment Sound task (Figure 2D), the ambient conditions data, including relative humidity, weather, and altitude, are passively collected from several Application Programming Interfaces.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/63169/63169fig01.jpg" /> 
Figure 1: Overview of the app. The functions of the app on the smartwatch, smartphone, and database. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/63169/63169fig02.jpg" /> 
Figure 2: The app tasks. Examples of the tasks that can be used on the app: from left to right, there is (A) The Pop-up question. (B) The Stroop Test. (C) The Image Capture task. (D) The Environment Sound task. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
All data will be uploaded to the backend website (access to cooperative researchers, see Table of Materials). The website provides several primary functions: a map display that shows users&#39; current locations and heart rate (Figure 3), a datasheet for browsing and extracting data (Figure 4), and task configurations for modifying the frequency, priority, and content of the tasks (Figure 5). With such great flexibility and a wide range of measurements, researchers can easily select the previously stated task functions according to the research objectives. In addition, the app can benefit both users and researchers. The app provides their health reports and GPS location trajectories (Figure 6) according to the questions they have answered and their chosen routes. Thus, they can obtain a quick idea of their health status on the day and keep on tracking their health data.
<img alt="Figure 3" class="xfigimg" src="/files/ftp_upload/63169/63169fig03.jpg" /> 
Figure 3: The map displayed on the app database. The map display of the app database provides current information, including locations and heart rate, to the researchers. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig03large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 4" class="xfigimg" src="/files/ftp_upload/63169/63169fig04.jpg" /> 
Figure 4: Datasheet on the app database. The data report of the display map in the app database, in which data can be exported by filtering the Time, Field, or Tester ID. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig04large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 5" class="xfigimg" src="/files/ftp_upload/63169/63169fig05.jpg" /> 
Figure 5: The task configuration on the app database. The task priorities, time intervals, language, and content of the questionnaires can be modified. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig05large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Figure 6" class="xfigimg" src="/files/ftp_upload/63169/63169fig06.jpg" /> 
Figure 6: The health report for the app users. After using the app, the user can receive a set of individual results generated automatically. <a href="https://www.jove.com/files/ftp_upload/63169/63169fig06large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
Representative study 
To showcase the integration of diverse dimensions of data collection using the app on smartphones and smartwatches, an in situ study was conducted in 2020 at the National Taiwan University campus in Taipei City, Taiwan. Participants for the study were recruited on the social media fan page of National Taiwan University through an online form 1 week before the experiment. The form included the research purpose, process, location, participation conditions, a schematic diagram of the research device to be worn, and a space for readers to indicate their willingness to participate and the time at which they could do so. After completion, participants were notified of their experiment&#39;s exact time and location by email 2 days before the schedule. Since the research examines psychological changes, physiology, physical activity (walking), and sound and color perception, participants met the following conditions: (1) between 20-36 years old, (2) good physical and mental health, (3) not be in regular use of drugs affecting the central nervous system, (4) not be pregnant or breastfeeding, (5) have no history of cardiovascular disease, (6) can walk for more than 30 min on foot, (7) be able to identify a color.
On the day of the experiment, participants were provided with one set of smartphones and smartwatches, and a route map. Researchers presented a uniform explanation to the participants of the purpose of the research, the research process, the wearable devices, and the matters needing attention in the research process. During the walk, psychological responses were assessed using a Pop Quiz task every 5 min, and physiological responses, such as heart rate, were measured every minute by sensors in the smartwatch. After the experiment, participants were compensated with a 200 NTD equivalent gift card (~7 USD).
For the psychological measurement, this study considered landscape preferences and two aspects of the Perceived Restorative Scale Short Version30, namely, &#34;being away&#34; and &#34;fascination.&#34; These aspects were measured by asking participants to rate the statements &#34;This is a place which is away from everyday demands and where I would be able to relax and think about what interests me.&#34; and &#34;That place is fascinating; it is large enough for me to discover and be curious about things.&#34; on a five-point Likert scale from (1) &#34;strongly disagree&#34; to (5) &#34;strongly agree&#34; to measure individual perceptions of the restorative factors of the environment based on attention restoration theory31. Landscape preference was assessed using a five-point Likert scale with the single question: &#34;How much do you like the setting, for whatever reason?&#34; from (1) &#34;very little&#34; to (5) &#34;very much.&#34; The questionnaire was sent using the &#34;Pop Quiz&#34; task with a 5 min time interval, meaning participants received the questionnaire every 5 min.
For physiological measurement, heart rate (HR) while walking was used to represent the participants&#39; physiological outcomes with a 1 min time interval. Environmental information, including GPS data (latitude and longitude), temperature, relative humidity, wind speed, and wind degree, were collected through the smartphone.

<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>Apple Watch 6</td>
			<td>Apple</td>
			<td></td>
			<td>For the use of the HealthCloud app, such as Pop-up questions, heart rates measurement.</td>
		</tr>
		<tr>
			<td>iPhone</td>
			<td>Apple</td>
			<td></td>
			<td>For the use of the HealthCloud app, such as GPS location collection, weather data colledction, data storage, data transfer.</td>
		</tr>
		<tr>
			<td>HealthCloud</td>
			<td>Self-developed</td>
			<td></td>
			<td>The HealthCloud app, adopting Apple Watch and iPhone, was developed by Healthy Landscape and Healthy People Lab, National Taiwan University (HLHP-NTU) to track human responses. It adopted several APIs such as HealthKit, ResearchKit, Weather API and AppleWatch applications including Breathe app, and Blood Oxygen app to collect physiological status and psychological states, and environmental data in aims of further analyzing the relationships between human health and the environmental information. 
			 
			The link to the app in APP Store is as following: https://apps.apple.com/tw/app/healthcloud/id1446179518?l=en</td>
		</tr>
		<tr>
			<td>backend website</td>
			<td></td>
			<td></td>
			<td>The backend website of HealthCloud app for the use of the configuration of the tasks, data exportation, and the display of users. 
			http://healthcloud.hort.ntu.edu.tw/</td>
		</tr>
		<tr>
			<td>HealthKit</td>
			<td>Apple</td>
			<td></td>
			<td>For the use of retrieving the data of physiological responses such as heart rate, heart rate variability, and blood oxygen saturation level. 
			The link to the HealthKit: 
			https://developer.apple.com/documentation/healthkit</td>
		</tr>
		<tr>
			<td>ResearchKit</td>
			<td>Apple</td>
			<td></td>
			<td>This kit includes a variety of tasks for the use of research purposes. The functions adopted in HealthCloud app include Image Capture task, environment sound task, Stroop Test, to the Pop Questions of psychological state measurements such as perceived restorativeness scale, landscape preferences. 
			The link to the ResearchKit: 
			https://www.researchandcare.org/</td>
		</tr>
		<tr>
			<td>Weather API</td>
			<td>OpenWeather</td>
			<td></td>
			<td>For the use of collecting the real-time environmental data, including humidity, weather, global positioning system location, altitudes, etc., from the nearest weather station. 
			The link to the Weather API: 
			https://openweathermap.org/api</td>
		</tr>
		<tr>
			<td>Breathe app</td>
			<td>Apple</td>
			<td></td>
			<td>For the use of assessing the real-time heart rate variability (HRV). This app was not included in the procedures of this pilot study. However, the HealthlCloud is now capable of retrieving the HRV data collected from Breathe app. 
			The link to the Breathe app: 
			https://apps.apple.com/us/app/breathe/id1459455352</td>
		</tr>
		<tr>
			<td>Blood Oxygen app</td>
			<td>Apple</td>
			<td></td>
			<td>For the use of assessing the real-time Blood Oxygen Concentration level (SpO2). The latest version of HealthlCloud is capable of retrieving the SpO2 data collected from&#160; app. This app was not included in the procedures of this pilot study. However, 
			The measurement of Blood Oxygen app: 
			https://support.apple.com/en-us/HT211027 
			The link to the Blood Oxygen app: 
			https://apps.apple.com/us/app/breathe/id1459455352&#34;</td>
		</tr>
		<tr>
			<td>IBM SPSS Statistics 25</td>
			<td>IBM</td>
			<td></td>
			<td>For the use of statistical analysis. 
			The link to the Blood Oxygen app: 
			https://www.ibm.com/support/pages/downloading-ibm-spss-statistics-25</td>
		</tr>
	</tbody>
</table>

an application for pairing with wearable devices to monitor personal health status

The current protocol aims to showcase the technology integration, providing a detailed description of adopting the HealthCloud app, developed by the Healthy Landscape and Healthy People Lab, National Taiwan University (HLHP-NTU), on smartphones and smartwatches to collect data on users' real-time psychological and physiological responses and environmental information. A flexible and integrated research method was proposed because it can be difficult to measure multi-dimensional aspects of personal data in on-site studies in landscape and outdoor recreation research. An on-site study conducted in 2020 at the National Taiwan University campus was used as an application example. A dataset of 385 participants was used after excluding invalid samples. During the experiment, participants were asked to walk around campus for 30 min when their heart rate and psychological-scale items were measured, together with several environmental metrics. This work aimed to provide a possible solution to help on-site studies track real-time human responses that match ambient factors. Due to the app's flexibility, its use on wearable devices shows excellent potential for multidisciplinary research studies.

The original sample consisted of 423 individuals, of which 18 had to be excluded because of poor data quality due to instability of the beta version of the app and another 20 failed to complete all Pop Quiz questions. This led to an effective sample rate of 0.91. A dataset of 385 students (213 females, 172 males) from National Taiwan University were recruited. Participants were between 20-36 years old (M = 23.38, SD = 2.268). Regarding their psychological states, 514 ratings of preference (PREF, M =...

Watch this Scientific Journal Video about An Application for Pairing with Wearable Devices to Monitor Personal Health Status at JoVE.com

An Application for Pairing with Wearable Devices to Monitor Personal Health Status

The present protocol introduces a non-commercial self-developed application for collecting real-time on-site data, including psychological scales, GPS location, heart rate, and blood-oxygen saturation level, as well as the application's operating procedures. An empirical study conducted in Taiwan in 2020 was used as an application example.

The current protocol aims to showcase the technology integration, providing a detailed description of adopting the HealthCloud app, developed by the ...

This protocol facilitates the integration of a self-developed application and wearable devices to measure multiple dimensional states, including psychological, physiological, and environmental data. This is a proven technology to assess how landscape impacts human health and wellbeing. Flexible tasks and functions are provided in the smartphone and smartwatch application to measure different types of human states and reactions.Now, thousands of people can be engaged in research, placing very little burden on them while producing a rich trove of data for landscape and urban-planning scholars. This method can be adopted in outdoor recreation and human health research. It can also be used in other fields that investigate relationships between human health and the environment, showing the flexibility of the application.Users may struggle due to being unfamiliar with the app and devices. This can be solved by going through the protocol presented in this article. This protocol requires using several tools including webpages, smartphones, and smartwatches.Therefore, visual demonstrations can help users and researchers get started quickly. To begin, log into the HealthCloud app backend website. Go to Admin management in the app database and add a new field name at the Set Field to mark the data collected during the experiment.Then go to Configuration and click on the Select file button to upload the questionnaires. Set the time interval by choosing the number of minutes in the period of pop quiz. Download the HealthCloud app from the app store.Ensure the tools are ready for use. Have good battery life, GPS functionality, and a stable internet connection on the site. Then log into the app on the phone by creating an account.Ensure all realtime information, including heart rate, location, elevation, weather, the distance that the user has moved since starting, and duration since the app started are successfully collected on the app's main page on the smartphone. Press Set Measurements on the Settings page. Then select the Field Name and identify the participants according to their test number.Before the walk, give the participants the following instructions. Verbally instruct the participants on how to use both the smartwatch and smartphone for proper assessment. Ask them to press start on the smartwatch to collect physiological and environmental information.Once the tasks are received, the participants must follow the instructions on the smartwatch. For the pop quiz task, ask the participants to rate the statements using one to five stars to answer the psychological scale items and press send to complete this step. Next, the participants will receive a photo taking task on their smartwatch.Instruct the participants to open the HealthCloud app on the phone and follow the instructions for the photo-taking task. The participants will also receive a Stroop Test followed by a voice task on their smartwatch. Ask the participants to follow the instructions on the phone to complete the Stroop Test and then the voice task.For the HRV task, instruct the participants to open the breath app and click on start. The HRV data will be uploaded. Finally, for the SPO2 task, ask the participants to open the Blood Oxygen app on the smartwatch and click on Start.The result will be uploaded. After the walk, collect the devices from the participants and hit Quit Calculate to end the experiment. Then log into the backend website.Extract the research data from the data sheet by filtering the time, field, and tester ID.Press Export CSV to download the dataset and perform descriptive statistical analysis using statistical software. A dataset of 385 students from National Taiwan University were recruited for this study. The participants were between the ages of 20 and 36.Regarding their psychological states, 514 ratings of preference, 548 ratings of being away, and 523 ratings of fascination were collected. For the physiological responses, that is, heart rate, 14, 253 data points were collected. The following environmental information was collected, 14, 253 data points related to GPS latitude and longitude, 14, 253 related to temperature, 14, 253 related to relative humidity, 14, 253 related to wind speed, and 12, 232 related to wind degree.With these data, variables from different dimensions can be statistically analyzed to verify the relationships among them. Consider whether the activities intended to be included are suitable in the experiment since their intensity may affect the accuracy of the measurement. It is recommended that the researchers follow the protocol instructions to guide the participants in the experiment and to reduce the novelty effect of the devices and the application.This method can be used to generate and collect additional information. For example, photographs, sound decibels, or GPS location can be used to analyze the quality of the physical environment. The main purpose of this method is to provide an efficient way to measure real-time psychological responses, physiological responses, and ambient environmental information.Only a few previous studies have managed to provide frequent sectional data points. Therefore, the relationships among the dimensions can be discussed in greater detail.

Research

JoVE Journal

Environment

The Use of an Automated System (GreenFeed) to Monitor Enteric Methane and Carbon Dioxide Emissions from Ruminant Animals

The Use of an Automated System GreenFeed to Monitor Enteric Methane and Carbon Dioxide Emissions from Ruminant Animals

Ruminant animals (domesticated or wild) emit methane (CH4) through enteric fermentation in their digestive tract and from decomposition of manure during ...

Spotting Cheetahs: Identifying Individuals by Their Footprints

The cheetah (Acinonyx jubatus) is Africa's most endangered large felid and listed as Vulnerable with a declining population trend by the IUCN1. It ranges ...

Empirical, Metagenomic, and Computational Techniques Illuminate the Mechanisms by which Fungicides Compromise Bee Health

Growers often use fungicide sprays during bloom to protect crops against disease, which exposes bees to fungicide residues. Although considered ...

Methods of Soil Resampling to Monitor Changes in the Chemical Concentrations of Forest Soils

Recent soils research has shown that important chemical soil characteristics can change in less than a decade, often the result of broad environmental ...

Experimental Protocol for Detecting Cyanobacteria in Liquid and Solid Samples with an Antibody Microarray Chip

Experimental Protocol for Detecting Cyanobacteria in Liquid and Solid Samples with an Antibody Microarray Chip

Global warming and eutrophication make some aquatic ecosystems behave as true bioreactors that trigger rapid and massive cyanobacterial growth; this has ...

Microfluidic Devices for Characterizing Pore-scale Event Processes in Porous Media for Oil Recovery Applications

Microfluidic devices are versatile tools for studying transport processes at a microscopic scale. A demand exists for microfluidic devices that are ...

The Calibration and Use of Capacitance Sensors to Monitor Stem Water Content in Trees

Water transport and storage through the soil-plant-atmosphere continuum is critical to the terrestrial water cycle, and has become a major research focus ...

A Strain Gauge Monitor (SGM) for Continuous Valve Gape Measurements in Bivalve Molluscs in Response to Laboratory Induced Diel-cycling Hypoxia and pH

A Strain Gauge Monitor SGM for Continuous Valve Gape Measurements in Bivalve Molluscs in Response to Laboratory Induced Diel-cycling Hypoxia and pH

An inexpensive, laboratory-based, strain gauge valve gape monitor (SGM) was developed to monitor the valve gape behavior of bivalve molluscs in response ...

The Plant Infection Test: Spray and Wound-Mediated Inoculation with the Plant Pathogen Magnaporthe Grisea

The Plant Infection Test: Spray and Wound-Mediated Inoculation with the Plant Pathogen Magnaporthe Grisea

Plants possess a powerful system to defend themselves against potential threats by pathogenic fungi. For agriculturally important plants, however, current ...

A Video Surveillance System to Monitor Breeding Colonies of Common Terns (Sterna Hirundo)

A Video Surveillance System to Monitor Breeding Colonies of Common Terns Sterna Hirundo

Many waterbird populations have faced declines over the last century, including the common tern (Sterna hirundo), a waterbird species with a widespread ...