Quantified Assessment of Infant's Gross Motor Abilities Using a Multisensor Wearable

Summary

This paper outlines the assessment of infants' gross motor performance with a multisensor wearable and its fully automated deep learning-based analysis pipeline. The method quantifies the posture and movement patterns of infants from lying supine until they master walking independently.

Abstract

Developing objective and quantitative methods of early gross motor assessment is essential to better understand neurodevelopment and to support early therapeutic interventions. Here, we present a method to quantify gross motor performance using a multisensor wearable, MAIJU (Motility Assessment of Infants with a JUmpsuit), which offers an automated, scalable, quantitative, and objective assessment using a fully automated cloud-based pipeline. This wearable suit is equipped with four movement sensors that record synchronized data to a mobile phone utilizing a low-energy Bluetooth connection. An offline analysis in the cloud server generates fully analyzed results within minutes for each recording. These results include a graphical report of the recording session and a detailed result matrix that gives second-by-second classifications for posture, movement, infant carrying, and free playtime. Our recent results show the virtue of such quantified motor assessment providing a potentially effective method for distinguishing variations in the infant's gross motor development.

Introduction

Early gross motor development is essential for higher-level neurocognitive performance that emerges later by supporting infants' exploration of the environment. Therefore, clinicians and researchers alike have a high interest in assessing early gross motor development^1,2,3. To provide support for evidence-based medicine or scientific studies, it is essential that the gross motor assessments are quantitative, reliable, objective, and ecologically valid. However, there is a scarcity of such methods available for either clinical or basic science research.

A typical early gross motor development progresses through a predictable sequence of newly acquired skills. They are commonly observed in infants as reaching discrete motor milestones⁴, where standing and walking are often considered significant landmarks en route to more complex behavioral repertoire⁵. In addition to direct observation or parental surveys about motor milestones, several widely used standardized batteries have been developed^6,7,8,9 for performing infants' assessments in the laboratory or hospital environment. However, these assessments suffer from multiple caveats: they need substantial expertise from trained professionals, they are partly subjective and categorical, and they assess infants' performance in an environment (hospital or laboratory) that is unnatural from an infant's perspective.

Recording infants' spontaneous motor activity over longer times in the native environment, such as their home, enables more relevant measures of motor abilities. In one such feasible method, the assessment is performed for the full sequence of the infant's motor ability development from lying supine to walking fluently with a wearable system, such as the MAIJU wearable (Motor Assessment of the Infants with a JUmpsuit)^10,11,12. The MAIJU wearable system (Figure 1) involves a whole-body textile garment equipped with movement sensors to allow unsupervised out-of-hospital/laboratory assessments and recordings that are analyzed with an automated pipeline, providing a second-by-second assessment of posture and movement patterns. These algorithmic detections can be used for each posture and movement type separately, or they can be combined for a holistic assessment of the maturational level of the infant's motor abilities. A recently published, unit-free expression of such metric of motor maturity is BIMS (Baba Infant Motor Score)^10,12.

This article will describe the assessment of infants' gross motor performance using a multisensor wearable suit; the rationale, practical performance, analysis pipeline, and potential future perspectives for using the metrics that can be obtained from the automated analysis pipeline available for recordings with a multisensor wearable^10,11,12. The method is suitable for a detailed quantitation of spontaneous gross motor activities in all infants that exhibit motor abilities between supine lying and fluent walking.

The multisensor wearable system consists of three components: 1) the full body overall garment equipped with four movement sensors, 2) a mobile device using a custom-built iOS application, and 3) a cloud-based analysis pipeline (Babacloud the credentials for which can be obtained from the authors)¹¹. The waterproof inertial measurement unit (IMU) sensors stream synchronized data (3-axis accelerometer and gyroscope) at 13-52 Hz sampling frequency to a mobile phone using a low-energy Bluetooth connection. The data is initially stored in the memory of (the sensor or) the mobile device, followed by an offline analysis in the cloud server after the recording is stopped.

Protocol

The studies carried out with this system were reviewed by the Ethics committee of the New Children's Hospital, Helsinki University Hospital, and the hospital gave permission to carry out the research projects described in the original studies cited in this work. An informed consent was obtained to film the child in the video.

1. Preparing the suit for a recording session

1. Select the correct suit size. Currently, the sizes run up from size 68 cm, and there are five distinct size options (68 cm, 74 cm, 80 cm, 86 cm, and 92 cm). Ensure that the suit fits snugly yet comfortably and the child can move freely without interference.
2. Start the recording, i.e., data collection using the data logger application, Maijulogger, as described in Supplemental file 1.
   1. On the first page, enter the "Subject identification number". The number of movement sensors used in the assessment is set to 4 as a default, as shown on the first page.
   2. Proceed to the next stage by pressing the forward arrow.
3. Equip four sensors with batteries (version CR2025).
4. Pair each sensor with the mobile application by selecting and pressing a limb location on the application and bringing the sensor close to the mobile device.
   1. Confirm that the correct sensor number is shown on the application.
   2. Ensure sufficient battery charge level (recommended > 80%) by checking the indicators below the sensor number.
      NOTE: Replace the sensor batteries, if needed, by lifting the backside cover.
5. Fix each sensor with the snap-on mounts in the correct sleeve pocket.
   1. Ensure that the sensors are correctly oriented.
   2. Always check the latest user guide for details. Incorrect orientation will lead to unusable data.
6. Proceed to check the correct sensor pairing by pressing the forward arrow in the application.
   1. Shake the sensors one by one and check the application to see that the correct indicator is wiggling.
7. When the checks are complete, proceed to the Start page by pressing the forward arrow.
   NOTE: If needed, the duration of the recording (hh:mm) can be set manually by pressing the Settings button at the start of each recording.
   1. Press the Record button to start the recording. Wait until the sensors are ready before dressing the suit on the infant (this may take a few min).
8. For unsupervised home recordings, set the screen lock to the mobile device to avoid its parental operation and pack the suit for delivery to the recipient.
   1. Use a courier or a similar service to deliver the suit to the recipient immediately after it has been prepared.

2. Preparing and dressing the infant for a recording session

1. Ensure that the infant is nursed (i.e., fed and diapers changed) and feels secure and comfortable for a natural and spontaneous playtime.
   1. Remove the suit later for a diaper change, if needed.
2. Dress the suit on the infant as done with regular overalls.
   1. Check that the sensor pockets are facing outwards (i.e., away from the body midline instead of rotating towards the front or back of the infant).
3. Check that the suit fits snugly on the limbs at each sensor location.
   1. Adjust the straps near the pockets to tighten the sensor on the limb, if needed.
      NOTE: It is also possible to add clothes underneath the suit or bandages to fasten the sensors in case the limbs are too thin for sufficient fastening with the straps.

3. Recording session

1. Keep the mobile device near the infant to ensure a reliable data transmission over the Bluetooth connection (i.e., in the same room or within 10 m if recording in open space) when recording with direct data streaming.
   1. If applicable, keep the mobile device in a bag, such as a tablet sleeve, for easier and safer handling. The Bluetooth protocol will attempt reconnecting if the BLE-connection is lost.
      NOTE: It is not advisable to pause and then continue the recording as it may disrupt synchronization between sensors or the temporal integrity of the recorded data, as well as you may lose the BLE connection. On such occasions, the only option is to switch off the application and start the recording anew.
2. Arrange the surroundings to facilitate play with toys and other objects and encourage the infant to move freely. For instance, clear the space for moving around or lay a mat on the ground so the infant may be encouraged to move when seeing age-appropriate toys. The aim is to record the natural movement of the infant.
   1. Ensure that the infant feels comfortable and secure enough to engage in spontaneous play without experiencing anxiety due to new people or unfamiliar places.
3. Record at least 1 h of free play or as long as desired by the study questions. Multiple play/movement epochs can be combined later during the analysis.
4. If required by the specific research protocol, take further notes to facilitate detailed inspection of individual results. Use real-time synchronized annotations in the data logger application as free text, audio recordings, or video recordings.
5. For unsupervised home recordings, set the recording to stop automatically (i.e., set the duration (hh:mm) of the recording manually by pressing the Settings button).
6. In supervised settings, end the recording by pressing the Stop button on the application.
7. Take off the suit and pack it for return to the laboratory.
8. Wash the suit after each recording after taking the sensors off the suit pockets. If available, use detergents, including moisture transportation aimed at synthetic materials¹¹.
   1. Inspect the suit visually after washing for mechanical defects before storing it for the use on the next child.

4. Cloud-based analysis: upload of raw data and download of results

1. Click on the recorded file in the database view of the application, and then click Export to Babacloud, which opens the home page of the computational cloud (https://babacloud.fi/) using the web browser on the mobile device (Supplemental file 2).
2. Enter username and password into the login page. If needed, request new credentials from the email address provided on the Babacloud home page.
3. Choose the recorded file for an upload. Then, choose an identification number for the subject and add the required information as indicated by the Babacloud workflow. If relevant for the case, also enter the subject's age or other information (e.g., playtime) to "Add another raw file label". Finally, save the upload session by pressing the Save button.
   NOTE: As a default, the data logger application will generate a zipped file from the movement data to enable an easier and faster data transfer over the air via a wi-fi or mobile network. The Babacloud interface will require credentials that can be obtained as instructed on their web page. The recorded raw data can also be transferred directly from the phone to another device for customized analysis. Ensure that unnecessary data from the memory of the mobile device is deleted to avoid confusion between recording sessions. The recording sessions are automatically placed in their own folders, which are named with their respective time stamps.
4. Download the zipped package of analysis outputs from the cloud server using a mobile device or a computer web browser. Click the correct Subject ID, then choose the link to the desired analysis, which automatically opens the file download.
   NOTE: In the zipped results package, the two following items can be found: A detailed result matrix, which gives all second-by-second classifications for posture, movement, infant carrying, and free playtime (Figure 2A, Supplemental file 3). Graphical reports that give an overview of the study session (Supplemental file 4).

Discussion

A quantified assessment and developmental tracking of infants' motor performance with a wearable solution, such as MAIJU, is technically simple to learn and perform, and it can be readily implemented into health care or clinical research practice^10,11,12. Compared to the other existing motor assessment methods, this kind of at-home recording of infants' spontaneous motor activity improves the ecological validity of the assessment. Furthermore, it provides a quantified, transparent, and fully automated analysis of infants' motor performance. Most importantly, the metrics used in the analysis are intuitive and explainable, which enables their easy comparison with other clinical and research assessments, such as environmental factors, cognitive development, or psychosocial assessments. A holistic assessment of motor development provides an accuracy that compares well with the conventional physical growth measures¹².

Critical steps in the protocol include careful preparation of the wearable suit. When preparing for a recording, choosing the correct size for the suit is crucial, as the sensor attachments in the sleeves and legs are required to sit tightly to obtain a reliable recording of body movements. Also, for a successful recording, it is essential to place the sensors in the pockets with a correct orientation, as indicated in the protocol. The sensor mounts will not allow sensors to rotate during the recording. However, the incorrectly oriented sensor records data that is difficult, if not impossible, to fix afterward. The infant should be encouraged to move freely and independently during the recording. The recording length may vary according to the given study questions. The multiple spontaneous movement epochs are combined to accumulate enough spontaneous movement for each recording session.

The flexible and practical operation of the MAIJU wearable solution allows its use in variable contexts in both supervised and unsupervised settings, such as research labs or homes. Recent results from our clinical trials show that fully unsupervised recordings conducted at home may provide comparable results with recordings that are done under full or partial supervision¹². Still, a child's spontaneous motor behavior is potentially affected by several factors, such as the surroundings (e.g., playing outside vs. indoors, the layout of the space, furniture, and toys), the child's level of alertness, and the parents' involvement during the home recording. When the recordings are performed in unsupervised settings at home, it is important to encourage the child to play spontaneously, i.e., to play or move independently, without someone else carrying or holding the child if not necessary, and to keep the recording mobile phone at a Bluetooth range (in the same room)¹⁰. The majority of our current troubleshooting situations during the recordings are caused by loss of Bluetooth connection. Near-future advances in sensor technology will improve Bluetooth connectivity, and the upcoming introduction of a larger sensor memory will allow offline recording by storing movement data directly in the sensor memory.

Out-of-hospital recordings with a wearable solution of this kind are readily scalable and they may improve safety of infants, e.g., by enabling remote monitoring during circumstances such as a pandemic. Our present classifier algorithms were trained to specifically recognize the given motor abilities, postures, and movements shown in the motility description scheme (Figure 2A). These phenomena were identified as characteristic of infant movement during the first two years of life. Other types of movements or postures seen in older children, such as running or jumping, will require modified movement description schemes and respective algorithms to be trained to identify them. Posture-context dependent analysis is a potentially fruitful approach where an infant's motor activity is analyzed separately in different postures to support studying, e.g., developmental correlates of infant behavior^5,6,7,8,9,13. Alternatively, a context-dependent movement analysis could also support assessing asymmetry in motor function when predicting the development of unilateral cerebral palsy^10,12,14,15. Further, assessment of motor abilities with the MAIJU system may be combined with other study modalities, e.g., eye tracking, imaging, or video recording, to provide multimodal data, spanning it to different types and contexts. Multimodal data may be useful, e.g., in evaluating the effects of social interaction or the efficacy of therapeutic intervention.

For the success of novel wearable technologies in out-of-hospital monitoring environments with infants, certain limitations, challenges, and ethical concerns need to be addressed. Our analysis pipelines were trained and validated using typically developing infants in Finland^10,11,12. The raw analysis outputs with pure postures and movements should be universal. However, their developmental trajectories may require adjustments for diverse cultures and geographical locations. According to parent feedback regarding wearable devices, they are viewed favorably due to infant-friendliness¹⁶. However, parents may raise concerns regarding privacy, data access, and family practicalities (e.g., multiple caregivers, visitors, and varying schedules). Dependency on the battery life of the sensors and the recording phone can be considered a limitation of the method. In our experience, the battery model (CR2025) typically lasts for the full day (12-24 hours) when using continuous data streaming. Notably, it depends on both the battery brand and the strength of the Bluetooth connection needed for wireless data transmission, which is continuously changing to maximize data transmission in the recording environment. For instance, a long distance between the infant and the phone or a wall between them would adjust the Bluetooth connection to significantly higher battery consumption. Notably, the batteries of most mobile devices are also drained within about the same time if using continuous Bluetooth streaming. In practice, the presently used continuous data streaming over Bluetooth connection implies that both the sensors and mobile devices need a daily recharge/battery replacement. The near future introduction of sensors with larger memory capacity will allow data storage in the sensor memory, supporting over a week of continuous recording. That will remove the need for power-consuming Bluetooth streaming, as well as carrying the phone within a Bluetooth range that may be perceived as restrictive in recording situations and is susceptible to human error.

Overall, tracking of early neurodevelopment needs methods that are sensitive to natural neurobehavioural variability. Gross motor development is an intricate process consisting of variations in the order and timing, both on individual and cultural levels⁴. Detection of atypical motor development is effective in recognizing infants at risk for an extensive range of neurodevelopmental disorders. Traditional test batteries with standardized neurodevelopmental assessments are performed in controlled environments, such as hospitals, and are at least partially subjective^7,8,9. Current advances in sensor technology and signal analysis have enabled recordings of infants' spontaneous motor ability over extended periods in out-of-hospital settings and quantitation of the motor behavior at an accuracy comparable with human observers^10,11,12. Novel wearable technology offers automated and scalable methods for monitoring movement and the efficacy of therapeutic intervention in infants in an ecologically valid and objective way. Furthermore, the novel neurodevelopmental index Baba Infant Motor Score (BIMS) enables the estimation of infants' maturity of motor ability by individual tracking of neurodevelopment^10,12. It can be employed in a range of future applications, such as the development of infant motor growth charts¹². By training the automated classifiers for other specific motilities (e.g., for older children or adults) with different kinds of movement description schemes and algorithms, the wearable movement sensors have the potential for clinical applications, such as movement disorders or follow-up on the effects of therapeutic interventions regardless of the developmental stage of the individual¹⁷. Currently, however, this should be viewed as an investigational methodology that should not be used to inform clinical diagnosis or treatment targets.

Materials

Name	Company	Catalog Number	Comments
iOS device (version 16.5 or higher)	Apple	n/a
MAIJU jumpsuit	Planno Ltd	n/a	customized for purpose
Maijulogger (mobile application) and sensor firmware	BABA Center (www.babacenter.fi), Kaasa solutions GmbH	n/a	constructed by Kaasa Solutions, distributed by Baba Center
Movesense movement sensor	Movesense (www.movesense.com)	n/a