Name: video movement analysis using smartphones (vimas): a pilot study
Uploaded: 2017-03-14T12:30:00.000+00:00
Duration: 7 min 51 s
Description: Watch this Scientific Journal Video about Video Movement Analysis Using Smartphones ViMAS: A Pilot Study at JoVE.com

The authors wish to thank all the participants who generously gave their time to participate in this study.

This protocol was approved by the Institutional Review Board of Wayne State University.
1. Experimental Preparation
<ol>
	<li>Position cameras to capture the entire 6-m walkway. Use a total of 4 3D motion captures cameras to capture walking over a 6-m walkway.
	<ol>
		<li>Place each of the cameras at the 4 corners of the 6 m walkway. Orient each of the cameras at the diagonal ends of the walkway to face each other.</li>
	</ol>
	</li>
	<li>Collect height, weight and leg length measures of each participant.
	<ol>
		<li>Measure mass in kilograms.</li>
		<li>Measure leg length (in meters) from greater trochanter to medial malleoli of both legs with a measuring tape.</li>
		<li>Measure the height (in meters), by having the participant stand barefoot next to a measuring tape attached to the wall. Place a ruler on top of the participant&#39;s head to read the measurement from the measuring tape attached to the wall.</li>
	</ol>
	</li>
	<li>Mount the smartphone on a tripod with a tripod adapter for a smart phone holder clip. Place the tripod at 2-m or 4-m, perpendicular to the center of the walkway. Randomize the order of this placement if performing a validation study.</li>
	<li>Place clusters of 3 smart markers on the participant on bilateral anterior superior iliac crests (ASIS), upper 1/3 of thigh, upper 1/3 of calf and dorsum of foot. Place a single smart marker in midline between the right and left posterior superior iliac crests.
	<ol>
		<li>Secure the smart markers with Velcro straps/double sided sticky tape. Secure thigh and calf markers in the frontal plane.</li>
	</ol>
	</li>
	<li>Place stickers indicating bony landmarks over bilateral medial and lateral femoral condyles, medial and lateral malleoli and the webspace between first and second toes for calibration of the 3D motion capture system. 
	NOTE: The calibration procedure is specific to each laboratory, and 3D motion capture equipment and software.</li>
	<li>For the calibration procedure, refer to the instructional manual provided by the manufacturer of the 3D motion capture equipment and/or software that is used to analyze the data. The process used here involves using an instrumented &#34;Wand&#34; with smart markers, to register the 3D location of the stickers that were placed.</li>
</ol>
2. Experiment
<ol>
	<li>Adjust the smart phone camera lens height to capture either the participant&#39;s lower body only (ASIS as superior border) or upper and lower body (acromion as superior border). Measure the height from the floor to the camera lens in meters.</li>
	<li>Give participants a practice trial. Have one investigator operate the smart phone, and the other operate the computer that controls the 3D motion capture system. Use numbered paper to indicate trial number on the smart phone recording.</li>
	<li>Open the smart phone application. Press the red &#34;record&#34; button on the bottom, center of the screen to begin recording (when in vertical orientation). 
	NOTE: If the smartphone has already been placed on the tripod, the button appears at the middle, right side of the phone, near the home button of the smartphone.</li>
	<li>Instruct the participant to walk at their normal pace, focused on a marker placed on opposite wall to assist them in walking a straight line. Place the smartphone parallel to the walkway to capture a side profile of the participant. Have the participant cross the first two 3D motion capture cameras placed at the beginning of the walkway on either side, and walk towards another two 3D motion capture cameras placed at the other end of the walkway on either side.
	<ol>
		<li>For each trial, give each participant a countdown to start (3, 2, 1, GO) and end the trial (3, 2, 1, STOP).</li>
	</ol>
	</li>
	<li>After the subject finishes walking 6-m distance, select the red &#34;record&#34; button once more to finish recording this walking trial.</li>
	<li>Check all markers for position after each trial. If a marker position was altered, return to step 1.6 to recalibrate the 3D motion capture system to the new marker placements.</li>
	<li>Have participants perform 3 trials at each camera distance in step 2.1.</li>
	<li>Move the tripod with the smart phone to the second distance. Return the participant to stand on the mid-point of the walk way. Follow instructions in protocol steps 2.2 - 2.5.</li>
	<li>Save and verify the 3D motion capture recordings and smartphone recordings before removal of smart markers.</li>
</ol>
3. Data Analysis
<ol>
	<li>Follow software/manufacturer&#39;s instructions to compute the knee angle. Manually record the knee angle that is displayed on the screen at heel strike and toe off phase of the gait cycle.</li>
	<li>Complete the analysis of smart phone recordings for heel strike and toe off events captured by a team of two investigators, who have to agree on the moment of heel strike and toe off events and angle measurement land marks. Use a stylus for increased accuracy of landmark placement for knee angle measurements. The steps below are done jointly by the two investigators.</li>
	<li>To view the trial that was just recorded, select the video square in the bottom left corner of the screen (in vertical orientation).</li>
	<li>Using the scroll bar at the base of the screen, select the frame in which the subject is closest to heel strike or toe off (whichever is the preferred variable) in the center of the screen.</li>
	<li>To drop in the angle, tap on the white, outlined pencil icon on the upper right side of the screen.</li>
	<li>Select the angle option, the second option in the drop down menu.</li>
	<li>Choose a preferred color and the angle maker. Please note that only one angle can be measured at one time. The angle measured in this protocol purely consisted of the knee angle in the sagittal plane.</li>
	<li>Slide or tap the stylus anywhere on the screen to drop in the angle.</li>
	<li>Place the center of the angle on the knee joint (lateral condyle), with the vectors reaching upwards along the femur and downwards towards the lateral malleoli.</li>
	<li>If needed, &#34;zoom in&#34; by placing two fingers close together in the center of the screen and slowly drawing them apart from one another. 
	NOTE: Once satisfied with the placement of the angle, the tool automatically calculates the knee angle at that given frame.</li>
	<li>To identify the knee angle at other phases of toe off or heel strike, repeat steps 3.4 - 3.10.</li>
</ol>
4. Clinical Protocol
<ol>
	<li>Measure and mark off a 6-m walkway using a measuring tape and marker/sticky tape.</li>
	<li>Place the smartphone on a tripod parallel and close to the center of the 6-meter walkway.</li>
	<li>Place the tripod 2 m away from the center of the walkway to capture the lower extremity, or 4 m away to capture the trunk and lower extremity. All camera positions allow only capture of sagittal plane kinematics.</li>
	<li>Calculate the height of the smartphone camera lens height from the floor using the following formulae: 
	Near camera configuration (2 m) for only lower extremity capture 
	Camera lens height = (0.87xPatient&#39;s reference leg length in meters)- 0.12 
	Far camera configuration (4 meters) for both lower extremity and trunk capture 
	Camera lens height = Patient&#39;s reference leg length in meters - 0.23</li>
	<li>Repeat sections 2 - 3 to record and analyze data using the smart phone app.</li>
</ol>

<ol>
	<li>Brunnekreef, J. J., van Uden, C. J., van Moorsel, S., Kooloos, J. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+of+videotaped+observational+gait+analysis+in+patients+with+orthopedic+impairments.">Reliability of videotaped observational gait analysis in patients with orthopedic impairments.</a> BMC Musculoskelet Disord. 6 (17), (2005).</li><li>Jette, D. U., Halbert, J., Iverson, C., Miceli, E., Shah, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Use+of+standardized+outcome+measures+in+physical+therapist+practice:+perceptions+and+applications.">Use of standardized outcome measures in physical therapist practice: perceptions and applications.</a> Phys Ther. 89 (2), 125-135 (2009).</li><li>Jette, D. U., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evidence-based+practice:+beliefs,+attitudes,+knowledge,+and+behaviors+of+physical+therapists.">Evidence-based practice: beliefs, attitudes, knowledge, and behaviors of physical therapists.</a> Phys Ther. 83 (9), 786-805 (2003).</li><li>Stuberg, W. A., Colerick, V. L., Blanke, D. J., Bruce, W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Comparison+of+a+Clinical+Gait+Analysis+Method+Using+Videography+and+Temporal-Distance+Measures+with+16-Mm+Cinematography.">Comparison of a Clinical Gait Analysis Method Using Videography and Temporal-Distance Measures with 16-Mm Cinematography.</a> Phys Ther. 68 (8), 1221-1225 (1988).</li><li>Norris, B. S., Olson, S. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Concurrent+validity+and+reliability+of+two-dimensional+video+analysis+of+hip+and+knee+joint+motion+during+mechanical+lifting.">Concurrent validity and reliability of two-dimensional video analysis of hip and knee joint motion during mechanical lifting.</a> Physiother Theory Pract. 27 (7), 521-530 (2011).</li><li>Robinson, J. L., Smidt, G. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Quantitative+gait+evaluation+in+the+clinic.">Quantitative gait evaluation in the clinic.</a> Phys Ther. 61 (3), 351-353 (1981).</li><li>Krystkowiak, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gait+abnormalities+induced+by+acquired+bilateral+pallidal+lesions:+a+motion+analysis+study.">Gait abnormalities induced by acquired bilateral pallidal lesions: a motion analysis study.</a> J Neurol. 253 (5), 594-600 (2006).</li><li>Grunt, S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reproducibility+and+validity+of+video+screen+measurements+of+gait+in+children+with+spastic+cerebral+palsy.">Reproducibility and validity of video screen measurements of gait in children with spastic cerebral palsy.</a> Gait Posture. 31 (4), 489-494 (2010).</li><li>Womersley, L., May, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Sitting+posture+of+subjects+with+postural+backache.">Sitting posture of subjects with postural backache.</a> J Manipulative Physiol Ther. 29 (3), 213-218 (2006).</li><li>DeForge, D., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effect+of+4-aminopyridine+on+gait+in+ambulatory+spinal+cord+injuries:+a+double-blind,+placebo-controlled,+crossover+trial.">Effect of 4-aminopyridine on gait in ambulatory spinal cord injuries: a double-blind, placebo-controlled, crossover trial.</a> Spinal Cord. 42 (12), 674-685 (2004).</li><li>Lucareli, P. R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gait+analysis+following+treadmill+training+with+body+weight+support+versus+conventional+physical+therapy:+a+prospective+randomized+controlled+single+blind+study.">Gait analysis following treadmill training with body weight support versus conventional physical therapy: a prospective randomized controlled single blind study.</a> Spinal Cord. 49 (9), 1001-1007 (2011).</li><li>Lucareli, P. R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=[Gait+analysis+and+quality+of+life+evaluation+after+gait+training+in+patients+with+spinal+cord+injury].">[Gait analysis and quality of life evaluation after gait training in patients with spinal cord injury].</a> Rev Neurol. 46 (7), 406-410 (2008).</li><li>McFadyen, B. J., Swaine, B., Dumas, D., Durand, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Residual+effects+of+a+traumatic+brain+injury+on+locomotor+capacity:+a+first+study+of+spatiotemporal+patterns+during+unobstructed+and+obstructed+walking.">Residual effects of a traumatic brain injury on locomotor capacity: a first study of spatiotemporal patterns during unobstructed and obstructed walking.</a> J Head Trauma Rehabil. 18 (6), 512-525 (2003).</li><li>Shin, J. C., Yoo, J. H., Jung, T. H., Goo, H. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Comparison+of+lower+extremity+motor+score+parameters+for+patients+with+motor+incomplete+spinal+cord+injury+using+gait+parameters.">Comparison of lower extremity motor score parameters for patients with motor incomplete spinal cord injury using gait parameters.</a> Spinal Cord. 49 (4), 529-533 (2011).</li><li>Reid, S., Held, J. M., Lawrence, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+and+Validity+of+the+Shaw+Gait+Assessment+Tool+for+Temporospatial+Gait+Assessment+in+People+With+Hemiparesis.">Reliability and Validity of the Shaw Gait Assessment Tool for Temporospatial Gait Assessment in People With Hemiparesis.</a> Arch Phys Med Rehabil. 92 (7), 1060-1065 (2011).</li><li>Stokic, D. S., Horn, T. S., Ramshur, J. M., Chow, J. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Agreement+Between+Temporospatial+Gait+Parameters+of+an+Electronic+Walkway+and+a+Motion+Capture+System+in+Healthy+and+Chronic+Stroke+Populations.">Agreement Between Temporospatial Gait Parameters of an Electronic Walkway and a Motion Capture System in Healthy and Chronic Stroke Populations.</a> Am J Phys Med Rehabil. 88 (6), 437-444 (2009).</li><li>Arazpour, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluation+of+a+novel+powered+hip+orthosis+for+walking+by+a+spinal+cord+injury+patient:+a+single+case+study.">Evaluation of a novel powered hip orthosis for walking by a spinal cord injury patient: a single case study.</a> J. Prosthet. Orthot. Int. 36 (1), 105-112 (2012).</li><li>Prado-Medeiros, C. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Effects+of+the+addition+of+functional+electrical+stimulation+to+ground+level+gait+training+with+body+weight+support+after+chronic+stroke.">Effects of the addition of functional electrical stimulation to ground level gait training with body weight support after chronic stroke.</a> Revista Brasileira De Fisioterapia. 15 (6), 436-444 (2011).</li><li>Sousa, C. O., Barela, J. A., Prado-Medeiros, C. L., Salvini, T. F., Barela, A. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Gait+training+with+partial+body+weight+support+during+overground+walking+for+individuals+with+chronic+stroke:+a+pilot+study.">Gait training with partial body weight support during overground walking for individuals with chronic stroke: a pilot study.</a> J Neuroeng Rehabil. 8 (48), (2011).</li><li>Krebs, D. E., Edelstein, J. E., Fishman, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+of+observational+kinamatic+gait+analysis.">Reliability of observational kinamatic gait analysis.</a> J Am Phys Ther Assoc. 65, 1027-1033 (1995).</li><li>Martin, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=More+than+half+of+MDs+under+age+35+now+using+PDAs.">More than half of MDs under age 35 now using PDAs.</a> Can. Med. Assoc. J. 169 (9), 952 (2003).</li><li>Mosa, A. M., Yoo, I., Sheets, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+Systematic+Review+of+Healthcare+Applications+for+Smartphones.">A Systematic Review of Healthcare Applications for Smartphones.</a> BMC Med Inform Decis Mak. 12, (2012).</li><li>Ferriero, G., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+of+a+smartphone-based+goniometer+for+knee+joint+goniometry.">Reliability of a smartphone-based goniometer for knee joint goniometry.</a> Int J Rehabil Res. 36 (2), 146-151 (2013).</li><li>Vohralik, S. L., Bowen, A. R., Burns, J., Hiller, C. E., Nightingale, E. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+and+validity+of+a+smartphone+app+to+measure+joint+range.">Reliability and validity of a smartphone app to measure joint range.</a> Am J Phys Med Rehabil. 94 (4), 325-330 (2015).</li><li>Scholtes, S. S., Gretchen, <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Ability+to+detect+change+in+single+leg+squat+movement+patterns+following+instruction+in+females+with+patellofemoral+pain+using+2D+motion+analysis+methods.">Ability to detect change in single leg squat movement patterns following instruction in females with patellofemoral pain using 2D motion analysis methods.</a> Combined Sections Meeting. , (2014).</li><li>Eltoukhy, M. A., Asfour, S., Thompson, C., Latta, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Evaluation+of+the+performance+of+digital+video+analysis+of+human+motion:+dartfish+tracking+system.">Evaluation of the performance of digital video analysis of human motion: dartfish tracking system.</a> IJSER. 3 (3), 1-6 (2012).</li><li>Boone, D. C., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+of+goniometric+measurements.">Reliability of goniometric measurements.</a> Phys Ther. 58 (11), 1355-1360 (1978).</li><li>Bovens, A. M., van Baak, M. A., Vrencken, J. G., Wijnen, J. A., Verstappen, F. T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Variability+and+reliability+of+joint+measurements.">Variability and reliability of joint measurements.</a> Am J Sports Med. 18 (1), 58-63 (1990).</li></ol>

No relevant financial relationship exists with Hudl Technique (Ubersense). Adams Physical Therapy Clinic, Novi, MI were our clinical collaborators on this study.

The purpose of this validation study was to determine the validity of a freely available smartphone application in order to be clinically used as an objective and cost effective means of using smartphone technology for kinematic gait analysis in the clinical setting. Existing validation studies that examined kinematic measures with a smartphone application are limited and have not assessed dynamic kinematic measures recorded during gait in the sagittal plane. This validation study is the first to have examined kinematic ...

Assessment of human gait is a key component of the physical therapy evaluation and clinical decision-making process.1 Gait assessment is a frequently used clinical tool to assess gait deficits in patients with neurological and musculoskeletal deficits. Reassessment of gait can then provide the clinician with information about the efficacy of an intervention in achieving the goals they had set at their initial evaluation. There is a nationally recognized need in the United States for physical therapists to utilize standardized outcome measurements when evaluating patients.2 This need stems from the rapidly changing landscape of insurance reimbursement policies, as well as an emphasized shift for physical therapists to rely more heavily on evidence based practices.3 There are numerous outcome measures to assess different aspects of gait, which can be observed in a number of ways including: visual observation by a clinician, functional assessments, video recorded measures, electronic walkways, three-dimensional motion analysis software, etc. In clinical settings, observational (visual) gait analysis is commonly performed, as it requires minimal equipment and time.
While observational gait analysis is commonly used within the clinic, it still remains a subjective assessment.4 Therefore, factors such as therapist experience, visual acuity, distance from the subject (camera distance), measurement tools, and any other such factors can introduce variability and error in the assessment. The potential for such variability presents a critical need for a more reliable means of measurement, which can ultimately be overcome by the use of valid instrumentation.5
Since its inception, videography and related technology has been used to examine various functional limitations resulting from impaired movement capability as well as a form of visual feedback. This is acutely true in regards to gait assessment. Stuberg et al. found that &#34;videography equipment is commonly available in the clinic&#8230;and provides the clinician with additional objective information on posture and joint position during the gait cycle.&#34;4 As technology has continued to improve, so have the capabilities of video analysis. These capabilities provide the physical therapist with greater ability to clinically assess the various parameters of gait.
The two key parameters that physical therapists focus on include kinematic and spatiotemporal parameters. As the name implies, spatiotemporal measures involve elements of distance and time. Specific to a gait cycle, spatiotemporal measures would include, but not be limited to, stride length, step length, cadence, and velocity.6 Kinematic measures on the other hand focus on the joint movements/rotations of the lower extremities observed during each gait cycle.
A number of peer-reviewed articles have been published that have cited the use of video motion analysis as an outcome measure, specifically 2D camera systems, to assess kinematic, spatiotemporal, or a combination of both types of parameters. These articles have evaluated various clinical populations including individuals with a history of a stroke (CVA), traumatic brain injuries (TBI), spinal cord injuries (SCI), Parkinson&#39;s disease (PD), cerebral palsy (CP), and healthy individuals. The schematic presented below (Figure 1) provides the framework that was adopted to identify relevant peer-reviewed literature that has been published on this topic.
<img alt="Figure 1" src="/files/ftp_upload/54659/54659fig1.jpg" /> 
Figure 1. Schematic for Article Selection Criteria. The schematic outlines the steps used in choosing peer-reviewed articles to ascertain the type of variables that were reported in gait analysis. <a href="http://cloudflare.jove.com/files/ftp_upload/54659/54659fig1large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
The majority of the research studies that have used video motion analysis for recording gait parameters were validation studies. Kinematic validation studies can be further broken down into one of three categories: assessing abnormal motion resulting from a specific diagnosis/pathology,7 examining joint angles during specific functional motions,8,9 and evaluating the effectiveness of treatment via comparison of pre-intervention motion and post-intervention motion.10,11 Similarly, research studies assessing spatiotemporal parameters can also be broken down into three categories: assessment of abnormal motion resulting from a specific pathology,12,13,14 examination of a platform during a specific functional activity,15,16 and determination of the effect of a specific intervention.17 The research studies that evaluated both kinematic and spatiotemporal parameters were primarily aimed at determining the effectiveness of specific treatment interventions such as orthoses 17 or body weight/partial body weight supported treadmill training.18,19 A preliminary descriptive analysis of these articles determined that 52.1% of the studies (the sum of those looking solely at kinematics (30.4%) and those that examined a combination of parameters (21.7%)) researched kinematic parameters with a 2D camera system. This is in comparison to the 69.5% of the articles (sum of articles that researched spatiotemporal parameters (47.8%) and a combination of parameters (21.7%)) that assessed spatiotemporal parameters.
The methodological differences in recording and assessing kinematic and spatiotemporal gait parameters are also seen in clinical practice in terms of the type of observational gait analysis being used. Spatiotemporal parameters are assessed with much greater frequency as indicated by the research. There are three generally agreed upon reasons for this trend: low cost, ease of use, and the existence of a standard protocol to measure such parameters. Observational kinematic measurements have been shown to have very low intra-rater (60%) and inter-rater reliability (40% - 94%) in clinical settings.4 This wide range is understood to be due to the variation in the placement of markers on bony landmarks and the specific tools used to assess joint angles. Minute differences in location placement of the markers can significantly alter the resultant angles. Spatiotemporal measurements have much higher reliability (ranging 69% - 97%), especially when using the paper, pencil and stop clock method to assess gait.20
The technological advances in the last few decades have significantly changed the way healthcare is practiced. With the recent emergence of smartphones, access to the Internet, online research articles, and other electronic resources are now more readily available to clinicians at any time. Martin et al. reported that &#34;general use of smartphones is increasing in clinical practice, medical education and research.&#34;21 In this study, more than 50% of medical doctors under the age of 35 responded that they have implemented using a smartphone in clinical practice. This trend increased in 2009 when 64% of physicians in the United States were found to be using smartphones in their clinical practice. The Manhattan Review study further predicted that this growth would continue to climb to 81% of physicians and healthcare clinicians implementing smartphone usage in clinical practice by 2012.22 While further research has not been conducted to determine if this upward trend has indeed continued to climb, it is reasonable to assume, with the known implementation of technology in healthcare, that the use of smartphone platforms in clinical practice will become more commonplace.
The current use of smartphone applications in physical therapy practice has not been established. There have been no studies evaluating the use of smartphone video analysis applications by a physical therapist to date. However, various smartphone applications have been used by individual physical therapists as a breakthrough assistive tool in outpatient orthopedic settings for use in both rehabilitating and training athletes of various disciplines. Smartphone apps are also available that can measure joint angles, some of which have been validated.23,24 Individual therapists have begun using various analysis applications on smartphones for visual feedback for the patient and for easier breakdown of various components that may be lacking in a patient&#39;s gait cycle, based on anecdotal evidence. However, the validity of these measures remains unknown. The limited research that does exist regarding these smartphone video analysis applications has focused on the validation of kinematic gait parameters, specifically ankle, knee and hip angles, in the frontal plane,25 and inter-rater reliability of the device.26 There are no studies to date that have validated the use of smartphone video analysis applications to record kinematics of gait in the sagittal plane, which is most commonly performed in clinical gait analysis.
The purpose of this study was to test the concurrent validity of kinematic measures recorded by the smartphone application and compare them to measures recorded by a 3D motion capture system in the sagittal plane. We predict that there will be no significant differences between the measures recorded by the smartphone application when compared to the measures recorded by the 3D motion capture system. The secondary purpose is to test if two distinct placements of the smartphone camera from the subject (near distance of 2-m; far distance of 4 -nt difference in measures between the two distinct placements of the smartphone camera. The final purpose of the study is to draft a protocol for clinical video gait analysis using a smartphone application.

<table><tbody><tr><td>Hudl Technique App</td><td>Hudl&amp;nbsp;</td><td>Online app</td><td>Freely downladable app from adroid /apple store</td></tr><tr><td>Optotrak Certus 3D motion capture system</td><td>Northern Digital inc</td><td>Optotrak certus System</td><td>http://www.ndigital.com/msci/products/optotrak-certus/</td></tr><tr><td>Smartphone</td><td>Apple</td><td>Iphone 5</td><td>www.apple.com</td></tr></tbody></table>

video movement analysis using smartphones (vimas): a pilot study

The use of smartphones in clinical practice is steadily increasing with the availability of low cost/freely available &#34;apps&#34; that could be used to assess human gait. The primary aim of this manuscript is to test the concurrent validity of kinematic measures recorded by a smartphone application in comparison to a 3D motion capture system in the sagittal plane. The secondary aim was to develop a protocol for clinicians on the set up of the smartphone camera for video movement analysis.
The sagittal plane knee angle was measured during heel strike and toe off events using the smart phone app and a 3D motion-capture system in 32 healthy subjects. Three trials were performed at near (2-m) and far (4-m) smartphone camera distances. The order of the distances was randomized. Regression analysis was performed to estimate the height of the camera based on either the subject&#39;s height or leg length.
Absolute measurement errors were least during toe off (3.12 &#177; 5.44 degrees) compared to heel strike (5.81 &#177; 5.26 degrees). There were significant (p &#60; 0.05) but moderate agreements between the application and 3D motion capture measures of knee angles. There were also no significant (p &#62; 0.05) differences between the absolute measurement errors between the two camera positions. The measurement errors averaged between 3 - 5 degrees during toe off and heel strike events of the gait cycle.
The use of smartphone apps can be a useful tool in the clinic for performing gait or human movement analysis. Further studies are needed to establish the accuracy in measuring movements of the upper extremity and trunk.

All 32 subjects completed the 6 walking trials; however, data from 6 of the participants were not included in the data analysis due to technical problems resulting in poor marker visibility. The absolute measurement errors of knee angles were least during toe off events (3.12 &#177; 5.44 degrees) compared to heel strike (5.81 &#177; 5.26 degrees) (Table 1b). There were no statistically significant agreements (P &#62; 0.05) between the smartphone application and 3D motion ...

Watch this Scientific Journal Video about Video Movement Analysis Using Smartphones ViMAS: A Pilot Study at JoVE.com

Video Movement Analysis Using Smartphones ViMAS: A Pilot Study

This manuscript describes the method to test the concurrent validity of kinematic measures recorded by the smartphone application in comparison to a 3D motion capture system in the sagittal plane. This protocol will enable clinicians to set up smartphones for video capture of human movement.

Video Movement Analysis Using Smartphones (ViMAS): A Pilot Study

The use of smartphones in clinical practice is steadily increasing with the availability of low cost/freely available &#34;apps&#34; that could be used to ...

video-movement-analysis-using-smartphones-vimas-a-pilot-study

Research

JoVE Journal

Medicine

16.7K Views.  Wayne State University. This manuscript describes the method to test the concurrent validity of kinematic measures recorded by the smartphone application in comparison to a 3D motion capture system in the sagittal plane. This protocol will enable clinicians to set up smartphones for video capture of human movement.

Video: Video Movement Analysis Using Smartphones ViMAS: A Pilot Study

Evaluation of a Smartphone-based Human Activity Recognition System in a Daily Living Environment

An evaluation method that includes continuous activities in a daily-living environment was developed for Wearable Mobility Monitoring Systems (WMMS) that attempt to recognize user activities. Participants performed a pre-determined set of daily living actions within a continuous test circuit that included mobility activities (walking, standing, sitting, lying, ascending/descending stairs), daily living tasks (combing hair, brushing teeth, preparing food, eating, washing dishes), and subtle environment changes (opening doors, using an elevator, walking on inclines, traversing staircase landings, walking outdoors). 
To evaluate WMMS performance on this circuit, fifteen able-bodied participants completed the tasks while wearing a smartphone at their right front pelvis. The WMMS application used smartphone accelerometer and gyroscope signals to classify activity states. A gold standard comparison data set was created by video-recording each trial and manually logging activity onset times. Gold standard and WMMS data were analyzed offline. Three classification sets were calculated for each circuit: (i) mobility or immobility, ii) sit, stand, lie, or walking, and (iii) sit, stand, lie, walking, climbing stairs, or small standing movement. Sensitivities, specificities, and F-Scores for activity categorization and changes-of-state were calculated.
The mobile versus immobile classification set had a sensitivity of 86.30% &#177; 7.2% and specificity of 98.96% &#177; 0.6%, while the second prediction set had a sensitivity of 88.35% &#177; 7.80% and specificity of 98.51% &#177; 0.62%. For the third classification set, sensitivity was 84.92% &#177; 6.38% and specificity was 98.17 &#177; 0.62. F1 scores for the first, second and third classification sets were 86.17 &#177; 6.3, 80.19 &#177; 6.36, and 78.42 &#177; 5.96, respectively. This demonstrates that WMMS performance depends on the evaluation protocol in addition to the algorithms. The demonstrated protocol can be used and tailored for evaluating human activity recognition systems in rehabilitation medicine where mobility monitoring may be beneficial in clinical decision-making.

A standardized evaluation method was developed for Wearable Mobility Monitoring Systems (WMMS) that includes continuous activities in a realistic daily living environment. Testing with a series of daily living activities can decrease activity recognition sensitivity; therefore, realistic testing circuits are encouraged for valid evaluation of WMMS performance.

An evaluation method that includes continuous activities in a daily-living environment was developed for Wearable Mobility Monitoring Systems (WMMS) that ...

Behavior

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

As individuals increasingly live in cities, methods to study their everyday movements and the data that can be collected becomes important and valuable. Eye-tracking informatics are known to connect to a range of feelings, health conditions, mental states and actions. But because vision is the result of constant eye-movements, teasing out what is important from what is noise is complex and data intensive. Furthermore, a significant challenge is controlling for what people look at compared to what is presented to them.
The following presents a methodology for combining and analyzing eye-tracking on a video of a natural and complex scene with a machine learning technique for analyzing the content of the video. In the protocol we focus on analyzing data from filmed videos, how a video can be best used to record participants&#39; eye-tracking data, and importantly how the content of the video can be analyzed and combined with the eye-tracking data. We present a brief summary of the results and a discussion of the potential of the method for further studies in complex environments.

The objective of the protocol is to detail how to collect video data for use in the laboratory; how to record eye-tracking data of participants looking at the data and how to efficiently analyze the content of the videos that they were looking at using a machine learning technique.

As individuals increasingly live in cities, methods to study their everyday movements and the data that can be collected becomes important and valuable. ...

Environment

Frame-by-Frame Video Analysis of Idiosyncratic Reach-to-Grasp Movements in Humans

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate objects and tools in our environment. Such behaviors are impaired by many sensorimotor disorders, yet our current understanding of their neural control is far from complete. Current technologies for investigating human reach-to-grasp movements often utilize motion tracking systems that can be expensive, require the attachment of markers or sensors to the hands, impede natural movement and sensory feedback, and provide kinematic output that can be difficult to interpret. While generally effective for studying the stereotypical reach-to-grasp movements of healthy sighted adults, many of these technologies face additional limitations when attempting to study the unpredictable and idiosyncratic reach-to-grasp movements of young infants, unsighted adults, and patients with neurological disorders. Thus, we present a novel, inexpensive, and highly reliable yet flexible protocol for quantifying the temporal and kinematic structure of idiosyncratic reach-to-grasp movements in humans. High speed video cameras capture multiple views of the reach-to-grasp movement. Frame-by-frame video analysis is then used to document the timing and magnitude of pre-defined behavioral events such as movement start, collection, maximum height, peak aperture, first contact, and final grasp. The temporal structure of the movement is reconstructed by documenting the relative frame number of each event while the kinematic structure of the hand is quantified using the ruler or measure function in photo editing software to calibrate 2 dimensional linear distances between two body parts or between a body part and the target. Frame-by-frame video analysis can provide a quantitative and comprehensive description of idiosyncratic reach-to-grasp movements and will enable researchers to expand their area of investigation to include a greater range of naturalistic prehensile behaviors, guided by a wider variety of sensory modalities, in both healthy and clinical populations.

This protocol describes how to use frame-by-frame video analysis to quantify idiosyncratic reach-to-grasp movements in humans. A comparative analysis of reaching in sighted versus unsighted healthy adults is used to demonstrate the technique, but the method can also be applied to the study of developmental and clinical populations.

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate ...

Measuring the Kinematics of Daily Living Movements with Motion Capture Systems in Virtual Reality

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based assessments of IADL are easy to use but prone to subjective bias. Here, we describe a novel virtual reality (VR) test to assess two complex IADL tasks: handling financial transactions and using public transportation. While a participant performs the tasks in a VR setting, a motion capture system traces the position and orientation of the dominant hand and head in a three-dimensional Cartesian coordinate system. Kinematic raw data are collected and converted into &#39;kinematic performance measures,&#39; i.e., motion trajectory, moving distance, and time to completion. Motion trajectory is the path of a particular body part (e.g., dominant hand or head) in space. Moving distance refers to the total distance of the trajectory, and time to completion is how long it took to complete an IADL task. These kinematic measures could discriminate patients with cognitive impairment from healthy controls. The development of this kinematic measuring protocol allows detection of early IADL-related cognitive impairments.

We designed a virtual reality test to assess instrumental activities of daily living (IADL) with a motion capture system. We propose a detailed kinematic analysis to interpret the participant&#39;s various movements, including trajectory, moving distance, and time to completion to evaluate IADL capabilities.

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based ...

Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will and action (sense of agency; SoA) have been recognized as the basis of our bodily self-consciousness. Previously, the illusory SoO over a fake body part (e.g., rubber hand) was introduced as the rubber hand illusion (RHI). Furthermore, it was determined that one could also evoke a SoA over an object with movements linked to the one&#8217;s prior intention. On the other hand, the postdictivity of our spontaneity implies that it is essentially inseparable whether actions originate from self or others. In other words, our SoA or daily experiences are obtained in such as inseparable scenario. Previous research, however, has maintained the premise that self- and other-origin movements are perceptually distinguishable. Here, we implement a protocol to make these aspects ambiguous for the participants and to estimate whether they can feel SoO and/or SoA and how. To this end, we employ an experiment using virtual reality, under which participants observe virtual fingers moving very slowly (or quickly or not moving) while their own fingers do not move. For evaluation of the illusory SoO, measurements of skin conductance responses against a knife threat are adopted. Additionally, we introduce face-to-face interviews to determine whether the feelings regarding the slow movement match the conventional SoA definition. Our representative results suggest that the SoO is evoked over the hand, and various attitudes to accept its movement as the participant&#8217;s own with awareness that they did not originate it are reported by the majority. As the results show, the novelty of this protocol is discovering that in such a situation, the SoO cooperates with an externally produced SoA to establish one&#8217;s own bodily experience rather than the independence of the SoO and SoA.

While previous research on bodily self-consciousness assumed that self- and other-origin movements were perceptually distinguishable, this protocol allows them to be ambiguous on a virtual hand with unintentional slight movements. This enables us to observe one&#8217;s experience formed by SoO and other-produced SoA, rather than the absence of SoA.

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will ...

Smartphone-Based Imaging for C. elegans Lawn Avoidance Assay

A Smartphone-Based Imaging Method for C. elegans Lawn Avoidance Assay

When exposed to toxic or pathogenic bacteria, the nematode Caenorhabditis elegans displays a learned lawn avoidance behavior, in which the worms gradually leave their food source and prefer to remain outside the bacterial lawn. The assay is an easy way to test the worms' ability to sense external or internal cues to properly respond to harmful conditions. Though a simple assay, counting is time consuming, particularly with multiple samples, and assay durations that span overnight are inconvenient for researchers. An imaging system that can image many plates over a long period is useful but costly. Here, we describe a smartphone-based imaging method to record lawn avoidance in C. elegans. The method requires only a smartphone and a light emitting diode (LED) light box, to serve as a transmitted light source. Using free time-lapse camera applications, each phone can image up to six plates, with sufficient sharpness and contrast to manually count worms outside the lawn. The resulting movies are processed into 10 s audio video interleave (AVI) files for every hourly time point, then cropped to show each single plate to make them more amenable for counting. This method is a cost-effective way for those looking to examine avoidance defects and can potentially be extended to other C. elegans assays.

Author Spotlight: A Smartphone-Based Imaging Method for C. elegans Lawn Avoidance Assay  

This article describes a simple, low-cost method of recording the lawn avoidance behavior of Caenorhabditis elegans, using readily available items such as a smartphone and a light emitting diode (LED) light box. We also provide a Python script to process the video file into a format more amenable for counting.

When exposed to toxic or pathogenic bacteria, the nematode Caenorhabditis elegans displays a learned lawn avoidance behavior, in which the worms gradually ...

Smartphone as an Analytical Device to Quantify Protein Using Bradford Assay

RGBradford: Protein Quantitation with a Smartphone Camera

Protein quantitation is an essential procedure in life sciences research. Amongst several other methods, the Bradford assay is one of the most used. Because of its widespread, the limitations and advantages of the Bradford assay have been exhaustively reported, including several modifications of the original method to improve its performance. One of the alterations of the original method is the use of a smartphone camera as an analytical instrument. Taking advantage of the three forms of the Coomassie Brilliant Blue dye that exist in the conditions of the Bradford assay, this paper describes how to accurately quantify protein in samples using color data extracted from a single picture of a microplate. After performing the assay in a microplate, a picture is taken using a smartphone camera, and RGB color data is extracted from the picture using a free and open-source image analysis software application. Then, the ratio of blue to green intensity (in the RGB scale) of samples with unknown concentrations of protein is used to calculate the protein content based on a standard curve. No significant difference is observed between values calculated using RGB color data and those calculated using conventional absorbance data.

Author Spotlight: An Alternative Approach to Protein Quantification by Bradford Assay Using a Smartphone 

This paper provides a protocol for protein quantification using the Bradford assay and a smartphone as an analytical device. Protein levels in samples can be quantified using color data extracted from a picture of a microplate taken with a smartphone.

Protein quantitation is an essential procedure in life sciences research. Amongst several other methods, the Bradford assay is one of the most used. ...

Biochemistry

Quantitative Analysis of Random Migration of Cells Using Time-lapse Video Microscopy

Cell migration is a dynamic process, which is important for embryonic development, tissue repair, immune system function, and tumor invasion 1, 2. During directional migration, cells move rapidly in response to an extracellular chemotactic signal, or in response to intrinsic cues 3 provided by the basic motility machinery. Random migration occurs when a cell possesses low intrinsic directionality, allowing the cells to explore their local environment.
Cell migration is a complex process, in the initial response cell undergoes polarization and extends protrusions in the direction of migration 2. Traditional methods to measure migration such as the Boyden chamber migration assay is an easy method to measure chemotaxis in vitro, which allows measuring migration as an end point result. However, this approach neither allows measurement of individual migration parameters, nor does it allow to visualization of morphological changes that cell undergoes during migration.
Here, we present a method that allows us to monitor migrating cells in real time using video - time lapse microscopy. Since cell migration and invasion are hallmarks of cancer, this method will be applicable in studying cancer cell migration and invasion in vitro. Random migration of platelets has been considered as one of the parameters of platelet function 4, hence this method could also be helpful in studying platelet functions. This assay has the advantage of being rapid, reliable, reproducible, and does not require optimization of cell numbers. In order to maintain physiologically suitable conditions for cells, the microscope is equipped with CO2 supply and temperature thermostat. Cell movement is monitored by taking pictures using a camera fitted to the microscope at regular intervals. Cell migration can be calculated by measuring average speed and average displacement, which is calculated by Slidebook software.

This method allows monitoring of cells in real time and quantitative measurements of different cell migration parameters such as speed, displacement, and velocity. Unlike the traditional methods, this real time approach is not based on endpoint quantitative migration measurements; instead it allows monitoring and calculating different parameters continuously.

Cell migration is a dynamic process, which is important for embryonic development, tissue repair, immune system function, and tumor invasion 1, 2. During ...

Biology

Smartphone Fundus Photography

Smartphone fundus photography is a simple technique to obtain ocular fundus pictures using a smartphone camera and a conventional handheld indirect ophthalmoscopy lens. This technique is indispensable when picture documentation of optic nerve, retina, and retinal vessels is necessary but a fundus camera is not available. The main advantage of this technique is the widespread&#160;availability of smartphones that allows documentation of macula and optic nerve changes in many settings that was not previously possible. Following the well-defined steps detailed here, such as proper alignment of the phone camera, handheld lens, and the patient&#39;s pupil, is the key for obtaining a clear retina picture with no interfering light reflections and aberrations. In this paper, the optical principles of indirect ophthalmoscopy and fundus photography will be reviewed first. Then, the step-by-step method to record a good quality retinal image using a smartphone will be explained.

Fundus photography normally requires specialized fundus cameras that are not always available in all clinical settings.&#160;Here, a simple method to record ocular fundus images using a smartphone camera and a conventional high-plus handheld indirect ophthalmoscopy lens is described.

Smartphone fundus photography is a simple technique to obtain ocular fundus pictures using a smartphone camera and a conventional handheld indirect ...

Quantified Assessment of Infant's Gross Motor Abilities Using a Multisensor Wearable

Developing objective and quantitative methods of early gross motor assessment is essential to better understand neurodevelopment and to support early therapeutic interventions. Here, we&#160;present&#160;a method to quantify gross motor performance using a multisensor wearable, MAIJU (Motility Assessment of Infants with a JUmpsuit), which offers an automated, scalable,&#160;quantitative, and objective assessment using&#160;a fully automated cloud-based pipeline. This wearable suit is equipped with four movement sensors that record synchronized data to a mobile phone utilizing a low-energy Bluetooth connection. An offline analysis in the cloud server generates fully analyzed results within minutes for each recording. These results include a graphical report of the recording session and a detailed result matrix that gives second-by-second classifications for posture, movement, infant carrying, and free playtime. Our recent results show the virtue of such&#160;quantified motor assessment&#160;providing&#160;a potentially&#160;effective method for distinguishing variations in the infant&#39;s gross motor development.

This paper outlines the assessment of infants' gross motor performance with a multisensor wearable and its fully automated deep learning-based analysis pipeline. The method quantifies the posture and movement patterns of infants from lying supine until they master walking independently.

Developing objective and quantitative methods of early gross motor assessment is essential to better understand neurodevelopment and to support early ...