Name: design and evaluation of smart glasses for food intake and physical activity classification
Uploaded: 2018-02-14T13:00:00
Description: Watch this Scientific Journal Video about Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification at JoVE.com

这项工作得到了 Envisible 公司的支持。这项研究还得到了大韩民国卫生部 & 福利部韩国卫生技术 & 发展项目 (HI15C1027) 的资助。这项研究也得到韩国国家研究基金会 (NRF-2016R1A1A1A05005348) 的支持。

注意: 所有的程序, 包括使用人的主题是通过非侵入性的方式, 简单地戴着一副眼镜。所有的数据都是通过测量在玻璃中插入的力信号, 而不是与皮肤直接接触而获得的。数据被无线传输到数据记录模块, 在这种情况下, 这是一个指定的智能手机的研究。所有协议都与体内/体外人类研究无关。没有用药物和血液样本进行实验。所有实验对象都获得了知情同意。
1. 传感...

<ol>
	<li>Sharma, A. M., Padwal, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Obesity+is+a+sign-over-eating+is+a+symptom:+an+aetiological+framework+for+the+assessment+and+management+of+obesity.">Obesity is a sign-over-eating is a symptom: an aetiological framework for the assessment and management of obesity.</a> Obes Rev. 11 (5), 362-370 (2010).</li><li>Pi-Sunyer, F. X., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Clinical+guidelines+on+the+identification,+evaluation,+and+treatment+of+overweight+and+obesity+in+adults.">Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults.</a> Am J Clin Nutr. 68 (4), 899-917 (1998).</li><li>McCrory, P., Strauss, B., Wahlqvist, M. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Energy+balance,+food+intake+and+obesity.">Energy balance, food intake and obesity.</a> Exer Obes. , (1994).</li><li>Albinali, F., Intille, S., Haskell, W., Rosenberger, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Proceedings of the 12th ACM international conference on Ubiquitous computing. , 311-320 (2010).</li><li>Bonomi, A., Westerterp, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Advances+in+physical+activity+monitoring+and+lifestyle+interventions+in+obesity:+a+review.">Advances in physical activity monitoring and lifestyle interventions in obesity: a review.</a> Int J Obes. 36 (2), 167-177 (2012).</li><li>Jung, S., Lee, J., Hyeon, T., Lee, M., Kim, D. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Fabric-Based+Integrated+Energy+Devices+for+Wearable+Activity+Monitors.">Fabric-Based Integrated Energy Devices for Wearable Activity Monitors.</a> Adv Mater. 26 (36), 6329-6334 (2014).</li><li>Fulk, G. D., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Using+sensors+to+measure+activity+in+people+with+stroke.">Using sensors to measure activity in people with stroke.</a> Top Stroke Rehabil. 18 (6), 746-757 (2011).</li><li>Makeyev, O., Lopez-Meyer, P., Schuckers, S., Besio, W., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automatic+food+intake+detection+based+on+swallowing+sounds.">Automatic food intake detection based on swallowing sounds.</a> Biomed Signal Process Control. 7 (6), 649-656 (2012).</li><li>P&#228;&#223;ler, S., Fischer, W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Food+intake+activity+detection+using+an+artificial+neural+network.">Food intake activity detection using an artificial neural network.</a> Biomed Tech (Berl). , (2012).</li><li>Passler, S., Fischer, W. -. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Food+intake+monitoring:+Automated+chew+event+detection+in+chewing+sounds.">Food intake monitoring: Automated chew event detection in chewing sounds.</a> IEEE J Biomed Health Inform. 18 (1), 278-289 (2014).</li><li>Kadomura, A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> CHI'13 Extended Abstracts on Human Factors in Computing Systems. , 1551-1556 (2013).</li><li>Fontana, J. M., Farooq, M., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automatic+ingestion+monitor:+A+novel+wearable+device+for+monitoring+of+ingestive+behavior.">Automatic ingestion monitor: A novel wearable device for monitoring of ingestive behavior.</a> IEEE Trans Biomed Eng. 61 (6), 1772-1779 (2014).</li><li>Shen, Y., Salley, J., Muth, E., Hoover, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Assessing+the+Accuracy+of+a+Wrist+Motion+Tracking+Method+for+Counting+Bites+across+Demographic+and+Food+Variables.">Assessing the Accuracy of a Wrist Motion Tracking Method for Counting Bites across Demographic and Food Variables.</a> IEEE J Biomed Health Inform. , (2016).</li><li>Farooq, M., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> International Conference on Bioinformatics and Biomedical Engineering. , 464-472 (2017).</li><li>Grigoriadis, A., Johansson, R. S., Trulsson, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Temporal+profile+and+amplitude+of+human+masseter+muscle+activity+is+adapted+to+food+properties+during+individual+chewing+cycles.">Temporal profile and amplitude of human masseter muscle activity is adapted to food properties during individual chewing cycles.</a> J Oral Rehab. 41 (5), 367-373 (2014).</li><li>Strini, P. J. S. A., Strini, P. J. S. A., de Souza Barbosa, T., Gavi&#227;o, M. B. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Assessment+of+thickness+and+function+of+masticatory+and+cervical+muscles+in+adults+with+and+without+temporomandibular+disorders.">Assessment of thickness and function of masticatory and cervical muscles in adults with and without temporomandibular disorders.</a> Arch Oral Biol. 58 (9), 1100-1108 (2013).</li><li>Standring, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Gray's anatomy: the anatomical basis of clinical practice. , (2015).</li><li>Farooq, M., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+novel+wearable+device+for+food+intake+and+physical+activity+recognition.">A novel wearable device for food intake and physical activity recognition.</a> Sensors. 16 (7), 1067 (2016).</li><li>Zhang, R., Amft, O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Proceedings of the 2016 ACM International Symposium on Wearable Computers. , 50-52 (2016).</li><li>Farooq, M., Sazonov, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Segmentation+and+Characterization+of+Chewing+Bouts+by+Monitoring+Temporalis+Muscle+Using+Smart+Glasses+with+Piezoelectric+Sensor.">Segmentation and Characterization of Chewing Bouts by Monitoring Temporalis Muscle Using Smart Glasses with Piezoelectric Sensor.</a> IEEE J Biomed Health Inform. , (2016).</li><li>Huang, Q., Wang, W., Zhang, Q. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Your+Glasses+Know+Your+Diet:+Dietary+Monitoring+using+Electromyography+Sensors.">Your Glasses Know Your Diet: Dietary Monitoring using Electromyography Sensors.</a> IEEE Internet of Things Journal. , (2017).</li><li>Chung, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+glasses-type+wearable+device+for+monitoring+the+patterns+of+food+intake+and+facial+activity.">A glasses-type wearable device for monitoring the patterns of food intake and facial activity.</a> Scientific Reports. 7, 41690 (2017).</li><li>Cristianini, N., Shawe-Taylor, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> An introduction to support Vector Machines: and other kernel-based learning methods. , (2000).</li><li>Giannakopoulos, T., Pikrakis, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Introduction to Audio Analysis: A MATLAB Approach. , (2014).</li><li>Chang, C. -. C., Lin, C. -. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=LIBSVM:+a+library+for+support+vector+machines.">LIBSVM: a library for support vector machines.</a> ACM Trans Intell Syst Technol. 2 (3), 27 (2011).</li><li>Po, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Time-frequency+analysis+of+chewing+activity+in+the+natural+environment.">Time-frequency analysis of chewing activity in the natural environment.</a> J Dent Res. 90 (10), 1206-1210 (2011).</li><li>Ji, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Frequency+and+velocity+of+people+walking.">Frequency and velocity of people walking.</a> Struct Eng. 84 (3), 36-40 (2005).</li><li>Knoblauch, R., Pietrucha, M., Nitzburg, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Field+studies+of+pedestrian+walking+speed+and+start-up+time.">Field studies of pedestrian walking speed and start-up time.</a> Transp Res Red. 1538, 27-38 (1996).</li></ol>

在这项研究中, 我们首先提出了眼镜的设计和制造过程, 它能感觉到食物的摄取和运动的规律。由于本研究主要集中在数据分析上, 将食物摄取量与其他物理活动 (如步行和眨眼) 区分开来, 传感器和数据采集系统需要执行移动记录。因此, 该系统包括传感器、具有无线通信能力的 MCU 和电池。该议定书提供了一种新颖和实用的方法来衡量颞肌肉活动的模式, 由于食物摄取和眨眼的非接触方式: 工具和?...

持续和客观地监测食物摄入量对于维持人体的能量平衡至关重要, 因为过量的能量积聚可能导致 overweightness 和肥胖症1, 这可能导致各种医疗并发症2。能源失衡的主要因素是食物摄入过量和体力活动不足3。通过可穿戴设备4、5、6, 对日常能源支出监测进行了各种研究, 包括在最终消费者级别和医疗阶段7。然而, 对食品摄入量监测的研究仍处于实验室设置之中, 因为很难直接和客观地检测食物摄取活动。在这里, 我们的目的是提供一个设备设计和评估, 以监测食品摄入量和体育活动模式在实际水平的日常生活中。
通过咀嚼和吞咽声音来监测食物摄取的各种间接方法8,9,10, 手腕11,12,13, 图像分析14和肌电图 (肌电信号)15。然而, 这些方法很难适用于日常生活应用, 因为它们固有的局限性: 使用声音的方法容易受到环境声音的影响;使用手腕运动的方法在不消耗食物的情况下很难与其他体力活动区分开来;使用图像和肌电信号的方法受到运动和环境边界的限制。这些研究表明, 使用传感器自动检测食物摄取量的能力, 但仍然有限制的实际适用性的日常生活以外的实验室设置。
在本研究中, 我们利用颞肌肉活动的模式作为对食物摄取量的自动和客观的监测。一般来说, 颞肌肉重复收缩和松弛作为咀嚼肌肉的一部分, 在食物摄取量16,17;因此, 可以通过检测颞肌肉活动的周期性模式来监测食物摄取活动。最近, 有几项研究利用了颞肌肉活动18,19,20,21, 使用了肌电信号或压电应变传感器, 并直接附加到人类皮肤.然而, 这些方法对肌电信号电极或应变传感器的皮肤位置很敏感, 并且由于身体运动或出汗而容易脱离皮肤。因此, 我们提出了一个新的和有效的方法, 使用一对眼镜, 通过两个负载细胞, 通过插入在我们以前的研究中的铰链中的颞肌肉活动22。该方法在不接触皮肤的情况下, 具有很高的准确度检测食物摄取活动的潜力。因为我们使用的是一种普通的眼镜式设备, 所以它也不太显眼, 也不侵入。
在本研究中, 我们提出了如何实现眼镜型设备的一系列详细协议, 以及如何使用颞肌肉活动模式来监测食物摄取量和体力活动。这些协议包括硬件设计和制造过程, 由3维打印的眼镜框架、一个电路模块和一个数据采集模块组成, 包括用于数据处理和分析的软件算法。此外, 我们还检查了几个特色活动 (例如, 咀嚼, 散步和眨眼) 的分类, 以证明作为一个实际系统的潜力, 可以区分食物摄入量和其他体力活动之间的细微差别。模式.

<table>
	<tbody>
		<tr>
			<td>FSS1500NSB</td>
			<td>Honeywell, USA</td>
			<td></td>
			<td>Load cell</td>
		</tr>
		<tr>
			<td>INA125U</td>
			<td>Texas Instruments, USA</td>
			<td></td>
			<td>Amplifier</td>
		</tr>
		<tr>
			<td>ESP-07</td>
			<td>Shenzhen Anxinke Technology, China</td>
			<td></td>
			<td>MCU with Wi-Fi module</td>
		</tr>
		<tr>
			<td>74LVC1G3157</td>
			<td>Nexperia, The Netherlands</td>
			<td></td>
			<td>Multiplexer</td>
		</tr>
		<tr>
			<td>MP701435P</td>
			<td>Maxpower, China</td>
			<td></td>
			<td>LiPo battery</td>
		</tr>
		<tr>
			<td>U1V10F3</td>
			<td>Pololu, USA</td>
			<td></td>
			<td>Voltage regulator</td>
		</tr>
		<tr>
			<td>Ultimaker 2</td>
			<td>Ultimaker, The Netherlands</td>
			<td></td>
			<td>3D printer</td>
		</tr>
		<tr>
			<td>ColorFabb XT-CF20</td>
			<td>ColorFabb, The Netherlands</td>
			<td></td>
			<td>Carbon fiber filament</td>
		</tr>
		<tr>
			<td>iPhone 6s Plus</td>
			<td>Apple, USA</td>
			<td></td>
			<td>Data acquisition device</td>
		</tr>
		<tr>
			<td>Jelly Belly</td>
			<td>Jelly Belly Candy Company, USA</td>
			<td></td>
			<td>Food texture for user study</td>
		</tr>
	</tbody>
</table>

design and evaluation of smart glasses for food intake and physical activity classification

本研究提出了设计和制造一种眼镜式可穿戴装置的一系列协议, 用于检测在进食和其他体力活动期间颞肌肉活动的模式。我们制作了一个 3 d 印刷框架的眼镜和一个负载单元集成印制电路板 (PCB) 模块插入两个铰链的框架。该模块用于获取力信号, 并进行无线传输。这些程序为系统提供了更高的机动性, 可以评估在实际穿戴条件如步行和晃。分类的表现也通过区别食物摄取的方式从那些体育活动被评估。一系列的算法被用来对信号进行预处理, 产生特征向量, 并识别几种功能性活动 (咀嚼和眨眼) 的模式, 以及其他体育活动 (静坐休息、说话和走路)。结果表明, 各特征活动的分类平均为1评分为91.4%。我们认为, 这种方法可能有助于自动和客观地监测摄食行为, 以更高的准确度作为治疗摄食问题的实用手段。

通过该协议中概述的过程, 我们通过区分头片长度、lH (133 和138毫米) 和寺庙、LT (110 和125毫米) 来编写3D 打印帧的两个版本, 如图 4所示。因此, 我们可以覆盖几个磨损条件, 这可以从不同的主题的头部大小, 形状,等.受试者选择了其中一个框架, 以适合他们的头部供用户学习。在铰链接头和支承螺栓孔之间的垂直距离 (Lh) ?...

Watch this Scientific Journal Video about Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification at JoVE.com

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification

食品摄取及运动分级智能眼镜的设计与评价

本研究提出了一种设计和制造一种眼镜式可穿戴装置的协议, 它通过在眼镜的两个铰链中插入负载细胞来检测食物摄取的模式和其他特征的物理活动。

This study presents a series of protocols of designing and manufacturing a glasses-type wearable device that detects the patterns of temporalis muscle ...

Research

JoVE Journal

Engineering

Experiments on Ultrasonic Lubrication Using a Piezoelectrically-assisted Tribometer and Optical Profilometer

使用超声波润滑实验一压电辅助摩擦试验机和光学轮廓

Friction and wear are detrimental to engineered systems. Ultrasonic lubrication is achieved when the interface between two sliding surfaces is vibrated at ...

科研

工程学

Scanning Light Scattering Profiler (SLPS) Based Methodology to Quantitatively Evaluate Forward and Backward Light Scattering from Intraocular Lenses

Scanning Light Scattering Profiler SLPS Based Methodology to Quantitatively Evaluate Forward and Backward Light Scattering from Intraocular Lenses

基于扫描光散射分析器（SLPS）的方法来量化评估来自眼内镜的前向和后向光散射

The scanning light scattering profiler (SLSP) methodology has been developed for the full-angle quantitative evaluation of forward and backward light ...

Measuring the Densities of Aqueous Glasses at Cryogenic Temperatures

在低温下测量水性玻璃的密度

We demonstrate a method for determining the vitreous phase cryogenic temperature densities of aqueous mixtures, and other samples that require rapid ...

Design and Characterization Methodology for Efficient Wide Range Tunable MEMS Filters

高效宽量程可调谐 MEMS 滤波器的设计与表征方法

Here, we demonstrate the advantages of the laser Doppler vibrometer (LDV) over conventional techniques (the network analyzer), as well as the techniques ...

Methods of Ex Situ and In Situ Investigations of Structural Transformations: The Case of Crystallization of Metallic Glasses

Methods of Ex Situ and In Situ Investigations of Structural Transformations: The Case of Crystallization of Metallic Glasses

结构转换的原位和原位研究方法: 金属玻璃结晶的实例

We demonstrate the use of two nuclear-based analytical methods that can follow the modifications of microstructural arrangement of iron-based metallic ...

Hybrid Printing for the Fabrication of Smart Sensors

用于智能传感器制造的混合打印

A method to combine additively manufactured substrates or foils and multilayer inkjet printing for the fabrication of sensor devices is presented. First, ...

Design and Implementation of a Bespoke Robotic Manipulator for Extra-corporeal Ultrasound

一种用于体外超声的自定义机器人机械手的设计与实现

With the potential for high precision, dexterity, and repeatability, a self-tracked robotic system can be employed to assist the acquisition of real-time ...

Crack Monitoring in Resonance Fatigue Testing of Welded Specimens Using Digital Image Correlation

使用数字图像相关性对焊接试样共振疲劳测试中的裂纹监测

A procedure using digital image correlation (DIC) to detect cracks on welded specimens during fatigue tests on resonance testing machines is presented. It ...

Evaluation of an Exclusive Spur Dike U-Turn Design with Radar-Collected Data and Simulation

利用雷达采集的数据和仿真评估独家刺堤 U 型转弯设计

Traditional U-turn designs can improve operational features obviously, while U-turn diversions and merge segments still cause traffic congestion, ...

Fabrication of Compressed Hosiery and Measurement of its Pressure Characteristic Exerted on the Lower Limbs

压缩袜子的制造及其下肢压力特性测量

This article reports the pressure characteristic measurement of compressed hosiery via direct and indirect methods. In the direct method, an interface ...