이 프로토콜을 사용하여 연구는 심장과 뇌졸중 재단 (G-18-0020952), 크레이그 H. 닐슨 재단 (542675), 캐나다 자연 과학 및 공학 연구 위원회 (RGPIN-2014-05498), 연구, 혁신 및 과학부, 온타리오 (ER16-12-013)에 의해 투자되었다.

연구 결과는 대학 건강 네트워크의 연구 윤리 위원회에 의해 승인되었습니다. 서명된 정보에 입각한 동의는 연구에 등록하기 전에 각 참가자로부터 얻어졌습니다. 비디오 녹화에 등장하는 간병인 이나 가정 구성원으로부터 서명 된 동의를 얻었습니다.
1. 개인에 대한 프로토콜 적용 가능성 확인
참고: 이 프로토콜은 손상되었지만 완전히 결석하지 않은 개인에게 적용하기 위한 것입니다(특정 기준은 인구 및/또는 관심 문제에 맞게 조정할 수 있음).
<ol><li>참가자들에게 영향을 받는 손이 AD를 수행하는 능력에 영향을 미치는지 물어보십시오. 참고: 참가자에게 영향을 받는 손으로 독립적으로 수행할 수 있고 수행할 수 없는 작업의 몇 가지 예를 제공하도록 요청하는 것이 좋습니다.</li>
	<li>몬트리올 인지 평가(MoCA)의 총 점수가 21을 초과하는지 확인하여 프로토콜 절차를 이해하고 따르는 잠재적 어려움을 방지합니다.</li>
</ol>2. 참가자의 일상의 결정
<ol><li>참가자들에게 지난 2주 동안 의 일상을 회상해 보라고 한다. 수행되는 일일 작업, 기간 및 대략 몇 시에 문서화합니다.</li>
	<li>참가자와 공동으로 동영상을 녹화하는 동안 각각 1.5h의 3회 를 선택합니다. 주 중 다른 날에 걸쳐 분산되는 타임슬롯을 선택하고 손을 포함하는 AD가 일반적으로 순서대로 수행될 때 수행됩니다. 참고: 선택한 AD는 각 참가자의 일반적인 활동을 대표해야 하며 의미 있는 것으로 인식되어야 합니다. 다양한 날에 기록 기간을 예약하는 것은 기록된 AL의 다양성을 높이고 유용하고 의미 있는 데이터의 캡처를 촉진하기 위한 것입니다. 참고: 기록 시간대는 기록 효율성을 위해 예약되어 있지만 참가자는 언제 시작하고 녹화를 중지해야 하는지 완전히 제어할 수 있음을 이해해야 합니다.</li>
</ol>3. 녹화 일정에 대한 합의 및 참가자와의 비디오 콘텐츠 타겟팅
<ol><li>기록 일정에 대한 각 참가자의 동의를 얻고, 그들이 가질 수있는 우려를 논의 한 후.</li>
	<li>2주 동안 3h의 동영상 목표를 설정합니다. 동영상이 부족하면 녹화 기간이 연장될 수 있음을 참가자에게 알립니다.</li>
</ol>4. AD를 자연스럽게 수행하는 것의 중요성을 강조합니다.
<ol><li>참가자에게 기록할 특정 활동을 지정하는 대신 사실적인 루틴을 캡처하는 데 집중하도록 지시합니다. 명령의 의도는 참가자가 일반적인 것보다 더 많은 양의 특정 활동을 인위적으로 기록하지 못하게하는 것입니다.</li>
</ol>5. 집에서 녹음 하는 동안 잠재적인 개인 정보 보호 문제에 대 한 통지
<ol><li>참가자는 모든 기록이 개인 정보 보호 문제를 피하기 위해 공공 장소가 아닌 집 안에서 수행되어야한다는 것을 이해해야합니다.</li>
	<li>목욕, 드레싱/드레싱, 기밀 정보 확인 등 개인 정보 보호 문제를 제기할 수 있는 몇 가지 예를 제시합니다. 참가자들에게 녹음에 얼굴을 표시할 수 있는 거울을 알고 있음을 상기시킨다.</li>
	<li>참가자는 비디오에서 가능한 한 가족 구성원이나 간병인과 같은 다른 사람들의 존재를 피할 것을 제안합니다. 참고: 연구 연구의 맥락에서, 다른 사람의 존재가 불가피한 경우, 그 개인에게서 통보된 동의를 얻어야 합니다.</li>
</ol>6. 카메라 및 태블릿 명령
참고: 참가자가 초기 접촉 중에 많은 일상적인 필요에 대한 간병인의 도움이 필요하다고 표시하는 경우, 간병인은 또한 연구 방문에 참석하고 장비 사용에 대한 교육을 받아 나중에 참가자를 도울 수 있도록 권장됩니다.
<ol><li>참가자에게 자기 중심카메라(재료 표)를사용하는 방법을 시연합니다.<ol>
<li>카메라를 켜고 끄는 방법을 보여 줍니다.</li>
		<li>카메라를 사용하여 녹화(시작, 일시 중지, 중지)를 제어하는 방법을 보여 줍니다.</li>
	</ol>
</li>
	<li>태블릿(재료 테이블)을사전 설치된 카메라 앱과 함께 사용하여 녹화를 제어하는 방법을 보여 준다. 참고: 데모에는 카메라 앱의 녹화 제어뿐만 아니라 녹화된 비디오를 재생 및 편집(예: 트림 또는 삭제)하는 것이 포함됩니다. 카메라 리모컨은 처음에는 고려되었지만(보충파일)을고려했지만, 실제로는 참가자가 카메라 나 태블릿을 사용하여 녹화를 시작하고 중지하는 것이 편안했기 때문에 사용되지 않았습니다.<ol>
<li>태블릿을 켜고 끄는 방법을 보여 줍니다.</li>
		<li>카메라 앱을 통해 태블릿을 카메라에 연결하는 방법을 보여 줍니다.</li>
		<li>카메라 앱에서 녹화를 제어하는 방법을 보여 줍니다.</li>
		<li>카메라 앱에서 녹화된 동영상을 검토하는 방법을 보여 줍니다.</li>
		<li>카메라 앱에서 비디오를 잘라내거나 삭제하는 방법을 보여 줍니다.</li>
	</ol>
</li>
	<li>참가자의 머리에 조절가능한 탄성 헤드밴드를 사용하여 카메라를 착용하고 벗는 방법을 시연합니다. 참고: 그림 1을참조하십시오. <img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/61898/61898fig01.jpg"> 그림 1. 웨어러블 카메라 설정.  (A) 자기 중심 카메라의 위치. (B) 카메라에서 각광을 받고 있습니다. <a href="https://www.jove.com/files/ftp_upload/61898/61898fig01large.jpg" target="_blank">이 그림의 더 큰 버전을 보려면 여기를 클릭하십시오.</a>
	<ol>
<li>참가자의 이마에 카메라를 놓습니다. 헤드밴드를 조정하여 카메라를 편안하고 꾸준히 착용합니다.</li>
		<li>이마에 대하여 카메라의 최적의 각도를 보장합니다.</li>
		<li>참가자에게 앞에서 손을 움직이고 객체(예: 태블릿)를 조작하는 동안 짧은 비디오 세그먼트를 기록하도록 요청합니다.</li>
		<li>녹화된 비디오를 검토하고 조작 작업을 수행하는 동안 장면의 중앙 영역에서 두 손이 명확하게 표시되는지 확인합니다.</li>
		<li>참가자 및 간병인과 함께 카메라와 태블릿을 사용하여 숙련도를 입증할 때까지 연습합니다.</li>
	</ol>
</li>
</ol>7. 장비 제공
<ol><li>참가자들에게 모든 장비가 있는 키트를 제공하여 집에서 AD를 기록하십시오. 카메라와 태블릿 외에도 추가 카메라 배터리, 카메라와 태블릿용 배터리 충전기, 충전 케이블, 카메라 헤드밴드 및 카메라 사용에 대한 인쇄된 지침 세트가 포함되어 있습니다(보충 자료참조).</li>
</ol>8. 실험적 문제 해결 및 후속 조치
<ol><li>집에서 실제 녹음 하는 동안 장애물을 해결 하는 데 도움이 연구원의 연락처 정보를 제공 합니다. 1주일 후, 연구원들은 참가자들에게 전화를 걸어 기록 진행 상황을 기록하고 잠재적인 기술적 문제를 해결합니다.</li>
</ol>9. 장비 및 비디오 검색
<ol><li>참가자의 모든 장비와 비디오를 직접 또는 선불 우편 소포를 통해 재구성합니다.</li>
	<li>참가자가 반환된 모든 동영상을 공유하는 데 동의해야 합니다. 참가자는 수집된 모든 동영상을 연구팀에 반환하기 전에 검토하고 공유하고 싶지 않은 부분을 삭제하는 것이 좋습니다.</li>
	<li>연구 연구의 경우 반환된 비디오를 검토하고 동의없이 비디오에 누군가가 나타나는지 확인하십시오. 이 경우 동의서를 보내거나 동영상에 등장하는 개인에게 전화하여 동영상 사용에 대한 동의를 얻습니다. 개인이 도달 할 수없는 경우, 그들이 나타나는 비디오의 부분은 연구원에 의해 삭제됩니다.</li>
</ol>

<ol><li>Nichols-Larsen, D. S., Clark, P., Zeringue, A., Greenspan, A., Blanton, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Factors+influencing+stroke+survivors%27+quality+of+life+during+subacute+recovery%5BTitle%5D)+AND+%22Stroke%22%5BJournal%5D)">Factors influencing stroke survivors' quality of life during subacute recovery.</a> Stroke. 36 (7), 1480-1484 (2005).</li>
<li>Anderson, K. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Targeting+recovery%3A+priorities+of+the+spinal+cord-injured+population%5BTitle%5D)+AND+%22Journal+of+Neurotrauma%22%5BJournal%5D)">Targeting recovery: priorities of the spinal cord-injured population.</a> Journal of Neurotrauma. 21 (10), 1371-1383 (2004).</li>
<li>Gladstone, D. J., Danells, C. J., Black, S. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+Fugl-Meyer+assessment+of+motor+recovery+after+stroke%3A+a+critical+review+of+its+measurement+properties%5BTitle%5D)+AND+%22Neurorehabilitation+and+Neural+Repair%22%5BJournal%5D)">The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties.</a> Neurorehabilitation and Neural Repair. 16 (3), 232-240 (2002).</li>
<li>Barreca, S. R., Stratford, P. W., Lambert, C. L., Masters, L. M., Streiner, D. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Test-retest+reliability%2C+validity%2C+and+sensitivity+of+the+Chedoke+arm+and+hand+activity+inventory%3A+a+new+measure+of+upper-limb+function+for+survivors+of+stroke%5BTitle%5D)+AND+%22Archives+of+Physical+Medicine+and+Rehabilitation%22%5BJournal%5D)">Test-retest reliability, validity, and sensitivity of the Chedoke arm and hand activity inventory: a new measure of upper-limb function for survivors of stroke.</a> Archives of Physical Medicine and Rehabilitation. 86 (8), 1616-1622 (2005).</li>
<li>Uswatte, G., Taub, E., Morris, D., Vignolo, M., McCulloch, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Reliability+and+validity+of+the+upper-extremity+Motor+Activity+Log-14+for+measuring+real-world+arm+use%5BTitle%5D)+AND+%22Stroke%22%5BJournal%5D)">Reliability and validity of the upper-extremity Motor Activity Log-14 for measuring real-world arm use.</a> Stroke. 36 (11), 2493-2496 (2005).</li>
<li>Duncan, P. W., Bode, R. K., Lai, S. M., Perera, S., Antagonist, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Rasch+analysis+of+a+new+stroke-specific+outcome+scale%3A+the+Stroke+Impact+Scale%5BTitle%5D)+AND+%22Archives+of+Physical+Medicine+and+Rehabilitation%22%5BJournal%5D)">Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale.</a> Archives of Physical Medicine and Rehabilitation. 84 (7), 950-963 (2003).</li>
<li>Marino, R. J., Shea, J. A., Stineman, M. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+capabilities+of+upper+extremity+instrument%3A+reliability+and+validity+of+a+measure+of+functional+limitation+in+tetraplegia%5BTitle%5D)+AND+%22Archives+of+Physical+Medicine+and+Rehabilitation%22%5BJournal%5D)">The capabilities of upper extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia.</a> Archives of Physical Medicine and Rehabilitation. 79 (12), 1512-1521 (1998).</li>
<li>Hayward, K. S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Exploring+the+role+of+accelerometers+in+the+measurement+of+real+world+upper-limb+use+after+stroke%5BTitle%5D)+AND+%22Brain+Impairment%22%5BJournal%5D)">Exploring the role of accelerometers in the measurement of real world upper-limb use after stroke.</a> Brain Impairment. 17 (1), 16-33 (2016).</li>
<li>van der Pas, S. C., Verbunt, J. A., Breukelaar, D. E., van Woerden, R., Seelen, H. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Assessment+of+arm+activity+using+triaxial+accelerometry+in+patients+with+a+stroke%5BTitle%5D)+AND+%22Archives+of+Physical+Medicine+and+Rehabilitation%22%5BJournal%5D)">Assessment of arm activity using triaxial accelerometry in patients with a stroke.</a> Archives of Physical Medicine and Rehabilitation. 92 (9), 1437-1442 (2011).</li>
<li>Oess, N. P., Wanek, J., Curt, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Design+and+evaluation+of+a+low-cost+instrumented+glove+for+hand+function+assessment%5BTitle%5D)+AND+%22Journal+of+Neuroengineering+and+Rehabilitation%22%5BJournal%5D)">Design and evaluation of a low-cost instrumented glove for hand function assessment.</a> Journal of Neuroengineering and Rehabilitation. 9 (1), 2(2012).</li>
<li>Friedman, N., Rowe, J. B., Reinkensmeyer, D. J., Bachman, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+manumeter%3A+a+wearable+device+for+monitoring+daily+use+of+the+wrist+and+fingers%5BTitle%5D)+AND+%22IEEE+Journal+of+Biomedical+Health+Informatics%22%5BJournal%5D)">The manumeter: a wearable device for monitoring daily use of the wrist and fingers.</a> IEEE Journal of Biomedical Health Informatics. 18 (6), 1804-1812 (2014).</li>
<li>Liu, X., Rajan, S., Ramasarma, N., Bonato, P., Lee, S. I. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+use+of+a+finger-worn+accelerometer+for+monitoring+of+hand+use+in+ambulatory+settings%5BTitle%5D)+AND+%22IEEE+Journal+of+Biomedical+Health+Informatics%22%5BJournal%5D)">The use of a finger-worn accelerometer for monitoring of hand use in ambulatory settings.</a> IEEE Journal of Biomedical Health Informatics. 23 (2), 599-606 (2018).</li>
<li>Lee, S. I., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((A+novel+upper-limb+function+measure+derived+from+finger-worn+sensor+data+collected+in+a+free-living+setting%5BTitle%5D)+AND+%22PloS+One%22%5BJournal%5D)">A novel upper-limb function measure derived from finger-worn sensor data collected in a free-living setting.</a> PloS One. 14 (3), (2019).</li>
<li>Rowe, J. B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+variable+relationship+between+arm+and+hand+use%3A+a+rationale+for+using+finger+magnetometry+to+complement+wrist+accelerometry+when+measuring+daily+use+of+the+upper+extremity%5BTitle%5D)+AND+%222014+36th+Annual+International+Conference+of+the+IEEE+Engineering+in+Medicine+and+Biology+Society%22%5BJournal%5D)">The variable relationship between arm and hand use: a rationale for using finger magnetometry to complement wrist accelerometry when measuring daily use of the upper extremity.</a> 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. , 4087-4090 (2014).</li>
<li>Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Tenodesis+Grasp+Detection+in+Egocentric+Video%5BTitle%5D)+AND+%22IEEE+Journal+of+Biomedical+and+health%22%5BJournal%5D)">Tenodesis Grasp Detection in Egocentric Video.</a> IEEE Journal of Biomedical and health. , (2020).</li>
<li>Likitlersuang, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Egocentric+video%3A+a+new+tool+for+capturing+hand+use+of+individuals+with+spinal+cord+injury+at+home%5BTitle%5D)+AND+%22Journal+of+Neuroengineering+and+Rehabilitation%22%5BJournal%5D)">Egocentric video: a new tool for capturing hand use of individuals with spinal cord injury at home.</a> Journal of Neuroengineering and Rehabilitation. 16 (1), 83(2019).</li>
<li>Tsai, M. -F., Wang, R. H., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Generalizability+of+Hand-Object+Interaction+Detection+in+Egocentric+Video+across+Populations+with+Hand+Impairment%5BTitle%5D)+AND+%222020+42nd+Annual+International+Conference+of+the+IEEE+Engineering+in+Medicine+%26+Biology+Society+%28EMBC%29%22%5BJournal%5D)">Generalizability of Hand-Object Interaction Detection in Egocentric Video across Populations with Hand Impairment.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). , 3228-3231 (2020).</li>
<li>Bandini, A., Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((A+wearable+vision-based+system+for+detecting+hand-object+interactions+in+individuals+with+cervical+spinal+cord+injury%3A+First+results+in+the+home+environment%5BTitle%5D)+AND+%222020+42nd+Annual+International+Conference+of+the+IEEE+Engineering+in+Medicine+%26+Biology+Society+%28EMBC%29%22%5BJournal%5D)">A wearable vision-based system for detecting hand-object interactions in individuals with cervical spinal cord injury: First results in the home environment.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). , 2159-2162 (2020).</li>
<li>Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Towards+Clustering+Hand+Grasps+of+Individuals+with+Spinal+Cord+Injury+in+Egocentric+Video%5BTitle%5D)+AND+%222020+42nd+Annual+International+Conference+of+the+IEEE+Engineering+in+Medicine+%26+Biology+Society+%28EMBC%29%22%5BJournal%5D)">Towards Clustering Hand Grasps of Individuals with Spinal Cord Injury in Egocentric Video.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). , 2151-2154 (2020).</li>
<li>Bandini, A., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Analysis+of+the+hands+in+egocentric+vision%3A+A+survey%5BTitle%5D)+AND+%22IEEE+Transactions+on+Pattern+Analysis+and+Machine+Intelligence%22%5BJournal%5D)">Analysis of the hands in egocentric vision: A survey.</a> IEEE Transactions on Pattern Analysis and Machine Intelligence. , (2020).</li>
<li>Likitlersuang, J., Sumitro, E. R., Theventhiran, P., Kalsi-Ryan, S., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Views+of+individuals+with+spinal+cord+injury+on+the+use+of+wearable+cameras+to+monitor+upper+limb+function+in+the+home+and+community%5BTitle%5D)+AND+%22Journal+of+Spinal+Cord+Medicine%22%5BJournal%5D)">Views of individuals with spinal cord injury on the use of wearable cameras to monitor upper limb function in the home and community.</a> Journal of Spinal Cord Medicine. 40 (6), 706-714 (2017).</li>
</ol>

저자는 공개 할 것이 없습니다.

우리는 cSCI 및 치기와 같은 상반신 장애가있는 개인의 웨어러블 카메라를 사용하여 집에서 ADL 비디오를 녹화하기위한 프로토콜을 발표했습니다. 이 프로토콜은 유연하며 특정 ADL에서 손 기능 성능을 캡처하거나 집에 거주하는 사람들의 원격으로 재활 진행 상황을 추적하는 것을 목표로 지시할 수 있습니다. 자기 중심의 비전 패러다임은 지역 사회에 살고있는 개인의 손 기능을 원격 모니터링하?...

손 기능은 상지 장애를 가진 임상 인구에 걸쳐 독립성과 삶의 질을 결정합니다1,2. 집에서 손 장애를 가진 개인의 손 기능을 캡처하는 것은 재활 중 및 후 일상 생활 (ADL)의 활동을 수행 할 수있는 능력의 진행 상황을 평가하는 데 필수적입니다. 대부분의 임상손 기능 평가는 가정3,4보다는임상 또는 실험실 환경에서 수행된다. 가정에서 ADL에 미치는 영향을 포착하고자 하는 기존 임상 손 기능 평가는 설문지이며 주관적인 자체 보고 등급5,6,7에의존한다. 재활이 가정에서 손 기능에 미치는 궁극적인 영향을 평가하는 객관적인 평가는 여전히 사용할 수 없습니다.
최근 몇 년 동안, 실제 환경에서 상지 기능을 캡처하기 위해 많은 웨어러블 기술이 개발및 구현되었습니다. 가속도계 및 관성 측정 장치(ImUS)와 같은 웨어러블 센서는 일상 생활에서 상지 의 움직임을 측정하는 데 일반적으로 사용되어 왔습니다. 그러나, 이들 장치는 전형적으로 검출된 시대가 기능상 상반두운동8,9에속하는지, 원하는 작업을 완료하기 위한 의도적인 움직임으로 정의되는지 여부를 구별하지 않는다. 예를 들어, 일부 웨어러블 센서는 보행 중 팔다리 의 존재에 민감하며, 이는 상지의 기능적 움직임이 아닙니다. 또한 손목착용 가속도계는 팔다리 의 상부 움직임을 포착하지만 실제 환경에서는 손 기능의 세부 사항을 캡처할 수 없습니다. 감각 장갑은 손 조작에 대한 자세한 정보를 캡처 할 수있습니다 10,하지만 손 기능과 감각이 이미 손상된 사람들에게 는 성가신 수 있습니다. 웨어러블 접근법은 또한 자기 측정또는 손가락 마모 가속도계11,12,13을통해 손가락 움직임을 포착하기 위해 제안되었지만, 이러한 움직임의 기능적 해석은 여전히 도전적이다14. 따라서 이전에 제안된 웨어러블 장치는 작고 사용하기 편리하지만 손 사용의 세부 사항 및 기능적 맥락을 설명하기에는 충분하지 않습니다.
웨어러블 카메라는 이러한 간격을 채우고 신경 재활 응용 프로그램15,16,17,18,19에대한 가정에서 ADLs 동안 손 기능의 세부 사항을 캡처하기 위해 제안되었습니다. 컴퓨터 비전을 사용하여 자기 중심 비디오를 자동화하여 손 자체와 실제 ADL20에서수행 된 작업에 대한 정보를 제공함으로써 컨텍스트에서 손 기능을 정량화 할 수있는 상당한 잠재력을 가지고 있습니다. 한편, 연속 기록의 지속 시간은 전형적으로 배터리, 저장 및 편안함 고려 사항에 의해 약 1~1.5h로 제한됩니다. 여기서 이러한 제약 조건 내에서 는 개인의 일상 생활을 대표하는 데이터와 손 기능 평가를 위한 유익한 데이터를 얻기 위한 자기 중심적인 비디오 수집 프로토콜을 제시합니다.

<table><tbody><tr><td>Egocentric camera</td><td>GoPro Inc., CA, USA</td><td>GoPro Hero 4 and 5</td><td>A camera that records from a first-person angle.</td></tr><tr><td>Battery chager and batteries</td><td>GoPro Inc., CA, USA</td><td>MAX Dual Battery Charger + Battery</td><td>Extra batteries for the camera and battery charger</td></tr><tr><td>Camera charger</td><td>GoPro Inc., CA, USA</td><td>Supercharger</td><td>This charger is connected to the camera directly without disassembling the camera frame.</td></tr><tr><td>Camera frame</td><td>GoPro Inc., CA, USA</td><td>The Frame</td><td>The hinge of the camera frame can be used to adjust the angle of view of the camera.</td></tr><tr><td>Headband for the camera</td><td>GoPro Inc., CA, USA</td><td>Head Strap + QuickClip</td><td></td></tr><tr><td>SD card</td><td>SanDisk, CA, USA</td><td>32GB microSD</td><td></td></tr><tr><td>Tablet</td><td>ASUSTeK Computer Inc., Taiwan</td><td>ZenPad 8.0 Z380M</td><td>The tablet is installed with the GoPro App in order to connect with the camera.</td></tr></tbody></table>

capturing representative hand use at home using egocentric video in individuals with upper limb impairment

신경 손상 후 손상 된 손 기능 독립성과 삶의 질에 큰 영향을 미칠 수 있습니다. 대부분의 기존 상반신 평가는 직접 수행되며, 이는 항상 지역 사회에서 손 사용을 나타내는 것은 아닙니다. 재활 개입의 진정한 영향을 측정하기 위해서는 일상 생활에서 손 기능을 포착하기 위한 새로운 접근법이 필요합니다. 자동화된 분석을 위한 컴퓨터 비전과 결합된 자기 중심 비디오는 가정에서 손 사용을 평가하기 위해 제안되었습니다. 그러나 연속 녹음 기간에는 제한이 있습니다. 획득한 동영상이 참가자의 프라이버시를 존중하면서 일상을 대표하도록 설계된 프로토콜을 제시합니다. 
대표적인 기록 일정은 연구자와 참가자 간의 협업 프로세스를 통해 선택되어 비디오가 자연스러운 작업과 성능을 포착할 수 있도록 하는 동시에 손 평가에 유용합니다. 장비 및 절차의 사용은 참가자에게 입증됩니다. 총 3h의 비디오 녹화가 2주 동안 예정되어 있습니다. 개인 정보 보호 문제를 줄이기 위해 참가자는 녹화를 시작하고 중지할 수 있는 모든 권한을 가지며, 이를 연구팀으로 되돌리기 전에 동영상을 편집할 수 있습니다. 미리 알림이 제공되며 필요한 경우 전화 및 가정 방문을 도와줍니다. 
이 프로토콜은 9명의 뇌졸중 생존자와 자궁 경부 척수 손상을 입은 14명의 개인으로 테스트되었습니다. 입수한 동영상에는 식사 준비, 식기 세척, 뜨개질 등 다양한 활동이 포함되어 있습니다. 평균 3.11 ± 0.98 h의 비디오가 입수되었습니다. 기록 기간은 질병이나 예기치 않은 사건으로 인해 12-69 d에서 다양합니다. 23명 중 22명이 데이터를 성공적으로 입수했으며, 6명의 참가자는 가정 기록 기간 동안 조사관의 도움을 받아야 합니다. 이 프로토콜은 신경 학적 부상 후 집에서 손 기능에 대한 귀중한 정보가 포함 된 비디오를 수집하는 데 효과적이었다.

참가자 인구 통계 및 포함 기준 이 연구 결과를 위해 23명의 참가자의 견본은 모집되었습니다: 9 치기 생존자 (6 남자, 3 여자) 및 cSCI를 가진 14명의 개별 (12 남자, 2 여자). 모집된 표본에 대한 요약 인구 통계 학적 및 임상 정보는 표 1에보고된다.
<table border="1" fo:keep-together.within-page="always"><tbody>
<tr>
<td rowspan="2"></td>
			<td rowspan="2...

Watch this Scientific Journal Video about Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment at JoVE.com

Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

프로토콜은 자기 중심의 카메라를 사용하여 일상 생활 중에 손 장애가있는 개인의 자연스러운 손 기능을 캡처하는 것이 좋습니다. 프로토콜의 목표는 집에서 일상 생활의 활동 중에 녹음이 개인의 전형적인 손 사용을 대표하는지 확인하는 것입니다.

팔다리 장애가 있는 개인의 자기 중심 비디오를 사용하여 집에서 대표손 사용 캡처

Impaired hand function after neurological injuries can have a major impact on independence and quality of life. Most existing upper limb assessments are ...

capturing-representative-hand-use-at-home-using-egocentric-video

Research

JoVE Journal

Bioengineering

2.5K 조회수.  University of Toronto. 프로토콜은 자기 중심의 카메라를 사용하여 일상 생활 중에 손 장애가있는 개인의 자연스러운 손 기능을 캡처하는 것이 좋습니다. 프로토콜의 목표는 집에서 일상 생활의 활동 중에 녹음이 개인의 전형적인 손 사용을 대표하는지 확인하는 것입니다.

비디오: Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

Corticospinal Excitability Modulation During Action Observation

This study used the transcranial magnetic stimulation/motor evoked potential (TMS/MEP) technique to pinpoint when the automatic tendency to mirror someone else's action becomes anticipatory simulation of a complementary act. TMS was delivered to the left primary motor cortex corresponding to the hand to induce the highest level of MEP activity from the abductor digiti minimi (ADM; the muscle serving little finger abduction) as well as the first dorsal interosseus (FDI; the muscle serving index finger flexion/extension) muscles. A neuronavigation system was used to maintain the position of the TMS coil, and electromyographic (EMG) activity was recorded from the right ADM and FDI muscles. Producing original data with regard to motor resonance, the combined TMS/MEP technique has taken research on the perception-action coupling mechanism a step further. Specifically, it has answered the questions of how and when observing another person's actions produces motor facilitation in an onlooker's corresponding muscles and in what way corticospinal excitability is modulated in social contexts.

Single-pulse transcranial magnetic stimulation over the primary motor cortex, neuronavigation, and registration of electromyographic activity of hand muscles were used in this study to explore corticospinal excitability while participants were observing action sequences.

행동 관찰 중 코르티코피날 흥분성 변조

This study used the transcranial magnetic stimulation/motor evoked potential (TMS/MEP) technique to pinpoint when the automatic tendency to mirror someone ...

연구

행동분석학

A Structured Rehabilitation Protocol for Improved Multifunctional Prosthetic Control: A Case Study

Advances in robotic systems have resulted in prostheses for the upper limb that can produce multifunctional movements. However, these sophisticated systems require upper limb amputees to learn complex control schemes. Humans have the ability to learn new movements through imitation and other learning strategies. This protocol describes a structured rehabilitation method, which includes imitation, repetition, and reinforcement learning, and aims to assess if this method can improve multifunctional prosthetic control. A left below elbow amputee, with 4 years of experience in prosthetic use, took part in this case study. The prosthesis used was a Michelangelo hand with wrist rotation, and the added features of wrist flexion and extension, which allowed more combinations of hand movements. The participant&#8217;s Southampton Hand Assessment Procedure score improved from 58 to 71 following structured training. This suggests that a structured training protocol of imitation, repetition and reinforcement may have a role in learning to control a new prosthetic hand. A larger clinical study is however required to support these findings.

As prosthetic development moves towards the goal of natural control, harnessing amputees&#8217; inherent ability to learn new motor skills may enable proficiency. This manuscript describes a structured rehabilitation protocol, which includes imitation, repetition, and reinforcement learning strategies, for improved multifunctional prosthetic control.

개선 된 다기능 보철 제어를위한 구조적 재활 프로토콜 : 사례 연구

Advances in robotic systems have resulted in prostheses for the upper limb that can produce multifunctional movements. However, these sophisticated ...

Frame-by-Frame Video Analysis of Idiosyncratic Reach-to-Grasp Movements in Humans

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate objects and tools in our environment. Such behaviors are impaired by many sensorimotor disorders, yet our current understanding of their neural control is far from complete. Current technologies for investigating human reach-to-grasp movements often utilize motion tracking systems that can be expensive, require the attachment of markers or sensors to the hands, impede natural movement and sensory feedback, and provide kinematic output that can be difficult to interpret. While generally effective for studying the stereotypical reach-to-grasp movements of healthy sighted adults, many of these technologies face additional limitations when attempting to study the unpredictable and idiosyncratic reach-to-grasp movements of young infants, unsighted adults, and patients with neurological disorders. Thus, we present a novel, inexpensive, and highly reliable yet flexible protocol for quantifying the temporal and kinematic structure of idiosyncratic reach-to-grasp movements in humans. High speed video cameras capture multiple views of the reach-to-grasp movement. Frame-by-frame video analysis is then used to document the timing and magnitude of pre-defined behavioral events such as movement start, collection, maximum height, peak aperture, first contact, and final grasp. The temporal structure of the movement is reconstructed by documenting the relative frame number of each event while the kinematic structure of the hand is quantified using the ruler or measure function in photo editing software to calibrate 2 dimensional linear distances between two body parts or between a body part and the target. Frame-by-frame video analysis can provide a quantitative and comprehensive description of idiosyncratic reach-to-grasp movements and will enable researchers to expand their area of investigation to include a greater range of naturalistic prehensile behaviors, guided by a wider variety of sensory modalities, in both healthy and clinical populations.

This protocol describes how to use frame-by-frame video analysis to quantify idiosyncratic reach-to-grasp movements in humans. A comparative analysis of reaching in sighted versus unsighted healthy adults is used to demonstrate the technique, but the method can also be applied to the study of developmental and clinical populations.

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate ...

Measuring the Kinematics of Daily Living Movements with Motion Capture Systems in Virtual Reality

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based assessments of IADL are easy to use but prone to subjective bias. Here, we describe a novel virtual reality (VR) test to assess two complex IADL tasks: handling financial transactions and using public transportation. While a participant performs the tasks in a VR setting, a motion capture system traces the position and orientation of the dominant hand and head in a three-dimensional Cartesian coordinate system. Kinematic raw data are collected and converted into &#39;kinematic performance measures,&#39; i.e., motion trajectory, moving distance, and time to completion. Motion trajectory is the path of a particular body part (e.g., dominant hand or head) in space. Moving distance refers to the total distance of the trajectory, and time to completion is how long it took to complete an IADL task. These kinematic measures could discriminate patients with cognitive impairment from healthy controls. The development of this kinematic measuring protocol allows detection of early IADL-related cognitive impairments.

We designed a virtual reality test to assess instrumental activities of daily living (IADL) with a motion capture system. We propose a detailed kinematic analysis to interpret the participant&#39;s various movements, including trajectory, moving distance, and time to completion to evaluate IADL capabilities.

가상 현실에서의 일상 생활 움직임 모션 캡처 시스템의 기구학을 측정

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based ...

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum

The objective analysis of eye movements has a significant history and has been long proven to be an important research tool in the setting of brain injury. Quantitative recordings have a strong capacity to screen diagnostically. Concurrent examinations of the eye and upper limb movements directed toward shared functional goals (e.g., eye-hand coordination) serve as an additional robust biomarker-laden path to capture and interrogate neural injury, including acquired brain injury (ABI). While quantitative dual-effector recordings in 3-D afford ample opportunities within ocular-manual motor investigations in the setting of ABI, the feasibility of such dual recordings for both eye and hand is challenging in pathological settings, particularly when approached with research-grade rigor. Here we describe the integration of an eye tracking system with a motion tracking system intended primarily for limb control research to study a natural behavior. The protocol enables the investigation of unrestricted, three-dimensional (3D) eye-hand coordination tasks. More specifically, we review a method to assess eye-hand coordination in visually guided saccade-to-reach tasks in subjects with chronic middle cerebral artery (MCA) stroke and compare them to healthy controls. Special attention is paid to the specific eye- and limb-tracking system properties in order to obtain high fidelity data from participants post-injury. Sampling rate, accuracy, permissible head movement range given anticipated tolerance and the feasibility of use were several of the critical properties considered when selecting an eye tracker and an approach. The limb tracker was selected based on a similar rubric but included the need for 3-D recording, dynamic interaction and a miniaturized physical footprint. The quantitative data provided by this method and the overall approach when executed correctly has tremendous potential to further refine our mechanistic understanding of eye-hand control and help inform feasible diagnostic and pragmatic interventions within the neurological and rehabilitative practice.&#160;

Cerebral injury can damage both ocular and somatic motor systems. Characterization of motor control post-injury affords biomarkers that assist in disease detection, monitoring, and prognosis. We review a method to measure eye-hand movement control in health and in pathologic incoordination, with look-and-reach paradigms to assess coordination between eye and hand.

눈 손 조화 Incoordination 스펙트럼을 효율적으로 기록

The objective analysis of eye movements has a significant history and has been long proven to be an important research tool in the setting of brain ...

Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will and action (sense of agency; SoA) have been recognized as the basis of our bodily self-consciousness. Previously, the illusory SoO over a fake body part (e.g., rubber hand) was introduced as the rubber hand illusion (RHI). Furthermore, it was determined that one could also evoke a SoA over an object with movements linked to the one&#8217;s prior intention. On the other hand, the postdictivity of our spontaneity implies that it is essentially inseparable whether actions originate from self or others. In other words, our SoA or daily experiences are obtained in such as inseparable scenario. Previous research, however, has maintained the premise that self- and other-origin movements are perceptually distinguishable. Here, we implement a protocol to make these aspects ambiguous for the participants and to estimate whether they can feel SoO and/or SoA and how. To this end, we employ an experiment using virtual reality, under which participants observe virtual fingers moving very slowly (or quickly or not moving) while their own fingers do not move. For evaluation of the illusory SoO, measurements of skin conductance responses against a knife threat are adopted. Additionally, we introduce face-to-face interviews to determine whether the feelings regarding the slow movement match the conventional SoA definition. Our representative results suggest that the SoO is evoked over the hand, and various attitudes to accept its movement as the participant&#8217;s own with awareness that they did not originate it are reported by the majority. As the results show, the novelty of this protocol is discovering that in such a situation, the SoO cooperates with an externally produced SoA to establish one&#8217;s own bodily experience rather than the independence of the SoO and SoA.

While previous research on bodily self-consciousness assumed that self- and other-origin movements were perceptually distinguishable, this protocol allows them to be ambiguous on a virtual hand with unintentional slight movements. This enables us to observe one&#8217;s experience formed by SoO and other-produced SoA, rather than the absence of SoA.

자아와 다른 기원 사이의 모호한 움직임과 가상의 손 : 소유권의 감각과 '다른 생산'기관

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will ...

Kinematic Analysis Using 3D Motion Capture of Drinking Task in People With and Without Upper-extremity Impairments

Kinematic analysis is a powerful method for objective assessment of upper extremity movements in a three-dimensional (3D) space. Three-dimensional motion capture with an optoelectronic camera system is considered as golden standard for kinematic movement analysis and is increasingly used as outcome measure to evaluate the movement performance and quality after an injury or disease involving upper extremity movements. This article describes a standardized protocol for kinematic analysis of drinking task applied in individuals with upper extremity impairments after stroke. The drinking task incorporates reaching, grasping and lifting a cup from a table to take a drink, placing the cup back, and moving the hand back to the edge of the table. The sitting position is standardized to the individual&#39;s body size and the task is performed in a comfortable self-paced speed and compensatory movements are not constrained. The intention is to keep the task natural and close to a real-life situation to improve the ecological validity of the protocol. A 5-camera motion capture system is used to gather 3D coordinate positions from 9 retroreflective markers positioned on anatomical landmarks of the arm, trunk, and face. A simple single marker placement is used to ensure the feasibility of the protocol in clinical settings. Custom-made Matlab software provides automated and fast analyses of movement data. Temporal kinematics of movement time, velocity, peak velocity, time of peak velocity, and smoothness (number of movement units) along with spatial angular kinematics of shoulder and elbow joint as well as trunk movements are calculated. The drinking task is a valid assessment for individuals with moderate and mild upper extremity impairment. The construct, discriminative and concurrent validity along with responsiveness (sensitivity to change) of the kinematic variables obtained from the drinking task have been established.

This protocol describes an objective method to evaluate the movement performance and sensorimotor function of the upper extremity applied to individuals with stroke and healthy controls. A standardized test procedure, kinematic analysis and outcome variables for three-dimensional motion capture of drinking task are provided.

Kinematic analysis is a powerful method for objective assessment of upper extremity movements in a three-dimensional (3D) space. Three-dimensional motion ...

신경과학

Development of a Novel Task-oriented Rehabilitation Program using a Bimanual Exoskeleton Robotic Hand

A robot-assisted hand is used for the rehabilitation of patients with impaired upper limb function, particularly for stroke patients with a loss of motor control. However, it is unclear how conventional occupational training strategies can be applied to the use of rehabilitation robots. Novel robotic technologies and occupational therapy concepts are used to develop a protocol that allows patients with impaired upper limb function to grasp objects using their affected hand through a variety of pinching and grasping functions. To conduct this appropriately, we used five types of objects: a peg, a rectangular cube, a cube, a ball, and a cylindrical bar. We also equipped the patients with a robotic hand, the Mirror Hand, an exoskeleton&#160;hand that is fitted to the subject&#8217;s affected hand and follows the movement of the sensor glove fitted to their unaffected hand (bimanual movement training (BMT)). This study had two stages. Three healthy subjects were first recruited to test the feasibility and acceptability of the training program. Three patients with hand dysfunction caused by stroke were then recruited to confirm the feasibility and acceptability of the training program, which was conducted on 3 consecutive days. On each day, the patient was monitored during 5 min of movement in a passive range of motion, 5 min of robot-assisted bimanual movement, and task-oriented training using the five objects. The results showed that both healthy subjects and subjects who had suffered a stroke in conjunction with the robotic hand could successfully grasp the objects. Both healthy subjects and those who had suffered a stroke performed well with the robot-assisted task-oriented training program in terms of feasibility and acceptability.

This study reports the development of a novel robot-assisted task-oriented program for hand rehabilitation. The developmental process consists of experiments using both healthy subjects and subjects who have had a stroke and suffered from subsequent motor control dysfunction.

바이매뉴얼 외골격 로봇 핸드를 이용한 새로운 과제 지향 재활 프로그램 개발

A robot-assisted hand is used for the rehabilitation of patients with impaired upper limb function, particularly for stroke patients with a loss of motor ...

의학

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Finger gestures are a critical element in human communication, and as such, finger gesture recognition is widely studied as a human-computer interface for state-of-the-art prosthetics and optimized rehabilitation. Surface electromyography (sEMG), in conjunction with deep learning methods, is considered a promising method in this domain. However, current methods often rely on cumbersome recording setups and the identification of static hand positions, limiting their effectiveness in real-world applications. The protocol we report here presents an advanced approach combining a wearable surface EMG and finger&#160;tracking system to capture comprehensive data during dynamic hand movements. The method records muscle activity from soft printed electrode arrays (16 electrodes) placed on the forearm as subjects perform gestures in different hand positions and during movement. Visual instructions prompt subjects to perform specific gestures while EMG and finger positions are recorded. The integration of synchronized EMG recordings and finger tracking data enables comprehensive analysis of muscle activity patterns and corresponding gestures. The reported approach demonstrates the potential of combining EMG and visual tracking technologies as an important resource for developing intuitive and responsive gesture recognition systems with applications in prosthetics, rehabilitation, and interactive technologies. This protocol aims to guide researchers and practitioners, fostering further innovation and application of gesture recognition in dynamic and real-world scenarios.

The paper presents a comprehensive protocol for simultaneously recording hand-electromyography (EMG) and visual finger tracking during natural finger gesturing. The visual data is designed to serve as the ground truth for the development of accurate EMG-based computational models for finger gesture recognition.

고해상도 표면 근전도 및 컴퓨터 비전을 사용한 동적 손가락 제스처 캡처

Finger gestures are a critical element in human communication, and as such, finger gesture recognition is widely studied as a human-computer interface for ...

생체공학

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients

This study introduces a Brain-Computer Interface (BCI)-controlled upper limb assistive robot for post-stroke rehabilitation. The system utilizes electroencephalogram (EEG) and electrooculogram (EOG) signals to help users assist upper limb function in everyday tasks while interacting with a robotic hand. We evaluated the effectiveness of this BCI-robot system using the Berlin Bimanual Test for Stroke (BeBiTS), a set of 10 daily living tasks involving both hands. Eight stroke patients participated in this study, but only four participants could adapt to the BCI robot system training and perform the postBeBiTS. Notably, when the preBeBiTS score for each item was four or less, the BCI robot system showed greater assistive effectiveness in the postBeBiTS assessment. Furthermore, our current robotic hand does not assist with arm and wrist functions, limiting its use in tasks requiring complex hand movements. More participants are required to confirm the training effectiveness of the BCI-robot system, and future research should consider using robots that can assist with a broader range of upper limb functions. This study aimed to determine the BCI-robot system's ability to assist patients in performing daily living activities.

This study introduces a brain-computer interface (BCI) system for stroke patients, which combines electroencephalography and electrooculography signals to control an upper limb robotic hand, enhancing daily activities. The evaluation used the Berlin Bimanual Test for Stroke (BeBiTS).