TY - GEN
T1 - Feasibility of Categorizing Rehabilitation Gestures for Automated Fidelity Assessment on Strategy Training using Deep Learning
AU - Osterhoudt, Hunter
AU - Ching, Liann
AU - Shih, Minmei
AU - Schneider, Courtney E.
AU - Harper, Alexandra E.
AU - Mohammad, Haneef A.
AU - Skidmore, Elizabeth R.
AU - Wang, Yanshan
AU - Zhou, Leming
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - One-third to half of people with acute stroke result in newly acquired cognitive impairments. Stroke-related cognitive impairments are associated with significant functional disability. Strategy training is an intervention designed to reduce this type of disability. Randomized controlled clinical trials demonstrated the feasibility and efficacy of this intervention. To measure adherence to treatment principles of strategy training, a fidelity assessment can be performed by examining guided and directed verbal and gesture cues made by therapists in video recordings of rehabilitation sessions. One major challenge of this fidelity assessment is that the manual procedure is labor intensive, time consuming, and expensive when it is applied in a large scale. To address this challenge, in one earlier study, we leveraged natural language processing techniques to automatically identify guided and directed verbal cues from the transcripts of recorded rehabilitation sessions. The current work evaluates the feasibility for using deep learning to automatically identify guided and directed therapists' gestures from recorded videos. The results can be used to guide the design for future study in this area.
AB - One-third to half of people with acute stroke result in newly acquired cognitive impairments. Stroke-related cognitive impairments are associated with significant functional disability. Strategy training is an intervention designed to reduce this type of disability. Randomized controlled clinical trials demonstrated the feasibility and efficacy of this intervention. To measure adherence to treatment principles of strategy training, a fidelity assessment can be performed by examining guided and directed verbal and gesture cues made by therapists in video recordings of rehabilitation sessions. One major challenge of this fidelity assessment is that the manual procedure is labor intensive, time consuming, and expensive when it is applied in a large scale. To address this challenge, in one earlier study, we leveraged natural language processing techniques to automatically identify guided and directed verbal cues from the transcripts of recorded rehabilitation sessions. The current work evaluates the feasibility for using deep learning to automatically identify guided and directed therapists' gestures from recorded videos. The results can be used to guide the design for future study in this area.
KW - action recognition
KW - machine learning
KW - rehabilitation training
KW - video annotation
UR - http://www.scopus.com/inward/record.url?scp=85181569857&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85181569857&partnerID=8YFLogxK
U2 - 10.1109/ICHI57859.2023.00088
DO - 10.1109/ICHI57859.2023.00088
M3 - Conference contribution
AN - SCOPUS:85181569857
T3 - Proceedings - 2023 IEEE 11th International Conference on Healthcare Informatics, ICHI 2023
SP - 513
EP - 515
BT - Proceedings - 2023 IEEE 11th International Conference on Healthcare Informatics, ICHI 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 11th IEEE International Conference on Healthcare Informatics, ICHI 2023
Y2 - 26 June 2023 through 29 June 2023
ER -