TY - GEN
T1 - Dynamic gesture design and recognition for human-robot collaboration with convolutional neural networks
AU - Chen, Haodong
AU - Tao, Wenjin
AU - Leu, Ming C.
AU - Yin, Zhaozheng
N1 - Publisher Copyright:
Copyright © 2020 ASME
PY - 2020
Y1 - 2020
N2 - Human-robot collaboration (HRC) is a challenging task in modern industry and gesture communication in HRC has attracted much interest. This paper proposes and demonstrates a dynamic gesture recognition system based on Motion History Image (MHI) and Convolutional Neural Networks (CNN). Firstly, ten dynamic gestures are designed for a human worker to communicate with an industrial robot. Secondly, the MHI method is adopted to extract the gesture features from video clips and generate static images of dynamic gestures as inputs to CNN. Finally, a CNN model is constructed for gesture recognition. The experimental results show very promising classification accuracy using this method.
AB - Human-robot collaboration (HRC) is a challenging task in modern industry and gesture communication in HRC has attracted much interest. This paper proposes and demonstrates a dynamic gesture recognition system based on Motion History Image (MHI) and Convolutional Neural Networks (CNN). Firstly, ten dynamic gestures are designed for a human worker to communicate with an industrial robot. Secondly, the MHI method is adopted to extract the gesture features from video clips and generate static images of dynamic gestures as inputs to CNN. Finally, a CNN model is constructed for gesture recognition. The experimental results show very promising classification accuracy using this method.
KW - Convolutional Neural Networks
KW - Dynamic gesture recognition
KW - Human-robot collaboration
KW - Motion History Image
UR - https://www.scopus.com/pages/publications/85092643322
U2 - 10.1115/ISFA2020-9609
DO - 10.1115/ISFA2020-9609
M3 - Conference contribution
AN - SCOPUS:85092643322
T3 - 2020 International Symposium on Flexible Automation, ISFA 2020
BT - 2020 International Symposium on Flexible Automation, ISFA 2020
PB - American Society of Mechanical Engineers (ASME)
T2 - 2020 International Symposium on Flexible Automation, ISFA 2020
Y2 - 8 July 2020 through 9 July 2020
ER -