Electronic Science and Technology ›› 2020, Vol. 33 ›› Issue (11): 79-83.doi: 10.16180/j.cnki.issn1007-7820.2020.11.015

Previous Articles     Next Articles

Human Skeleton-based Action Recognition Based on Deep Learning

WU Qian,WU Fei,LUO Lizhi   

  1. School of Electronic and Electrical Engineering,Shanghai University of Engineering Science,Shanghai 201620,China
  • Received:2019-07-31 Online:2020-11-15 Published:2020-11-27
  • Supported by:
    National Natural Science Foundation of China(61272097);Key Projects of Shanghai Science and Technology Academic Committee(18511101600)


Based on the advantages of robustness and view-invariant representation, a skeleton-based action recognition algorithm combining geometric features with LSTM network is proposed to further improve the recognition rate and to break the limitation that the inputs of most methods based on deep learning are human joint coordinates. The geometric features based on the distances between joints and selected lines are selected as the input of the network. Then, time-selective LSTM network is introduced to train. Time selection LSTM network has the ability to select the most recognizable time period features. By using this feature, 99.36% and 99.20% recognition rates are achieved on SBU Interaction dataset and UT Kinect dataset, respectively. The experimental results show that the method is effective for human skeleton-based action recognition.

Key words: action recognition, human skeleton, deep learning, geometric features, time selective modal, Long Short-term Memory networks

CLC Number: 

  • TP391