Electronic Science and Technology ›› 2021, Vol. 34 ›› Issue (3): 28-36.doi: 10.16180/j.cnki.issn1007-7820.2021.03.006

Previous Articles     Next Articles

Circuit and System Design for Assisting Virtual Reality with Data Glove and Electric Stimulation Tactile Enhancement Feedback

LI Zhaoji1,WANG Haipeng1,2,RUAN Weihua1,HUANG Shuhao1   

  1. 1. School of Electronic and Information Engineering,Sanjiang University,Nanjing 210012,China
    2. Institute of RF&OE-ICs, Southeast University,Nanjing 210096,China
  • Received:2019-12-04 Online:2021-03-15 Published:2021-03-10
  • Supported by:
    National Natural Science Foundation of China(61801262);The Natural Science Foundation of the Jiangsu Higher Education Institutions of China(18KJB510039)


In view of the shortcomings of low accuracy, large size, and poor wearability of current virtual reality human-machine interaction devices, this study proposes a new type of assisted VR device for gesture recognition and virtual reality human-machine interaction. The system includes a glove consisting of a set of flex sensors and a nine-axis motion attitude sensor, and a wrist strap based on functional electrical stimulation. The data glove system transmits the data through wireless communication and these data is calculated in the attitude program algorithm on the computer. The results are used to control the hand posture constructed in VR scene in real time. The collision algorithm in the VR scene is adaopted to predict the force haptic value generated by the hand colliding with the object in the scene. Finally, the wireless transmission to the FES stimulation wristband generates different levels of stimulation pulses to assist in completing the force and tactile control of the hand, thereby achieving the effect of human-computer interaction. The measured experimental results show that the average recognition accuracy of a single finger of 5 healthy volunteers is 94.7%±1.3%. The FES wristband can provide a current output of 0~30 mA and a wrist joint strength control with a maximum torque of 1.8 N·m, and the action delay time is 20 ms.

Key words: gesture recognition, virtual reality, functional electrical stimulation, data glove, rehabilitation, tactile enhancement feedback

CLC Number: 

  • TN911.7