Electronic Science and Technology ›› 2022, Vol. 35 ›› Issue (4): 28-34.doi: 10.16180/j.cnki.issn1007-7820.2022.04.005

Previous Articles     Next Articles

Design of Biological Behavior Analysis System Based on Vision and IMU Sensors

Sunyun YANG,Xiu KAN   

  1. School of Electronic and Electrical Engineering,Shanghai University of Engineering Science, Shanghai 201620,China
  • Received:2020-11-20 Online:2022-04-15 Published:2022-04-15
  • Supported by:
    National Natural Science Foundation of China(61803255)


In order to solve the problem that the digital image processing technology alone cannot detect and analyze the behavior of mice in behavioral experiments, a biological behavior detection method based on the combination of image and IMU sensor is proposed in this study. In Python programming environment, this method uses digital image processing technology to detect and track the motion video of mice, and obtain the motion behavior parameters of mice. Meanwhile, the wireless bluetooth micro IMU sensor designed by the laboratory is used to measure the three-axis acceleration, three-axis angular velocity and three-axis magnetic force of mice. The extended Kalman filter algorithm is used to solve the measured data to obtain the posture and other posture change information of mice. The experimental results show that the system can automatically analyze the motor behavior and posture information of mice, and can display the behavior information on the interface of biological behavior analysis system in real time.

Key words: mice, behavioral experiment, digital image processing technology, motor behavior parameters, IMU sensor, extended Kalman filtering, attitude information, real-time display

CLC Number: 

  • TP212.9