Electronic Science and Technology ›› 2022, Vol. 35 ›› Issue (9): 52-57.doi: 10.16180/j.cnki.issn1007-7820.2022.09.008

Previous Articles     Next Articles

Glasses Virtual Try-on System Based on 3D Frame Modeling

ZHANG Xindong,FU Dongxiang   

  1. School of Optical-Electrical and Computer Engineering,University of Shanghai forScience and Technology,Shanghai 200093,China
  • Received:2021-03-26 Online:2022-09-15 Published:2022-09-15
  • Supported by:
    National Natural Science Foundation of China(61605114);National Natural Science Foundation of China(61703277)


In the virtual try-on system, virtual glasses need to be superimposed on the face image accurately, which determines the experience of the virtual try-on system. The key technology is to construct a real glasses model and quickly and accurately estimate the 3D face pose of the image. In response to this technical requirement, a virtual try-on technology combining 3D mirror frame modeling and head space pose estimation based on facial feature detection is proposed and a virtual try-on system is implemented. First, the method uses ERT cascade regression to locate the facial feature points of the face images. Then, the VTK visualization tool is adopted to construct a 3D mirror frame, and the processed mirror frame image is accurately fused to the face image according to the information of the face feature points and the rotation information of the head. Finally, the accuracy of the pose estimation method is tested using the AFLW data set. The results show that the algorithm has high precision and fast speed. It can still quickly and accurately realize three-dimensional and multi-angle virtual try-on under complicated conditions of large angles, many background interferences and poor light conditions, which basically meets the requirements of virtual try-on technology.

Key words: face feature points, pose estimation, Euler angle, 3D mirror frame modeling, ERT cascade regression, VTK visualization tool, blanking, images synthesis, multi-angle virtual trial

CLC Number: 

  • TP391