西安电子科技大学学报 ›› 2020, Vol. 47 ›› Issue (2): 1-8.doi: 10.19665/j.issn1001-2400.2020.02.001

• •    下一篇

一种多路视频的360度实时拼接技术

黄樟钦,母召(),岑陈,高寒   

  1. 北京工业大学 北京市物联网软件与系统工程技术研究中心,北京 100124
  • 收稿日期:2019-10-21 出版日期:2020-04-20 发布日期:2020-04-16
  • 通讯作者: 母召
  • 作者简介:黄樟钦(1965—),男,教授,E-mail:huang@bjut.edu.cn

360-degree real-time stitching technology for multi-channel video

HUANG Zhangqin,MU Zhao(),CEN Chen,GAO Han   

  1. Beijing Engineering Research Center for IoT Software and System,Beijing University of Technology, Beijing 100124, China
  • Received:2019-10-21 Online:2020-04-20 Published:2020-04-16
  • Contact: Zhao MU

摘要:

针对视频拼接实现过程中图像配准阶段耗时较大的问题,设计出一种基于二进制鲁棒尺度不变性特征算法与运动统计算法的组合式图像配准算法。在二进制鲁棒尺度不变性特征算法快速特征提取特性的基础上,利用网格化方法对重叠区域图像进行划分,使特征点分布更加均匀,从而减少需要操作的特征点数量以提高速率;在匹配环节, 利用运动统计算法剔除误匹配对,利用双向匹配策略提高匹配准确率。为使图像融合的更加自然流畅,设计出一种区域化的渐入渐出加权融合算法:为减少求解重叠区域存在的误差,构建融合区域并进行区域化划分,利用最佳缝合线法求得拼接缝,在不同区域使用渐入渐出加权算法实现图像融合,从而获取融合质量更高的全景图像。最后,设计出完整的全景视频拼接系统,通过实验验证了系统方案的可行性和实用性。实验证明,相对于传统的视频拼接技术,新算法在消除拼接时出现的重影和接缝问题的同时,保证了视频拼接的实时性。

关键词: 全景视频拼接, 图像配准, 图像融合

Abstract:

Aiming at the time-consuming problem of image registration in video mosaic, a combined algorithm based on the BRISK and GMS is designed and optimized. Based on the fast feature extraction feature of the BRISK, the grid image method is used to divide the overlap region image to make the feature point distribution more uniform, thus reducing the number of feature points that need to be operated. In the feature matching stage after feature extraction, the GMS is used to eliminate the mismatching pair, and improves the matching accuracy according to the two-way matching strategy. In order to make the image fusion more natural and smooth, this paper designs a regionalized feather blending weighted fusion algorithm. To reduce the error in solving the overlapping area, the fusion area is constructed and divided into regions. The best suture method is used to get the seam. The gradual in and out weighting algorithm is used in different regions to achieve image fusion, so as to obtain the panoramic image with higher fusion quality. Finally, a complete prototype of the panoramic video stitching system is designed. The feasibility and practicability of the system scheme are verified by experiments which show that, compared with the traditional video splicing technology, this algorithm ensures the real-time performance of video splicing while eliminating the ghosting and seaming problems that occur during splicing.

Key words: panoramic video stitching, image registration, image fusion

中图分类号: 

  • TP391.41