Electronic Science and Technology ›› 2023, Vol. 36 ›› Issue (10): 95-102.doi: 10.16180/j.cnki.issn1007-7820.2023.10.013

Previous Articles    

Deep Completion Based on Multi-Source Data Association Fusion

WANG Ge,YANG Ruihua,XI Wei,ZHAO Jizhong   

  1. School of Computer Science and Technology,Xi'an Jiaotong University,Xi'an 710049,China
  • Received:2022-07-16 Online:2023-10-15 Published:2023-10-20
  • Supported by:
    National Key R&D Program of China(2020YFB2104000)

Abstract:

With the acceleration of urbanization, the intelligent transportation has received more and more attention. Among them, the use of depth completion technology to extract the depth information of objects plays an important role in the realization of vehicle target tracking, distance calculation between targets and other tasks. However, multi-source depth completion data collected in practice often have correlation bias, resulting in knotty errors. In this regard, this study studies the depth completion technology based on multi-source data association fusion. The proposed technology enhances the depth map by calculating multi-channel confidence, and performs more accurate point-by-point correlation between the image and the millimeter-wave radar point cloud data. By designing a multi-scale attention fusion module, the adaptive fusion of multi-granularity associated data is realized to generate high-quality depth maps. In this study, a large number of experiments have been carried out in the public nuScenes data set. The experimental results show that the mean absolute error of our method is 1.142 m, which is lower than the 1.472 m of the existing benchmark method.

Key words: intelligent transportation, multi-source data fusion, depth completion, deep learning, attention mechanism, adaptive combination

CLC Number: 

  • TP391