基于Dempster-Shafer理论的多光谱行人检测模型

    Multispectral pedestrian detection model based on Dempster-Shafer theory

    • 摘要: 多光谱行人检测模型通过融合可见光和红外图像的互补信息,增强检测的鲁棒性和可靠性,但如何有效融合不同模态信息以减少漏检率是多光谱行人检测目前面临的一个挑战。为解决上述问题,提出了一种基于Dempster-Shafer理论的多光谱行人检测模型。首先,设计了一种多尺度跨模态同质特征增强模块来增强各模态的特征;然后,引入Dirichlet分布建模行人检测的不确定性,从而提高检测的准确性;最后,利用Dempster-Shafer证据理论对多模态检测结果进行可信集成,以降低受损模态对检测结果的影响。实验结果表明,该模型在KAIST数据集上的性能优于现有的多光谱行人检测模型,在all-day、day和night 3个主要子集上的对数平均漏检率(log-average miss rate, MR−2) 分别较次优算法提高了1.84%、1.23%和2.16%。

       

      Abstract: Multispectral pedestrian detection models use complementary enhancement of visible and infrared images to improve robustness and reliability. However, effectively fusing different modal information to reduce the leakage rate remains a challenge in multispectral pedestrian detection. To address this, we proposed a multispectral pedestrian detection model based on Dempster-Shafer theory. First, a multi-scale cross-modal homogeneous feature enhancement model was designed to enhance the features of a single modality.Then, the Dirichlet distribution was used to characterize the uncertainty of pedestrian detection, thus improving the accuracy of detection. Finally, the detection results of multiple modalities were credibly integrated using the Dempster-Shafer evidence theory, which could reduce the impact of damaged modalities on the detection results. The experimental results show that the performance of the proposed model on the KAIST dataset is better than that of the existing multi-spectral pedestrian detection model, and the log-average miss rate (MR−2) on the 3 major subsets of all-day, day and night is 1.84%, 1.23% and 2.16% higher than that of the suboptimal algorithm, respectively.

       

    /

    返回文章
    返回