无人机载昼夜单通道自然感彩色热成像技术

UAV day and night single channel natural sensing color thermal imaging technology

  • 摘要: 为提高无人机在复杂环境下的环境感知和目标识别能力,探索无人机载昼夜单通道自然感彩色热成像技术。基于深度学习技术,构建了两种图像彩色化技术:基于多判别器生成对抗网络的红外图像彩色化网络TIVNet、基于区域自分割的语义引导扩散模型的红外图像彩色化网络RSDM。TIVNet通过多判别器的生成对抗网络结构能够将红外热成像直接转化为类似彩色可见光图像,但在部分场景细节部分色彩存在错误。语义引导扩散模型网络RSDM通过更复杂的模型生成更加真实的彩色图像,增强了图像的视觉效果和信息传递效率,但目前处理速度还有待提高。实验结果表明,所提出的两种方法在图像转换的逼真度和实时速率方面都各自具有显著优势,TIVNet在无人机平台的实验测试中,达到了不低于40 Hz的实时处理速度,同时保持高视觉逼真度,证明了技术的可行性,并具备针对应用需求开展装备转换应用的能力,为无人机在军事和民用领域的应用提供了新的技术手段。

     

    Abstract: To enhance the environmental perception and target recognition capabilities of unmanned aerial vehicles in complex environments, the exploration of unmanned aerial vehicles mounted day-and-night single-channel natural-sensing color thermal imaging technology is undertaken. Based on deep learning technology, two image colorization techniques have been constructed: the TIVNet, an infrared image colorization network based on a multi-discriminator generative adversarial network, and the infrared image colorization network based on the semantic-guided diffusion model with regional self-segmentation RSDM. TIVNet employs a generative adversarial network architecture with multiple discriminators to directly convert infrared thermal images into colorized visible-light-like images. However, there are instances where color inaccuracies are observed in the detailed aspects of certain scenes. RSDM generates more realistic color images through a more sophisticated model, enhancing the visual impact and efficiency of information transmission in images. However, the processing speed of the current model still requires improvement. Experimental results indicate that the two proposed methods each possess distinct advantages in terms of the fidelity of image conversion and real-time processing rate. TIVNet has achieved real-time processing at a rate of not less than 40 Hz on platforms such as UAVs, demonstrating the technical feasibility. Moreover, it possesses the capability to facilitate equipment transformation applications based on specific application requirements, thereby providing a novel technological means for the application of UAVs in both military and civilian domains.

     

/

返回文章
返回