基于环境光感知和红外特征分层引导的图像融合网络
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家自然科学基金项目(62406342);辽宁自然科学基金项目(2024-BS-260);上海市法医学重点实验室暨司法部司法鉴定重点实验室开放课题项目(KF202415).


An image fusion network based on ambient light awareness and infrared feature layer guidance
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    在红外图像中, 目标物体的突出显示与可见光图像中丰富的纹理细节相结合, 可以有效地增强融合图像的信息熵, 从而为夜间智能驾驶等下游视觉任务提供重要支持. 然而, 现有的主流融合算法对于可见光图像在恶劣光照夜间道路环境下的信息熵低与像素强度高之间的矛盾, 尚缺乏针对性的研究. 因此, 在正常环境下表现良好的融合算法, 在强光干扰下只能生成与可见光图像相似、信息熵较低的融合图像. 对此, 提出一种能够抵抗恶劣光照环境干扰的图像融合网络, 结合信息熵和信息论原理, 增强图像融合的鲁棒性和信息保留能力. 首先, 设计一个在正常光照条件下具备高鲁棒性和优异性能的图像融合网络, 在该融合网络的基础上设计一个环境光感知模块, 以便在极端光照条件下对低信息熵的可见光图像的特征权重进行分析. 然后, 设计一个红外边缘特征分层引导融合模块, 以充分提取红外图像中的有效特征信息. 实验结果表明, 该融合网络能够在夜间恶劣光照条件下充分利用可见光和红外图像的特征信息, 显著提高这种情况下融合图像的质量. 与其他主流算法相比, 所提出方法生成的融合结果包含了更丰富和更有效的信息.

    Abstract:

    In infrared images, the prominent display of target objects combined with the rich texture details in visible light images can effectively enhance the information entropy of the fused image, thereby providing important support for downstream visual tasks such as nighttime intelligent driving. However, existing mainstream fusion algorithms lack targeted research on the contradiction between the low information entropy and high pixel intensity of visible light images under adverse nighttime road lighting conditions. Therefore, fusion algorithms that perform well under normal conditions often can only generate fused images that are similar to visible light images and have low information entropy under strong light interference. To address this issue, this paper proposes an image fusion network capable of resisting interference from adverse lighting environments, combining information entropy and principles of information theory to enhance the robustness and information retention capability of image fusion. Specifically, we first design an image fusion network with high robustness and excellent performance under normal lighting conditions. Based on this fusion network, we introduce an ambient light perception module to analyze the feature weights of low-information-entropy visible light images under extreme lighting conditions. Additionally, we design an infrared edge feature hierarchical guided fusion module to fully extract effective feature information from infrared images. Experimental results show that this fusion network can fully utilize the feature information of visible and infrared images under adverse nighttime lighting conditions, significantly improving the quality of fused images in such scenarios. Compared with other mainstream algorithms, the fusion results generated by this method contain richer and more effective information.

    参考文献
    相似文献
    引证文献
引用本文

王爱侠,胡傲杰,闫爱云,等.基于环境光感知和红外特征分层引导的图像融合网络[J].控制与决策,2025,40(10):3177-3189

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-11-29
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2025-09-09
  • 出版日期: 2025-10-20
文章二维码