Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DenseFuse: A Fusion Approach to Infrared and Visible Images

About

In this paper, we present a novel deep learning architecture for infrared and visible images fusion problem. In contrast to conventional convolutional networks, our encoding network is combined by convolutional layers, fusion layer and dense block in which the output of each layer is connected to every other layer. We attempt to use this architecture to get more useful features from source images in encoding process. And two fusion layers(fusion strategies) are designed to fuse these features. Finally, the fused image is reconstructed by decoder. Compared with existing fusion methods, the proposed fusion method achieves state-of-the-art performance in objective and subjective assessment. Code and pre-trained models are available at https://github.com/hli1221/imagefusion_densefuse

Hui Li, Xiao-Jun Wu• 2018

Related benchmarks

TaskDatasetResultRank
Semantic segmentationMSRS
mIoU65.45
120
Visible-Infrared Image FusionMSRS (test)
Average Gradient (AG)2.05
55
Infrared-Visible Image FusionRoadScene (test)--
53
Infrared-Visible Image FusionLLVIP (test)
EN6.83
48
Object DetectionM3FD dataset
mAP@0.578.3
48
Infrared and Visible Image FusionTNO image fusion
MI (Mutual Information)2.302
30
Object DetectionM3FD Night
mAP@0.50.806
22
Object DetectionM3FD (Overcast)
mAP@0.575.9
22
Medical image fusionMRI-SPECT
Structural Fidelity (SF)10.74
20
Object DetectionM3FD (Day)
AP5060.8
16
Showing 10 of 17 rows

Other info

Follow for update