Review the state-of-the-art technologies of semantic segmentation based on deep learning

Y Mo, Y Wu, X Yang, F Liu, Y Liao - Neurocomputing, 2022 - Elsevier
The goal of semantic segmentation is to segment the input image according to semantic
information and predict the semantic category of each pixel from a given label set. With the …

Visible and infrared image fusion using deep learning

X Zhang, Y Demiris - IEEE Transactions on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Visible and infrared image fusion (VIF) has attracted a lot of interest in recent years due to its
application in many tasks, such as object detection, object tracking, scene segmentation …

SuperFusion: A versatile image registration and fusion network with semantic awareness

L Tang, Y Deng, Y Ma, J Huang… - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
Image fusion aims to integrate complementary information in source images to synthesize a
fused image comprehensively characterizing the imaging scene. However, existing image …

Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and …

L Tang, H Zhang, H Xu, J Ma - Information Fusion, 2023 - Elsevier
Image fusion aims to integrate complementary characteristics of source images into a single
fused image that better serves human visual observation and machine vision perception …

SwinFusion: Cross-domain long-range learning for general image fusion via swin transformer

J Ma, L Tang, F Fan, J Huang, X Mei… - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
This study proposes a novel general image fusion framework based on cross-domain long-
range learning and Swin Transformer, termed as SwinFusion. On the one hand, an attention …

Multi-interactive feature learning and a full-time multi-modality benchmark for image fusion and segmentation

J Liu, Z Liu, G Wu, L Ma, R Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Multi-modality image fusion and segmentation play a vital role in autonomous driving and
robotic operation. Early efforts focus on boosting the performance for only one task, eg …

PIAFusion: A progressive infrared and visible image fusion network based on illumination aware

L Tang, J Yuan, H Zhang, X Jiang, J Ma - Information Fusion, 2022 - Elsevier
Infrared and visible image fusion aims to synthesize a single fused image containing salient
targets and abundant texture details even under extreme illumination conditions. However …

Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network

L Tang, J Yuan, J Ma - Information Fusion, 2022 - Elsevier
Infrared and visible image fusion aims to synthesize a single fused image that not only
contains salient targets and abundant texture details but also facilitates high-level vision …

CMX: Cross-modal fusion for RGB-X semantic segmentation with transformers

J Zhang, H Liu, K Yang, X Hu, R Liu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Scene understanding based on image segmentation is a crucial component of autonomous
vehicles. Pixel-wise semantic segmentation of RGB images can be advanced by exploiting …

Delivering arbitrary-modal semantic segmentation

J Zhang, R Liu, H Shi, K Yang, S Reiß… - Proceedings of the …, 2023 - openaccess.thecvf.com
Multimodal fusion can make semantic segmentation more robust. However, fusing an
arbitrary number of modalities remains underexplored. To delve into this problem, we create …