Patch diffusion: Faster and more data-efficient training of diffusion models

Z Wang, Y Jiang, H Zheng, P Wang… - Advances in neural …, 2023 - proceedings.neurips.cc
Diffusion models are powerful, but they require a lot of time and data to train. We propose
Patch Diffusion, a generic patch-wise training framework, to significantly reduce the training …

Exploiting semantic relations for glass surface detection

J Lin, YH Yeung, R Lau - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Glass surfaces are omnipresent in our daily lives and often go unnoticed by the majority of
us. While humans are generally able to infer their locations and thus avoid collisions, it can …

Understanding self-attention mechanism via dynamical system perspective

Z Huang, M Liang, J Qin, S Zhong… - Proceedings of the …, 2023 - openaccess.thecvf.com
The self-attention mechanism (SAM) is widely used in various fields of artificial intelligence
and has successfully boosted the performance of different models. However, current …

Rethinking the pruning criteria for convolutional neural network

Z Huang, W Shao, X Wang, L Lin… - Advances in Neural …, 2021 - proceedings.neurips.cc
Channel pruning is a popular technique for compressing convolutional neural networks
(CNNs), where various pruning criteria have been proposed to remove the redundant filters …

Attentive fine-grained structured sparsity for image restoration

J Oh, H Kim, S Nah, C Hong… - Proceedings of the …, 2022 - openaccess.thecvf.com
Image restoration tasks have witnessed great performance improvement in recent years by
develo** large deep models. Despite the outstanding performance, the heavy …

[HTML][HTML] Filter pruning for convolutional neural networks in semantic image segmentation

CI López-González, E Gascó, F Barrientos-Espillco… - Neural Networks, 2024 - Elsevier
The remarkable performance of Convolutional Neural Networks (CNNs) has increased their
use in real-time systems and devices with limited resources. Hence, compacting these …

[HTML][HTML] Cracklab: A high-precision and efficient concrete crack segmentation and quantification network

Z Yu, Y Shen, Z Sun, J Chen, W Gang - Developments in the Built …, 2022 - Elsevier
A deep learning model named Cracklab for pixel level segmentation and measurement of
concrete cracks is proposed. Cracklab excels at handling cracks at image edges and …

Kill two birds with one stone: Domain generalization for semantic segmentation via network pruning

Y Luo, P Liu, Y Yang - International Journal of Computer Vision, 2024 - Springer
Deep models are notoriously known to perform poorly when encountering new domains with
different statistics. To alleviate this issue, we present a new domain generalization method …

A real‐time lane detection network using two‐directional separation attention

L Zhang, F Jiang, J Yang, B Kong… - Computer‐Aided Civil …, 2024 - Wiley Online Library
Real‐time network by adopting attention mechanism is helpful for enhancing lane detection
capability of autonomous vehicles. This paper proposes a real‐time lane detection network …

The lottery ticket hypothesis for self-attention in convolutional neural network

Z Huang, S Liang, M Liang, W He, H Yang… - arxiv preprint arxiv …, 2022 - arxiv.org
Recently many plug-and-play self-attention modules (SAMs) are proposed to enhance the
model generalization by exploiting the internal information of deep convolutional neural …