Application of complex systems topologies in artificial neural networks optimization: An overview

S Kaviani, I Sohn - Expert Systems with Applications, 2021 - Elsevier
Through the success of artificial neural networks (ANNs) in different domains, intense
research has been recently centered on changing the networks architecture to optimize the …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …

3dmfv: Three-dimensional point cloud classification in real-time using convolutional neural networks

Y Ben-Shabat, M Lindenbaum… - IEEE Robotics and …, 2018 - ieeexplore.ieee.org
Modern robotic systems are often equipped with a direct three-dimensional (3-D) data
acquisition device, eg, LiDAR, which provides a rich 3-D point cloud representation of the …

Forest fire segmentation from Aerial Imagery data Using an improved instance segmentation model

Z Guan, X Miao, Y Mu, Q Sun, Q Ye, D Gao - Remote Sensing, 2022 - mdpi.com
In recent years, forest-fire monitoring methods represented by deep learning have been
developed rapidly. The use of drone technology and optimization of existing models to …

Attention mechanism and depthwise separable convolution aided 3DCNN for hyperspectral remote sensing image classification

W Li, H Chen, Q Liu, H Liu, Y Wang, G Gui - Remote Sensing, 2022 - mdpi.com
Hyperspectral Remote Rensing Image (HRSI) classification based on Convolution Neural
Network (CNN) has become one of the hot topics in the field of remote sensing. However …

Efficient semantic scene completion network with spatial group convolution

J Zhang, H Zhao, A Yao, Y Chen… - Proceedings of the …, 2018 - openaccess.thecvf.com
Abstract We introduce Spatial Group Convolution (SGC) for accelerating the computation of
3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial …

Indoor scene recognition in 3D

S Huang, M Usvyatsov… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
Recognising in what type of environment one is located is an important perception task. For
instance, for a robot operating indoors it is helpful to be aware whether it is in a kitchen, a …

A multi-task-based deep multi-scale information fusion method for intelligent diagnosis of bearing faults

R **n, X Feng, T Wang, F Miao, C Yu - Machines, 2023 - mdpi.com
The use of deep learning for fault diagnosis is already a common approach. However,
integrating discriminative information of fault types and scales into deep learning models for …

Powerset convolutional neural networks

C Wendler, M Püschel… - Advances in Neural …, 2019 - proceedings.neurips.cc
We present a novel class of convolutional neural networks (CNNs) for set functions, ie, data
indexed with the powerset of a finite set. The convolutions are derived as linear, shift …

Inference, learning and attention mechanisms that exploit and preserve sparsity in CNNs

T Hackel, M Usvyatsov, S Galliani, JD Wegner… - International journal of …, 2020 - Springer
Convolutional neural networks (CNNs) are a powerful tool for pattern recognition and
computer vision, but they do not scale well to higher-dimensional inputs, because of the …