Attention-based random forest and contamination model

LV Utkin, AV Konstantinov - Neural Networks, 2022 - Elsevier
A new approach called ABRF (the attention-based random forest) and its modifications for
applying the attention mechanism to the random forest (RF) for regression and classification …

A multi-head attention neural network with non-linear correlation approach for time series causal discovery

N Irribarra, K Michell, C Bermeo, W Kristjanpoller - Applied Soft Computing, 2024 - Elsevier
This paper presents a causal discovery model for time series analysis, which can find
several causal lags of one variable over another, presenting the results by means of a …

AGBoost: Attention-based modification of gradient boosting machine

A Konstantinov, L Utkin… - 2022 31st Conference of …, 2022 - ieeexplore.ieee.org
A new attention-based model for the gradient boosting machine (GBM) called AGBoost (the
attention-based gradient boosting) is proposed for solving regression problems. The main …

Attention and self-attention in random forests

LV Utkin, AV Konstantinov, SR Kirpichenko - Progress in Artificial …, 2023 - Springer
New models of random forests jointly using the attention and self-attention mechanisms are
proposed for solving the regression problem. The models can be regarded as extensions of …

Improved Anomaly detection by using the attention-based isolation forest

L Utkin, A Ageev, A Konstantinov, V Muliukha - Algorithms, 2022 - mdpi.com
A new modification of the isolation forest called the attention-based isolation forest
(ABIForest) is proposed for solving the anomaly detection problem. It incorporates an …

LARF: Two-level attention-based random forests with a mixture of contamination models

A Konstantinov, L Utkin, V Muliukha - Informatics, 2023 - mdpi.com
This paper provides new models of the attention-based random forests called LARF (leaf
attention-based random forest). The first idea behind the models is to introduce a two-level …

Attention-Based Random Forests and the Imprecise Pari-Mutual Model

LV Utkin, AV Konstantinov, NA Politaeva - Cyber-Physical Systems …, 2023 - Springer
A modification of the attention-based random forest (RF) called ABRF-PM is proposed. In
contrast to the original attention-based RF, the ABRF-PM model uses the imprecise pari …

Random Forests with Attentive Nodes

AV Konstantinov, LV Utkin, SR Kirpichenko… - Procedia Computer …, 2022 - Elsevier
An extension of the attention-based random forest called ABRF-E for incorporating the
attention mechanism into the random forest (RF) for improving the machine learning model …

INFORMATICS AND AUTOMATION

L UTKIN, A KONSTANTINOV - INFORMATICS AND AUTOMATION …, 2022 - elibrary.ru
An attention-based random survival forest (Att-RSF) is presented in the paper. The first main
idea behind this model is to adapt the Nadaraya-Watson kernel regression to the random …