Understanding metric-related pitfalls in image analysis validation

A Reinke, MD Tizabi, V Singhal, N Chou, J Lee, Y Yue, J Liu, WK Chock… - Nature …, 2024 - nature.com
Spatial omics data are clustered to define both cell types and tissue domains. We present
Building Aggregates with a Neighborhood Kernel and Spatial Yardstick (BANKSY), an …

The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation

D Chicco, MJ Warrens, G Jurman - Peerj computer science, 2021 - peerj.com
Regression analysis makes up a large part of supervised machine learning, and consists of
the prediction of a continuous independent target from a set of other predictor variables. The …

Dual-IDS: A bagging-based gradient boosting decision tree model for network anomaly intrusion detection system

MHL Louk, BA Tama - Expert Systems with Applications, 2023 - Elsevier
The mission of an intrusion detection system (IDS) is to monitor network activities and
assess whether or not they are malevolent. Specifically, anomaly-based IDS can discover …

The Matthews correlation coefficient (MCC) is more informative than Cohen's Kappa and Brier score in binary classification assessment

D Chicco, MJ Warrens, G Jurman - Ieee Access, 2021 - ieeexplore.ieee.org
Even if measuring the outcome of binary classifications is a pivotal task in machine learning
and statistics, no consensus has been reached yet about which statistical rate to employ to …

A systematic evaluation of machine learning–based biomarkers for major depressive disorder

NR Winter, J Blanke, R Leenings, J Ernsting… - JAMA …, 2024 - jamanetwork.com
Importance Biological psychiatry aims to understand mental disorders in terms of altered
neurobiological pathways. However, for one of the most prevalent and disabling mental …

Enhanced credit card fraud detection model using machine learning

NS Alfaiz, SM Fati - Electronics, 2022 - mdpi.com
The COVID-19 pandemic has limited people's mobility to a certain extent, making it difficult
to purchase goods and services offline, which has led the creation of a culture of increased …

Challenges in the real world use of classification accuracy metrics: From recall and precision to the Matthews correlation coefficient

GM Foody - Plos one, 2023 - journals.plos.org
The accuracy of a classification is fundamental to its interpretation, use and ultimately
decision making. Unfortunately, the apparent accuracy assessed can differ greatly from the …