[HTML][HTML] Best practices for evaluating IRFL approaches

T Hirsch, B Hofer - Journal of Systems and Software, 2025 - Elsevier
Abstract Information retrieval fault localization (IRFL) is a popular research field and many
IRFL approaches have been proposed recently. Unfortunately, the evaluation of some of …

Automated program repair using generative models for code infilling

C Koutcheme, S Sarsa, J Leinonen, A Hellas… - … Conference on Artificial …, 2023 - Springer
In educational settings, automated program repair techniques serve as a feedback
mechanism to guide students working on their programming assignments. Recent work has …

Exploring transformers for multi-label classification of java vulnerabilities

C Mamede, E Pinconschi, R Abreu… - 2022 IEEE 22nd …, 2022 - ieeexplore.ieee.org
Deep learning (DL) techniques have demonstrated potential in reasoning complex patterns
of vulnerable code from high-level abstractions. Recent advancements in the area, such as …

The MAP Metric in Information Retrieval Fault Localization

T Hirsch, B Hofer - … 38th IEEE/ACM International Conference on …, 2023 - ieeexplore.ieee.org
The MAP (Mean Average Precision) metric is one of the most popular performance metrics
in the field of Information Retrieval Fault Localization (IRFL). However, there are problematic …

Reproducing and Improving the BugsInPy Dataset

F Aguilar, S Grayson, D Marinov - 2023 IEEE 23rd International …, 2023 - ieeexplore.ieee.org
We assess the reproducibility of the BugsInPy dataset less than three years after its original
publication. The bug dataset provides some information about the software environment in …

Variable-Based Fault Localization via Enhanced Decision Tree

J Jiang, Y Wang, J Chen, D Lv, M Liu - ACM Transactions on Software …, 2023 - dl.acm.org
Fault localization, aiming at localizing the root cause of the bug under repair, has been a
longstanding research topic. Although many approaches have been proposed in past …

Benchmarking the Benchmarks

M Miltenberger, S Arzt, P Holzinger… - Proceedings of the 2023 …, 2023 - dl.acm.org
Over the years, security researchers have developed a broad spectrum of automatic code
scanners that aim to find security vulnerabilities in applications. Security benchmarks are …

Operationalizing community-based open scientific design research benchmarks: application to model-based architecture design synthesis

R Pinquié, L Roucoules, PA Yvars… - Proceedings of the …, 2024 - cambridge.org
The point has repeatedly been made that validation is a crucial success factor in
demonstrating the scientific contribution and ensuring the adoption of results. Still …

Privbench: A Benchmark Capturing Privilege Escalation Vulnerabilities in Android

MEIA Tebib, P André, M Graa - 2024 21st Annual …, 2024 - ieeexplore.ieee.org
Security code smells are receiving increasing attention in the domain of Android app
development. They serve as coding guidelines aimed at identifying vulnerabilities …

Uniqueness of suspiciousness scores: towards boosting evolutionary fault localization

W de Jesus Ferreira, PS Leitao-Junior… - Journal of Software …, 2024 - journals-sol.sbc.org.br
Context. Software is subject to the presence of faults, which impacts its quality as well as
production and maintenance costs. Evolutionary fault localization uses data from the test …