Formal verification and control with conformal prediction

L Lindemann, Y Zhao, X Yu, GJ Pappas… - arxiv preprint arxiv …, 2024 - arxiv.org
In this survey, we design formal verification and control algorithms for autonomous systems
with practical safety guarantees using conformal prediction (CP), a statistical tool for …

Generalization and informativeness of conformal prediction

M Zecchin, S Park, O Simeone… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
The safe integration of machine learning modules in decision-making processes hinges on
their ability to quantify uncertainty. A popular technique to achieve this goal is conformal …

What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systems

Q Hou, S Park, M Zecchin, Y Cai, G Yu… - IEEE Transactions on …, 2025 - ieeexplore.ieee.org
In modern wireless network architectures, such as Open Radio Access Network (O-RAN),
the operation of the radio access network (RAN) is managed by applications, or apps for …

Multicalibration for confidence scoring in llms

G Detommaso, M Bertran, R Fogliato, A Roth - arxiv preprint arxiv …, 2024 - arxiv.org
This paper proposes the use of" multicalibration" to yield interpretable and reliable
confidence scores for outputs generated by large language models (LLMs). Multicalibration …

Multi-modal conformal prediction regions by optimizing convex shape templates

R Tumu, M Cleaveland, R Mangharam… - … Annual Learning for …, 2024 - proceedings.mlr.press
Conformal prediction is a statistical tool for producing prediction regions for machine
learning models that are valid with high probability. A key component of conformal prediction …

Adaptive learn-then-test: Statistically valid and efficient hyperparameter selection

M Zecchin, O Simeone - arxiv preprint arxiv:2409.15844, 2024 - arxiv.org
We introduce adaptive learn-then-test (aLTT), an efficient hyperparameter selection
procedure that provides finite-sample statistical guarantees on the population risk of AI …

Calibrating Bayesian learning via regularization, confidence minimization, and selective inference

J Huang, S Park, O Simeone - arxiv preprint arxiv:2404.11350, 2024 - arxiv.org
The application of artificial intelligence (AI) models in fields such as engineering is limited by
the known difficulty of quantifying the reliability of an AI's decision. A well-calibrated AI model …

Localized adaptive risk control

M Zecchin, O Simeone - arxiv preprint arxiv:2405.07976, 2024 - arxiv.org
Adaptive Risk Control (ARC) is an online calibration strategy based on set prediction that
offers worst-case deterministic long-term risk control, as well as statistical marginal coverage …

Conformal trajectory prediction with multi-view data integration in cooperative driving

X Chen, R Bhadani, L Head - arxiv preprint arxiv:2408.00374, 2024 - arxiv.org
Current research on trajectory prediction primarily relies on data collected by onboard
sensors of an ego vehicle. With the rapid advancement in connected technologies, such as …

Dependable Distributed Training of Compressed Machine Learning Models

F Malandrino, G Di Giacomo, M Levorato… - 2024 IEEE 25th …, 2024 - ieeexplore.ieee.org
Theexisting work on the distributed training of machine learning (ML) models has
consistently overlooked the distribution of the achieved learning quality, focusing instead on …