Multicalibration: Calibration for the (computationally-identifiable) masses

U Hébert-Johnson, M Kim… - International …, 2018 - proceedings.mlr.press
We develop and study multicalibration as a new measure of fairness in machine learning
that aims to mitigate inadvertent or malicious discrimination that is introduced at training time …

[BOEK][B] Prediction, learning, and games

N Cesa-Bianchi, G Lugosi - 2006 - books.google.com
This important text and reference for researchers and students in machine learning, game
theory, statistics and information theory offers a comprehensive treatment of the problem of …

Probabilistic forecasts, calibration and sharpness

T Gneiting, F Balabdaoui… - Journal of the Royal …, 2007 - academic.oup.com
Probabilistic forecasts of continuous variables take the form of predictive densities or
predictive cumulative distribution functions. We propose a diagnostic approach to the …

Combining probability forecasts

R Ranjan, T Gneiting - Journal of the Royal Statistical Society …, 2010 - academic.oup.com
Linear pooling is by far the most popular method for combining probability forecasts.
However, any non-trivial weighted average of two or more distinct, calibrated probability …

Outcome indistinguishability

C Dwork, MP Kim, O Reingold, GN Rothblum… - Proceedings of the 53rd …, 2021 - dl.acm.org
Prediction algorithms assign numbers to individuals that are popularly understood as
individual “probabilities”—what is the probability of 5-year survival after cancer diagnosis …

Adaptive heuristics

S Hart - Econometrica, 2005 - Wiley Online Library
We exhibit a large class of simple rules of behavior, which we call adaptive heuristics, and
show that they generate rational behavior in the long run. These adaptive heuristics are …

A truth serum for non-bayesians: Correcting proper scoring rules for risk attitudes

T Offerman, J Sonnemans… - The Review of …, 2009 - academic.oup.com
Proper scoring rules provide convenient and highly efficient tools for incentive-compatible
elicitations of subjective beliefs. As traditionally used, however, they are valid only under …

Moment multicalibration for uncertainty estimation

C Jung, C Lee, M Pai, A Roth… - Conference on Learning …, 2021 - proceedings.mlr.press
We show how to achieve the notion of" multicalibration" from Hebert-Johnson et al.(2018)
not just for means, but also for variances and other higher moments. Informally, this means …

Oracle efficient online multicalibration and omniprediction

S Garg, C Jung, O Reingold, A Roth - Proceedings of the 2024 Annual ACM …, 2024 - SIAM
A recent line of work has shown a surprising connection between multicalibration, a multi-
group fairness notion, and omniprediction, a learning paradigm that provides simultaneous …

Happymap: A generalized multi-calibration method

Z Deng, C Dwork, L Zhang - arxiv preprint arxiv:2303.04379, 2023 - arxiv.org
Multi-calibration is a powerful and evolving concept originating in the field of algorithmic
fairness. For a predictor $ f $ that estimates the outcome $ y $ given covariates $ x $, and for …