Evaluating recommender systems: survey and framework
The comprehensive evaluation of the performance of a recommender system is a complex
endeavor: many facets need to be considered in configuring an adequate and effective …
endeavor: many facets need to be considered in configuring an adequate and effective …
Social data: Biases, methodological pitfalls, and ethical boundaries
Social data in digital form—including user-generated content, expressed or implicit relations
between people, and behavioral traces—are at the core of popular applications and …
between people, and behavioral traces—are at the core of popular applications and …
Auditing algorithms: Understanding algorithmic systems from the outside in
Algorithms are ubiquitous and critical sources of information online, increasingly acting as
gatekeepers for users accessing or sharing information about virtually any topic, including …
gatekeepers for users accessing or sharing information about virtually any topic, including …
[LIBRO][B] Fairness and machine learning: Limitations and opportunities
An introduction to the intellectual foundations and practical utility of the recent work on
fairness and machine learning. Fairness and Machine Learning introduces advanced …
fairness and machine learning. Fairness and Machine Learning introduces advanced …
Equity of attention: Amortizing individual fairness in rankings
Rankings of people and items are at the heart of selection-making, match-making, and
recommender systems, ranging from employment sites to sharing economy platforms. As …
recommender systems, ranging from employment sites to sharing economy platforms. As …
Fairness in information access systems
Recommendation, information retrieval, and other information access systems pose unique
challenges for investigating and applying the fairness and non-discrimination concepts that …
challenges for investigating and applying the fairness and non-discrimination concepts that …
Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems
Two-sided marketplaces are platforms that have customers not only on the demand side (eg
users), but also on the supply side (eg retailer, artists). While traditional recommender …
users), but also on the supply side (eg retailer, artists). While traditional recommender …
Evaluating stochastic rankings with expected exposure
We introduce the concept of expected exposure as the average attention ranked items
receive from users over repeated samples of the same query. Furthermore, we advocate for …
receive from users over repeated samples of the same query. Furthermore, we advocate for …
All the cool kids, how do they fit in?: Popularity and demographic biases in recommender evaluation and effectiveness
In the research literature, evaluations of recommender system effectiveness typically report
results over a given data set, providing an aggregate measure of effectiveness over each …
results over a given data set, providing an aggregate measure of effectiveness over each …
Joint multisided exposure fairness for recommendation
Prior research on exposure fairness in the context of recommender systems has focused
mostly on disparities in the exposure of individual or groups of items to individual users of …
mostly on disparities in the exposure of individual or groups of items to individual users of …