Heterogeneity in effect size estimates

F Holzmeister, M Johannesson, R Böhm… - Proceedings of the …, 2024 - pnas.org
A typical empirical study involves choosing a sample, a research design, and an analysis
path. Variation in such choices across studies leads to heterogeneity in results that introduce …

Reproducibility in Management Science

M Fišar, B Greiner, C Huber, E Katok… - Management …, 2024 - pubsonline.informs.org
With the help of more than 700 reviewers, we assess the reproducibility of nearly 500
articles published in the journal Management Science before and after the introduction of a …

How do data analysts respond to ai assistance? a wizard-of-oz study

K Gu, M Grunde-McLaughlin, A McNutt, J Heer… - Proceedings of the …, 2024 - dl.acm.org
Data analysis is challenging as analysts must navigate nuanced decisions that may yield
divergent conclusions. AI assistants have the potential to support analysts in planning their …

A framework for evaluating reproducibility and replicability in economics

A Dreber, M Johannesson - Economic Inquiry, 2024 - Wiley Online Library
We propose a framework for evaluating reproducibility and replicability in economics.
Reproducibility is defined as testing if the results of an original study can be reproduced …

Do anomalies really predict market returns? New data and new evidence

N Cakici, C Fieberg, D Metko, A Zaremba - Review of Finance, 2024 - academic.oup.com
Using new data from US and global markets, we revisit market risk premium predictability by
equity anomalies. We apply a repertoire of machine-learning methods to forty-two countries …

Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

N Breznau, EM Rinke, A Wuttke, HHV Nguyen… - Proceedings of the …, 2022 - pnas.org
This study explores how researchers' analytical choices affect the reliability of scientific
findings. Most discussions of reliability problems in science focus on systematic biases. We …

Mass reproducibility and replicability: A new hope

A Brodeur, D Mikola, N Cook - 2024 - JSTOR
Reproducibility and replication efforts contribute in essential ways to the production of
scientific knowledge by testing accumulated evidence. 1 Reproductions and replications …

[HTML][HTML] Non-standard errors in asset pricing: Mind your sorts

A Soebhag, B Van Vliet, P Verwijmeren - Journal of Empirical Finance, 2024 - Elsevier
Non-standard errors capture variation due to differences in research design choices. We
document large variation in design choices in the context of asset pricing factor models and …

[HTML][HTML] Experimenting with financial professionals

C Huber, C König-Kersting, MM Marini - Journal of Banking & Finance, 2024 - Elsevier
As key players in financial markets and the broader industry, financial professionals are
increasingly used as experimental research participants. We review over 50 studies …