Compute trends across three eras of machine learning J Sevilla, L Heim, A Ho, T Besiroglu, M Hobbhahn, P Villalobos 2022 International Joint Conference on Neural Networks (IJCNN), 1-8, 2022 | 378 | 2022 |
Will we run out of data? Limits of LLM scaling based on human-generated data P Villalobos, A Ho, J Sevilla, T Besiroglu, L Heim, M Hobbhahn 2024 International Conference on Machine Learning (ICML), 2024 | 241* | 2024 |
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks T Räuker, A Ho, S Casper, D Hadfield-Menell 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML), 2022 | 190 | 2022 |
Machine learning model sizes and the parameter gap P Villalobos, J Sevilla, T Besiroglu, L Heim, A Ho, M Hobbhahn arXiv preprint arXiv:2207.02852, 2022 | 76 | 2022 |
Algorithmic progress in language models A Ho, T Besiroglu, E Erdil, D Owen, R Rahman, ZC Guo, D Atkinson, ... 2024 Conference on Neural Information Processing Systems (NeurIPS), 2024 | 25 | 2024 |
Estimating training compute of Deep Learning models J Sevilla, L Heim, M Hobbhahn, T Besiroglu, A Ho, P Villalobos Epoch AI, 2022 | 19 | 2022 |
Parameter, compute and data trends in machine learning J Sevilla, P Villalobos, JF Cerón, M Burtell, L Heim, AB Nanjajjar, A Ho, ... Epoch AI, 2021 | 16 | 2021 |
Frontiermath: A benchmark for evaluating advanced mathematical reasoning in AI E Glazer, E Erdil, T Besiroglu, D Chicharro, E Chen, A Gunning, ... arXiv preprint arXiv:2411.04872, 2024 | 14 | 2024 |
Compute trends across three eras of machine learning. arXiv J Sevilla, L Heim, A Ho, T Besiroglu, M Hobbhahn, P Villalobos arXiv preprint arXiv:2202.05924, 2022 | 11 | 2022 |
Trends in training dataset sizes P Villalobos, A Ho Epoch AI, 2022 | 11 | 2022 |
Limits to the Energy Efficiency of CMOS Microprocessors A Ho, E Erdil, T Besiroglu 2023 IEEE International Conference on Rebooting Computing (ICRC), 1-10, 2023 | 8 | 2023 |
Please Report Your Compute J Sevilla, A Ho, T Besiroglu Communications of the ACM 66 (5), 30-32, 2023 | 6 | 2023 |
Estimating Idea Production: A Methodological Survey E Erdil, T Besiroglu, A Ho arXiv preprint arXiv:2405.10494, 2024 | 2 | 2024 |
Future-Proof: Monitoring the Development, Deployment, and Impacts of Artificial Intelligence A Ho Journal of Science Policy & Governance 22 (3), 2023 | 1 | 2023 |
International AI Safety Report Y Bengio, S Mindermann, D Privitera, T Besiroglu, R Bommasani, ... arXiv preprint arXiv:2501.17805, 2025 | | 2025 |