A meta-summary of challenges in building products with ml components–collecting experiences from 4758+ practitioners

N Nahar, H Zhang, G Lewis, S Zhou… - 2023 IEEE/ACM 2nd …, 2023‏ - ieeexplore.ieee.org
Incorporating machine learning (ML) components into software products raises new
software-engineering challenges and exacerbates existing ones. Many researchers have …

On the design of ai-powered code assistants for notebooks

AM McNutt, C Wang, RA Deline… - Proceedings of the 2023 …, 2023‏ - dl.acm.org
AI-powered code assistants, such as Copilot, are quickly becoming a ubiquitous component
of contemporary coding contexts. Among these environments, computational notebooks …

Collaboration challenges in building ml-enabled systems: Communication, documentation, engineering, and process

N Nahar, S Zhou, G Lewis, C Kästner - Proceedings of the 44th …, 2022‏ - dl.acm.org
The introduction of machine learning (ML) components in software projects has created the
need for software engineers to collaborate with data scientists and other specialists. While …

Operationalizing machine learning: An interview study

S Shankar, R Garcia, JM Hellerstein… - arxiv preprint arxiv …, 2022‏ - arxiv.org
Organizations rely on machine learning engineers (MLEs) to operationalize ML, ie, deploy
and maintain ML pipelines in production. The process of operationalizing ML, or MLOps …

What's wrong with computational notebooks? Pain points, needs, and design opportunities

S Chattopadhyay, I Prasad, AZ Henley… - Proceedings of the …, 2020‏ - dl.acm.org
Computational notebooks-such as Azure, Databricks, and Jupyter-are a popular, interactive
paradigm for data scientists to author code, analyze data, and interleave visualizations, all …

How do data analysts respond to ai assistance? a wizard-of-oz study

K Gu, M Grunde-McLaughlin, A McNutt, J Heer… - Proceedings of the …, 2024‏ - dl.acm.org
Data analysis is challenging as analysts must navigate nuanced decisions that may yield
divergent conclusions. AI assistants have the potential to support analysts in planning their …

Symphony: Composing interactive interfaces for machine learning

A Bäuerle, ÁA Cabrera, F Hohman, M Maher… - Proceedings of the …, 2022‏ - dl.acm.org
Interfaces for machine learning (ML), information and visualizations about models or data,
can help practitioners build robust and responsible ML systems. Despite their benefits …

How data scientists use computational notebooks for real-time collaboration

AY Wang, A Mittal, C Brooks, S Oney - … of the ACM on Human-Computer …, 2019‏ - dl.acm.org
Effective collaboration in data science can leverage domain expertise from each team
member and thus improve the quality and efficiency of the work. Computational notebooks …

Documentation matters: Human-centered ai system to assist data science code documentation in computational notebooks

AY Wang, D Wang, J Drozdal, M Muller, S Park… - ACM Transactions on …, 2022‏ - dl.acm.org
Computational notebooks allow data scientists to express their ideas through a combination
of code and documentation. However, data scientists often pay attention only to the code …

How do analysts understand and verify ai-assisted data analyses?

K Gu, R Shang, T Althoff, C Wang… - Proceedings of the 2024 …, 2024‏ - dl.acm.org
Data analysis is challenging as it requires synthesizing domain knowledge, statistical
expertise, and programming skills. Assistants powered by large language models (LLMs) …