Black-box access is insufficient for rigorous ai audits

S Casper, C Ezell, C Siegmann, N Kolt… - Proceedings of the …, 2024 - dl.acm.org
External audits of AI systems are increasingly recognized as a key mechanism for AI
governance. The effectiveness of an audit, however, depends on the degree of access …

Evaluating the social impact of generative ai systems in systems and society

I Solaiman, Z Talat, W Agnew, L Ahmad… - ar**
ZJ Wang, C Kulkarni, L Wilcox, M Terry… - Proceedings of the 2024 …, 2024 - dl.acm.org
Prompt-based interfaces for Large Language Models (LLMs) have made prototy** and
building AI-powered applications easier than ever before. However, identifying potential …

Responsible reporting for frontier AI development

N Kolt, M Anderljung, J Barnhart, A Brass… - Proceedings of the …, 2024 - ojs.aaai.org
Mitigating the risks from frontier AI systems requires up-to-date and reliable information
about those systems. Organizations that develop and deploy frontier systems have …

Visibility into AI agents

A Chan, C Ezell, M Kaufmann, K Wei… - Proceedings of the …, 2024 - dl.acm.org
Increased delegation of commercial, scientific, governmental, and personal activities to AI
agents—systems capable of pursuing complex goals with limited supervision—may …

Not my voice! a taxonomy of ethical and safety harms of speech generators

W Hutiri, O Papakyriakopoulos, A **ang - Proceedings of the 2024 ACM …, 2024 - dl.acm.org
The rapid and wide-scale adoption of AI to generate human speech poses a range of
significant ethical and safety risks to society that need to be addressed. For example, a …

Wordflow: Social prompt engineering for large language models

ZJ Wang, A Chakravarthy, D Munechika… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) require well-crafted prompts for effective use. Prompt
engineering, the process of designing prompts, is challenging, particularly for non-experts …

Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy, Research, and Practice

AF Cooper, CA Choquette-Choo, M Bogen… - arxiv preprint arxiv …, 2024 - arxiv.org
We articulate fundamental mismatches between technical methods for machine unlearning
in Generative AI, and documented aspirations for broader impact that these methods could …

Evaluating ai evaluation: Perils and prospects

J Burden - arxiv preprint arxiv:2407.09221, 2024 - arxiv.org
As AI systems appear to exhibit ever-increasing capability and generality, assessing their
true potential and safety becomes paramount. This paper contends that the prevalent …

Securing the future of GenAI: Policy and technology

M Christodorescu, R Craven, S Feizi, N Gong… - arxiv preprint arxiv …, 2024 - arxiv.org
The rise of Generative AI (GenAI) brings about transformative potential across sectors, but its
dual-use nature also amplifies risks. Governments globally are grappling with the challenge …