AI Safety Newsletter

<p><strong>AI Deception: Examples, Risks, Solutions</strong></p><p>AI deception is the topic of a new paper from researchers at and affiliated with the Center for AI Safety. It surveys empirical examples of AI deception, then explores societal risks and potential solutions.</p><p...

<p class="c2">Rapid advancements in artificial intelligence (AI) have sparked growing concerns among experts, policymakers, and world leaders regarding the potential for increasingly advanced AI systems to pose catastrophic risks. Although numerous risks have been detailed separa...

<p class="c23">Artificial intelligence (AI) has the potential to greatly improve society, but as with any powerful technology, it comes with heightened risks and responsibilities. Current AI research lacks a systematic discussion of how to manage long-tail risks from AI systems, ...

<p class="c71 c80">Machine learning (ML) systems are rapidly increasing in size, are acquiring new capabilities, and are increasingly deployed in high-stakes settings. As with other powerful technologies, safety for ML should be a leading research priority. In response to emergin...

<p><strong>US-China Competition on AI Chips</strong></p><p>Modern AI systems are trained on advanced computer chips which are designed and fabricated by only a handful of companies in the world. The US and China have been competing for access to these chips for years. Last Octobe...

<p><strong>Challenges of Reinforcement Learning from Human Feedback</strong></p><p>If you’ve used ChatGPT, you might’ve noticed the “thumbs up” and “thumbs down” buttons next to each of its answers. Pressing these buttons provides data that OpenAI uses to improve their models thr...

<p><strong>Automatically Circumventing LLM Guardrails</strong></p><p>Large language models (LLMs) can generate hazardous information, such as step-by-step instructions on how to create a pandemic pathogen. To combat the risk of malicious use, companies typically build safety guar...

<p><strong>White House Unveils Voluntary Commitments to AI Safety from Leading AI Labs</strong></p><p>Last Friday, the White House announced a series of voluntary commitments from seven of the world's premier AI labs. Amazon, Anthropic, Google, Inflection, Meta, Microsoft, and Op...

<p><strong>Both China and the US take action to regulate AI</strong></p><p>Last week, regulators in both China and the US took aim at generative AI services. These actions show that China and the US are both concerned with AI safety. Hopefully, this is a sign they can eventually ...

<p><strong>OpenAI announces a ‘superalignment’ team</strong></p><p>On July 5th, OpenAI announced the ‘Superalignment’ team: a new research team given the goal of aligning superintelligence, and armed with 20% of OpenAI’s compute. In this story, we’ll explain and discuss the team’...

<p><strong>Interdisciplinary Perspective on AI Proxy Failures</strong></p><p>In this story, we discuss a recent paper on why proxy goals fail. First, we introduce proxy gaming, and then summarize the paper’s findings. </p><p>Proxy gaming is a well-documented failure mode in AI sa...

<p><strong>Policy Proposals from NTIA’s Request for Comment</strong></p><p>The National Telecommunications and Information Administration publicly requested comments on the matter from academics, think tanks, industry leaders, and concerned citizens. They asked 34 questions and r...