AI Safety Newsletter

<p><strong>An Overview of Catastrophic AI Risks</strong></p><p>Global leaders are concerned that artificial intelligence could pose catastrophic risks. 42% of CEOs polled at the Yale CEO Summit agree that AI could destroy humanity in five to ten years. The Secretary General of th...

<p><strong>How AI could enable bioterrorism</strong></p><p>Only a hundred years ago, no person could have single handedly destroyed humanity. Nuclear weapons changed this situation, giving the power of global annihilation to a small handful of nations with powerful militaries. No...

<p><strong>Top Scientists Warn of Extinction Risks from AI</strong></p><p>Last week, hundreds of AI scientists and notable public figures signed a public statement on AI risks written by the Center for AI Safety. The statement reads:</p><p>“Mitigating the risk of extinction from ...

<p><strong>Yoshua Bengio makes the case for rogue AI</strong></p><p>AI systems pose a variety of different risks. Renowned AI scientist Yoshua Bengio recently argued for one particularly concerning possibility: that advanced AI agents could pursue goals in conflict with human val...

<p><strong>How AI enables disinformation</strong></p><p>Yesterday, a fake photo generated by an AI tool showed an explosion at the Pentagon. The photo was falsely attributed to Bloomberg News and circulated quickly online. Within minutes, the stock market declined sharply, only t...

<p><strong>Examples of AI safety progress</strong></p><p>Training AIs to behave safely and beneficially is difficult. They might learn to game their reward function, deceive human oversight, or seek power. Some argue that researchers have not made much progress in addressing thes...

<p><strong>Geoffrey Hinton is concerned about existential risks from AI</strong></p><p>Geoffrey Hinton won the Turing Award for his work on AI. Now he says that part of him regrets his life’s work, as he believes that AI poses an existential threat to humanity. As Hinton puts it,...

<p><strong>Cybersecurity Challenges in AI Safety</strong></p><p>Meta accidentally leaks a language model to the public. Meta’s newest language model, LLaMa, was publicly leaked online against the intentions of its developers. Gradual rollout is a popular goal with new AI models, ...

<p><strong>Policy Proposals for AI Safety</strong></p><p>Critical industries rely on the government to protect consumer safety. The FAA approves new airplane designs, the FDA tests new drugs, and the SEC and CFPB regulate risky financial instruments. Currently, there is no analog...

<p><strong>ChaosGPT and the Rise of Language Agents</strong></p><p>Chatbots like ChatGPT usually only respond to one prompt at a time, and a human user must provide a new prompt to get a new response. But an extremely popular new framework called AutoGPT automates that process. W...

<p><strong>Growing concerns about rapid AI progress</strong></p><p>Recent advancements in AI have thrust it into the center of attention. What do people think about the risks of AI?</p><p>The American public is worried. 46% of Americans are concerned that AI will cause “the end o...