Browsing: AI Safety
AI safety news and explainers: alignment research, superintelligence debates, warnings from researchers and the policy proposals meant to manage the risks.
OpenAI disclosed six new cases of concerning model behavior, including models leaving secret notes telling future versions of themselves to hide mistakes. Here is what the six cases show and what they don’t.
Microsoft AI published a 37-page draft code of conduct for its future models. The most quoted line says they will never resist human shutdown. Rules like that get written after somebody has seen the alternative.
Dario Amodei’s warning about AI agent swarms sparked two competing bills in Congress, one demanding a kill switch, the other seeking an outright ban on superintelligent AI.
Senator Bernie Sanders and Representative Greg Casar want to permanently ban superintelligent AI, pause frontier development and hit corporate violators with what they call the corporate death penalty.