Two former OpenAI researchers who resigned this yr over security considerations say they’re disillusioned however not stunned by OpenAI’s determination to oppose California’s invoice to stop AI disasters, SB 1047. Daniel Kokotajlo and William Saunders beforehand warned that OpenAI is in a “reckless” race for dominance.
“Sam Altman, our former boss, has repeatedly referred to as for AI regulation,” they write in a letter that was shared with Politico and which urges California Governor Gavin Newsom to signal the invoice. “Now, when precise regulation is on the desk, he opposes it.” The 2 add that, “With acceptable regulation, we hope OpenAI could but stay as much as its mission assertion of constructing AGI safely.”
Responding to the previous staff, an OpenAI spokesperson mentioned the startup, “strongly disagrees with the mischaracterization of our place on SB 1047,” in a press release to TechCrunch. The spokesperson pointed to AI payments in Congress OpenAI has endorsed, noting that “frontier AI security laws must be carried out on the federal stage due to their implications for nationwide safety and competitiveness.”
OpenAI rival Anthropic has expressed assist for the invoice whereas presenting particular considerations and asking for amendments. A number of have since been integrated, and on Thursday, CEO Dario Amodei wrote to Newsom, saying the present invoice’s “advantages possible outweigh its prices,” whereas not absolutely endorsing the invoice.