Anthropic is working with the NNSA to ensure its models do not share potentially dangerous information about nuclear energy, and the company plans to share its findings with other organizations for further testing.
The document discusses the race among AI model operators, such as Anthropic, OpenAI, and Scale AI, to secure government contracts, particularly with U.S. intelligence agencies and the Department of Energy’s National Nuclear Security Administration (NNSA).
Anthropic has partnered with Palantir and Amazon Web Services to make its Claude model available to U.S. intelligence agencies, while OpenAI has signed deals with several government agencies.
Scale AI has developed its own model based on Meta’s open-source Llama for the defense sector.
The document also mentions the potential impact of the Trump transition on these safety testing partnerships