Senior Pentagon officials, led by Secretary Pete Hegseth, held discussions with executives from AI company Anthropic this Tuesday to address a growing dispute over military use of the firm's powerful Claude AI model. It is reported that Hegseth issued an ultimatum, giving Anthropic CEO Dario Amodei by Friday to accept the Pentagon's conditions or risk serious consequences.
A Clash Regarding Ethics and Access
Anthropic, which markets itself as the foremost ethically-focused of the major AI developers, has been engaged in a protracted disagreement with the Pentagon. The central conflict concerns the extent to which the armed forces can employ the Claude large language model. Whereas defense officials are demanding broad access to its functions, Anthropic has reportedly resisted allowing its product to be used for applications such as wide-scale monitoring or autonomous weapons systems that could engage targets absent human oversight.
"I think, if someone seeks to profit from the government, from the US Department of War, those safeguards ought to be adjusted for our applications – so long as they’re legal," said a high-ranking Pentagon AI official last week.
The Pentagon has reportedly integrated Claude into certain operations, but has threatened to sever the partnership over what it perceives as unnecessary restrictions imposed by the AI company.
Billions and Wider Agreements
This dispute highlights the larger question of whether the AI industry will resist against state demands for military uses of their technologies. The Department of Defense initially struck lucrative agreements with multiple prominent AI companies, including Anthropic, Google, and OpenAI, providing contracts worth up to $200 million. Previously, Anthropic's Claude was the sole AI model permitted for use in the military's secret systems.
However, in a significant development, the DoD signed a deal on Monday permitting the use of Elon Musk's xAI chatbot within those classified systems. This follows previous controversy regarding that specific AI's output of harmful imagery.
It is important to note that both OpenAI have reportedly agreed to the Pentagon's terms on usage, with a Pentagon spokesperson stating that OpenAI had authorized its model for "any legal purposes."
Political Undertones and Global Consequences
The context of the meeting is significant, occurring a few weeks after the US military allegedly used Claude to assist in a sensitive overseas mission. There has been a strong push from the current administration to embed AI deeply into defense strategy.
Meanwhile, Anthropic's leadership has openly advocated for stricter AI regulation and has backed initiatives advocating comprehensive protections. The firm's alleged political leanings have reportedly influenced its investor relations, with certain aligned venture capital firms withdrawing from planned deals.
What's Next of AI in Conflict
The Pentagon has poured vast sums into developing AI-enabled technologies, from drones to automated decision-making systems. This accelerating progress has brought pressing moral dilemmas to the center stage, especially regarding the handing over of life-and-death decision-making to algorithms.
- Lethal AI: Discussions are no longer hypothetical, with ongoing conflicts showcasing semiautonomous systems that can operate independently.
- Sector Pushback: The resolution of the Anthropic negotiation could set a precedent for how additional AI firms engage with defense demands.
- Global Race: There is a declared objective to dominate the global AI technology race, adding a layer of strategic rivalry to the moral conversation.
The Friday deadline looms, placing significant pressure on Anthropic to either accommodate the military's demands or uphold its public ethical commitments and risk substantial business and contractual repercussions.