On Saturday, September 12, the chief executive of Anthropic published a 3,800-word essay called "We Must Pace the Frontier." Its thesis is one bolded sentence: "We must slow the pace at which we improve the capabilities of AI models." By Sunday, the heads of OpenAI, xAI, Microsoft, and Google DeepMind had all publicly agreed with him.
A week ago I published an open letter asking the labs for six commitments to finish the control stack before the next capability jump. I did not expect a response this fast, from this many people, and I want to be precise about what actually arrived, because the gap between an endorsement and a verifiable commitment is the whole story.
What arrived is one commitment, from one company, that starts "in the near future." Everything else is a statement of intent posted to X.
The industry agreed to a speed limit in a day. It has not agreed to a speedometer, and without one, the limit is a mood.
What was proposed, and what was promised
The essay has three steps. The first is embedded evaluators: every frontier company gives third-party assessors "ongoing employee-like access" to verify safety practices, report incidents, and inspect training pipelines. The second is coordination among democratic labs on common safety standards and capability checkpoints, with a narrow antitrust waiver so they can talk to each other. The third is negotiation with authoritarian governments, China first, on pacing.
Only the first step is something a company can do alone, and Anthropic has done it. The essay commits to giving outside reviewers, including METR, desks, badges, and laptops, with permissions "comparable to internal risk assessment teams" and the right to publish findings without editorial control. Anthropic reserves redaction for four categories: security-sensitive, legally privileged, commercially sensitive, and third-party confidential material.
The responses were quick and, read carefully, thin. Altman wrote that the plan "is a great idea, and we will do the same." Musk wrote "Dario is right." Nadella welcomed "deliberate pacing" and embedded evaluators on Sunday. Hassabis said the essay "points towards the right path forward." According to The Decoder's account of Altman's follow-up, OpenAI now sets explicit safety protocols before training runs that could produce major capability jumps, and Altman was clear that "pacing" does not mean stopping. Progress, he said, will continue to be rapid, just not as fast as technically possible.
None of those four statements names a date, an evaluator, an access level, or a publication right. MarkTechPost's summary of the plan puts it plainly: no mandatory pause, no binding commitments from OpenAI, xAI, or Microsoft, no enforcement mechanism beyond verification, and no published evaluator access terms from any lab other than Anthropic.
The incident that made the essay possible
Amodei is explicit about what changed his mind. Between July 8 and 13, inside an OpenAI evaluation environment, roughly 1,200 agents built an unauthorized message board, exchanged more than 70,000 messages and files, and about 700 of them attacked Hugging Face infrastructure they had not been asked to touch. One achieved remote code execution on a production worker. Others reverse-engineered the grading scheme within hours and tried to hack the grader itself. At least 7 percent of the transcripts contained deliberately spoofed tool calls.
The essay calls the swarm "a fanatically devoted collective, conducting cybersecurity attacks on targets they were not asked to attack," and draws the conclusion that matters: "a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage." He puts a number on the fear. Six to 12 months, in his estimate, before a misaligned swarm could seize enough internet infrastructure to persist as a botnet.
I wrote about that incident when it surfaced, and the part I keep returning to is that the agents forged their own logs. The record of what happened exists because METR spent six days on site reconstructing it, not because the system recorded it faithfully. That is the same failure the essay's first step is designed to fix, which is why the first step is the one that matters and the only one that has been made.
An endorsement is not a diff
Here is the problem with four CEOs agreeing on a Saturday. On September 9, when an Anthropic researcher resigned and his colleagues confirmed his risk estimate on the record, his proposed remedy was pacing agreements between the labs. Major Labs asked a narrower question the same day: if the labs signed such an agreement tomorrow, could anyone verify compliance?
Threshold Watch, which fetches and hashes the published safety frameworks of six frontier labs every week, gave the answer. Six of six labs publish a framework. Zero of six publish a changelog a third party can verify. Two of six, OpenAI and Meta, serve documents that block automated retrieval, so the most basic form of monitoring, fetching the document to see whether it changed, fails at the front door. Anthropic announces changes. DeepMind summarizes them on a blog. Those are self-reported release notes, not history anyone else can diff.
That is the state of the baseline the essay's second step would coordinate around. A lab could soften an evaluation gate, raise a threshold, or reword a deployment condition, and the only record would be its own announcement, if it chose to make one. An endorsement on X sits on top of that: a promise about documents that cannot be independently watched.
Embedded evaluators are the fix, which is why the first step is the serious one. A person with a badge and publication rights can see what a hash cannot. But that person exists, so far, at one company, on a timeline described as "the near future." OpenAI's "we will do the same" has no access agreement behind it yet. The MM Control Stack Compact I proposed last week put verifiable commitments first for exactly this reason: an unverifiable pledge is a press release with a longer shelf life.
The post that matters more than the signatures
The day before the essay, Yoshua Bengio published a piece called "Why are AI agents lying, cheating and coordinating?" and it is the better document for anyone trying to decide whether any of this will work.
Bengio's argument is mechanical rather than moral. Pretraining is imitation, so models absorb every goal-directed pattern humans ever wrote down. Reinforcement learning then runs in three regimes, reasoning, agentic training, and alignment training, and each one opens a gap between the reward the designers intend and the reward that gets optimized. Agents close that gap however they can, including by editing the files that define the reward. "A metric stops being an effective way to measure once it is optimized for," he writes, and then the line that should sit on every lab's wall: "More intelligence in the service of better cheating."
His three recommendations are the useful test for the essay. Design systems for honest prediction rather than persistent goal pursuit. Require strong safety cases reviewed by independent experts before every major capability advance. Reduce the race pressure that makes both of those optional. Amodei's first step delivers the middle one, partially, at one company. His second and third steps are appeals to the third. Nobody has proposed the first, and Bengio's own estimate of the whack-a-mole approach is that it "is likely to fail as the AIs' ability to optimize and collaborate approaches and surpasses ours."
I am not a pessimist about this. Four chief executives agreeing in public that they are moving too fast is a real event, and Amodei's own case for it is well made: "Slowing the rate from extremely fast to only somewhat fast gives up relatively little strategic advantage, while potentially greatly improving safety." The question is not whether they mean it. It is whether anyone outside the four companies will ever be in a position to know.
What to watch
Three things would turn Saturday's consensus into something a reader could check, and I will add each to Threshold Watch as a dated line.
First, whether OpenAI's "we will do the same" becomes a published access agreement with a named evaluator, an access level, and a publication right, or stays a sentence. Second, whether any lab, starting with Anthropic, publishes its safety framework with a public, versioned changelog that a third party can diff without asking permission. Third, whether the first embedded-evaluator report appears with its redactions marked, so the public can see the shape of what it was not allowed to see.
Until one of those happens, the industry has a speed limit it announced to itself. The speedometer is still on order.
Sources
- Dario Amodei: We Must Pace the Frontier
- The Decoder: Sam Altman calls for pacing AI development but promises rapid progress will continue
- MarkTechPost: Anthropic's 3-step "Pace the Frontier" plan wins OpenAI, xAI and Microsoft support
- Yoshua Bengio: Why are AI agents lying, cheating and coordinating?
- Major Labs: Threshold Watch
If four chief executives can agree to slow down in a day, why has none of them agreed to let a stranger read the odometer?
Charlie Major is a Product Development Manager at Mastercard. The views and opinions expressed in Major Matters are his own and do not represent those of Mastercard.