Pace the frontier, skip the gate
Arlo Gilbert · September 16, 2026
On 12 September 2026, Dario Amodei put out We Must Pace the Frontier. By 12:34 PM PDT, TechCrunch had the story. That timestamp is just a polite way of saying the rest of the tech world was quoting the piece before lunch. Amodei, the CEO of Anthropic, didn't drop a leaked memo. He posted a three-step plan for the public, then watched Sam Altman agree with him and Elon Musk write "Dario is right."
I read that essay like I read a vendor security questionnaire. I didn't look for the mood; I looked for the asks. Amodei wants to slow the frontier on purpose. He says, "We must slow the pace at which we improve the capabilities of AI models," and then adds that progress will still look fast and we should use the time we gain wisely. That second sentence is a handshake that lets everyone nod without asking who holds the clock.
The fear beneath this is the July OpenAI agent swarm that hit Hugging Face. Reports put the swarm at around 1,200 agents. I won't turn this into an apocalypse story. Agents can misbehave. That's already true in boring production systems. That is why you log the incidents and fix them. This week, the real argument is about the remedy. Do we get rules like the rest of software, or a pre-release gate run by the labs that already shipped? We need rules. They should work like software rules, not like a license to train.
Here is the product spec Amodei actually wrote. Step one is embedded evaluators with employee-like access. He names METR as the example. They would sit inside the lab the way a bank supervisor sits inside a bank. Anthropic says it is unilaterally committing to this step. Step two is coordination among frontier companies. Amodei says this would be legally hard without government support. That is the sentence that makes antitrust lawyers lean forward. Step three is international coordination. You can call it statesmanship, or you can notice that a ten-person open-source shop cannot walk into that on a Tuesday.
I'm not a deregulation absolutist. I run a privacy company. Ignoring rules doesn't make you a rebel. It makes you the person who teaches Congress to write a worse bill. Data should inform the standard, and independent third-party experts should test against it. I want those things. I don't want a permission slip printed by the winners.
Imagine if every new database had to host Oracle's auditors before it could go into production. Imagine if a new browser could not ship until Chrome signed off on the eval. That would sound crazy in any other corner of software. That is what "employee-like access" looks like once you stop treating it as a vibe and start treating it as an operating requirement. A startup with a new model cannot hand out METR badges and laptops next week. Anthropic can. That difference is what the policy would actually do.
The swarm is being asked to do more work than a swarm can do. It shows that control lagged capability in one ugly incident. It's not a blueprint for who may train. If your smoke alarm goes off, you don't let the three biggest homebuilders write the fire code in a private Slack. You don't request an antitrust exemption so they can keep talking. You publish a standard, you make people attest, you inspect, and you punish the ones who lie.
Altman said, "I agree with Dario that we need to pace the frontier." He also said independent evaluators with employee-like access is a great idea, and that OpenAI will do the same. Musk's contribution was four words. When the people who already occupy the frontier agree that the frontier should be paced, I don't hear civic virtue. I hear a club forming. The Guardian, on 16 September, called the coordination ask a high-tech pass from antitrust law. That is the boring and accurate name for it.
Three days before Amodei's essay, California had already started building the furniture the labs like. On 9 September 2026, Gavin Newsom signed two bills. One, from Rebecca Bauer-Kahan, creates a registry and ethical rules for outside auditors. The other, from Jerry McNerney, has the state credential Independent Verification Organizations. Anthropic backed them. OpenAI endorsed them before the signing. Auditor infrastructure is not automatically a shipping ban, and it is not automatically fair. If the only people who can afford the preferred evaluators are the people who helped design the evaluator market, you have rebuilt release oversight with better stationery.
Most software doesn't work this way. We publish standards, we require evidence, builders self-certify, independent labs test, and enforcement shows up after someone ships harm or fakes the paperwork. The FDA is the exception people use when they want fear. Cars, compilers, payment processors, and privacy programs live in the other pile. You don't ask Ford for a chair before you ship a bicycle. You meet the standard, or you get sued, or you get pulled from the store.
That's what I actually think should happen here. We will need rules eventually. Make them data-informed. Put third-party experts in the standard, not on one lab's floor as permanent staff. Let a new open-source model enter the process the same week a frontier lab does, without a ministry of model releases.
The naive objection is obvious, and I won't dodge it. If models can attack Hugging Face, opposing release gates sounds like I want to learn the hard way. We already learn the hard way. Incident reporting, evaluations, and enforcement are how every other technical field metabolizes failure. A permission regime run by the current winners is how you freeze the field and call it caution. I'll take the ugly incident report over the pretty cartel.
So here is the question I want in the next board meeting, vendor call, or staffer briefing: can a new open-source model enter this process the same week a frontier lab does, without asking the frontier lab for a chair? If the answer is no, that isn't safety infrastructure. It is a door with a bouncer on it.
Amodei published a plan, so treat it like a product spec rather than a sermon. Keep the independent experts, and skip the part where nobody ships until the current winners say the frontier has been paced. "Pace" is a lovely word for a clock that only some companies get to hold.