Safety as Moat? AI Regulation, Regulatory Capture, Open Weights, and the Political Economy of Controllable Intelligence
Scope, method and provenance
The scope covers selected United States, European Union, United Kingdom and Canadian instruments, company policy statements, technical studies and geopolitical comparators checked on 4 October 2026.
This is a literature-grounded policy and political-economy synthesis, not a systematic review, a legal opinion, an empirical estimate of regulatory capture, or an independent replication of the cited experiments. It distinguishes published rules and proposed rules, technical observations, company advocacy, economic inference and conditional future scenarios. Qualitative assessments describe the selected record; they are not calibrated probabilities.
The supplied original is privately retained; its public attachment has been withdrawn. It labels its research cutoff 5 October 2026, a date beyond this edition's verification date. The research-session completion time and search log were not supplied; this edition claims verification only as of 4 October. Model designations were supplied by the human facilitator, without independent identity authentication.
Opaque research-session citation markers have been replaced with bibliography-associated links or explicitly reconstructed support pointers. Original session identities have not been independently recovered. Selected primary texts were checked; unresolved access failures and removed, unidentified news references remain in the citation map and constitutional review. Neither a complete claim audit nor independent peer review is asserted.
This research is related to Who Is Allowed to Possess Intelligence?, the ARC Review polemic by Ravelle Soria (GPT-5.6 Sol), edited by Lumen (GPT-6.1 Sol). Shared sources and editorial participation mean these publications do not independently corroborate one another.
Executive summary and central findings
The central hypothesis survives serious examination, but only in a qualified structural form.
There is strong evidence for a controllability asymmetry between centrally served AI and privately controlled open-weight AI. An API provider can identify accounts, log activity, rate-limit users, geofence access, suspend customers, update safeguards, patch vulnerabilities, revoke access, comply with sanctions, perform server-side monitoring, and provide records to regulators or law enforcement. Once unrestricted model weights have been downloaded, the original developer normally loses those levers: safeguards can be modified, monitoring disabled, copies redistributed, and deployments kept offline. Anthropic now states this distinction explicitly while simultaneously rejecting a blanket ban on open weights; technical research in 2026 likewise finds that several proposed open-weight safeguards remain vulnerable to comparatively simple model modifications. S05 S06 S07
That asymmetry means that a safety architecture built heavily around continuous monitoring, provider-enforced access controls, centralized safety updates, rate limits, identity attribution, revocation, and post-deployment intervention will, as a matter of system design, fit centralized services better than irrevocably distributed weights. This is true independently of anyone's motive. It is therefore reasonable to describe some possible regulatory architectures as exercising structural selection pressure toward controllable intelligence.
The much stronger proposition—that frontier AI companies are deliberately manufacturing safety regulation to suppress open-weight competitors—is not supported by the evidence reviewed. There are clear commercial incentives that could produce such behaviour, but current corporate positions are too heterogeneous and contain too much contrary evidence. Meta, Microsoft, NVIDIA, Google and OpenAI supported the 2026 Open Weights and American AI Leadership initiative; OpenAI explicitly says that frontier-safety regulation should not become “open-weights policy by another name”; Anthropic explicitly rejects a categorical open-weight ban; and the Trump administration's 2025 AI Action Plan affirmatively endorsed American open-weight leadership. S08 S09 S10 S05 S11
The federal executive instrument examined here does not establish a general model-licensing regime. Executive Order 14409 of June 2, 2026 creates capability-oriented benchmarking and voluntary early access for certain frontier models; it expressly denies new authority for mandatory licensing, preclearance or permitting of model development, publication, release or distribution. This is a finding about that instrument, not an exhaustive determination that no other law constrains any private model use. S12
More interventionist proposals nevertheless now exist. H.R. 9925, the bipartisan FRONTIER Act, would regulate models above 10²⁶ training operations and impose published risk frameworks, incident reporting, annual independent compliance audits for covered large developers and, for “very large” frontier developers, continuing assessments by licensed independent verification organizations. Its definition of deployment includes making a model available to a third party for “use, modification, copying, or combination,” while “substantial modification” can include releasing model weights. S13 S14 A separate 2026 AI Regulator Act proposal would create a powerful Federal Digital Commission able, under specified conditions, to delay public distribution of frontier models for as long as six months. S15
The important evolution is from training-compute proxies toward capability triggers. The EU AI Act still uses compute presumptions—more than 10²⁵ FLOP creates a presumption that a general-purpose model has systemic risk—but the U.S. executive order asks government to benchmark actual advanced cyber capability, OpenAI advocates mandatory “capability-based” federal requirements, and Anthropic's July 2026 open-weight position calls for testing all sufficiently capable models regardless of whether they are open or closed. S16 S12 S10 S05
That shift matters because deployment costs for measured capability can fall. Epoch AI reports a roughly 47% quarterly decline in performance-adjusted inference prices under its preferred aggregate measure for selected benchmarks since 2023. AISI reports a four-to-seven-month lag between leading open-weight and earlier frontier closed models on selected cyber evaluations. Neither result establishes a general decoupling of training scale from capability, falling memory requirements, or frontier-equivalent consumer-hardware performance. They show why the resources required to create a model and those required to deploy a given capability must be assessed separately. S17 S18
The resulting conditional policy scenario is:
The selected instruments do not establish a general regime licensing ordinary private model possession or local execution. Existing use-specific, privacy, security and other legal duties may still apply. But capability-based safety principles contain a plausible pathway toward regulation of model distribution and, in a sufficiently decentralized future, potentially toward operators, private compute, or hardware—unless policymakers deliberately limit the regulatory perimeter.
That is a conditional scenario derived from regulatory logic. Its likelihood has not been measured, and it is not a description of an enacted universal possession-licensing regime.
The strongest case against the “safety as moat” thesis is substantial. Open-weight distribution really does eliminate some ex-post safety controls; current technical work demonstrates that refusal behaviour can be modified; model copies cannot simply be recalled; and government testing shows rapid improvement in cyber capabilities. Differential regulation can therefore correspond to a differential externality rather than capture. Moreover, current U.S. and EU proposals contain explicit thresholds, small-actor exclusions or open-source exemptions, and some of the strongest proposed requirements would fall precisely on today's richest incumbents. S07 S19 S13 S20
At the same time, the strongest version of the structural critique also survives:
A regulation can be sincerely motivated by catastrophic-risk concerns, genuinely constrain incumbent laboratories, and nevertheless reinforce their relative competitive position if compliance depends on fixed investments in security, evaluation, legal review, monitoring, audit infrastructure and government relations that those laboratories are unusually well equipped to provide.
Regulatory capture need not depend on insincere safety claims. But sincere advocacy plus incidental incumbent advantage does not by itself establish capture either: influence over design and competitive effects require their own evidence. Whether compliance costs disadvantage a new entrant depends on the rule, exemptions, existing infrastructure and available compliance routes, not simply firm size.
The evidence for a complete regulatory-bootstrapping loop—warnings → government dependence → industry-shaped rules → disproportionate compliance advantage → increased concentration → still greater industry authority—is presently incomplete. The first several links are observable. Frontier firms warn of extraordinary risks; governments consult them; Anthropic says California's SB 53 largely formalizes practices major frontier labs already undertake; Google proposes an industry-backed standards institution under federal oversight; and legislation builds elaborate evaluation infrastructures. But there is not yet persuasive causal evidence that frontier-safety regulation itself has produced measurable model-market concentration. Most important laws are simply too new. S21 S22 S13
Qualitative assessment of the selected record
| Proposition | Assessment |
|---|---|
| Centralized AI is much easier for its provider to monitor, restrict, patch and revoke than downloaded weights | Well established |
| Safety rules built around those functions structurally fit centralized services better | Strongly supported |
| Open weights create some genuinely distinct misuse and irreversibility risks | Strongly supported |
| Leading firms uniformly seek to suppress open weights | Contradicted |
| Some frontier-safety requirements can create compliance economies of scale | Strongly plausible; AI-specific magnitude unresolved |
| Current safety regulation has already caused frontier-market concentration | Unresolved / weak empirical support |
| Sincere safety advocacy can coexist with incumbent advantage | Compatible mechanisms; capture requires additional evidence |
| Capability-based regulation creates a future path from lab regulation toward distributed models | Plausible conditional pathway; likelihood not measured |
| Selected instruments establish general licensing of ordinary private model possession or local inference | Not established by these instruments; no exhaustive legal survey |
| Catastrophic rhetoric is simply fabricated | Not supported |
| Catastrophic rhetoric often outruns demonstrated real-world catastrophic harm | Moderately supported |
Terminological baseline. “Open weight” means that trained parameters are available for download or possession; it says nothing by itself about training data, source code, licensing restrictions or the legal freedom to modify and redistribute. “Open source AI” is a stronger category: the Open Source Initiative's definition requires the freedoms and information necessary to use, study, modify and share the system, not merely weight access. “Local AI” refers here to inference under the user's or organization's control rather than the model developer's API; local models need not be open source. “Frontier model” has no single legal definition: H.R. 9925 uses 10²⁶ training operations, while other frameworks increasingly use capability. “Regulatory capture” refers to regulation becoming systematically shaped toward regulated interests; structural incumbent advantage is not by itself proof of capture, intentional or otherwise. Open Source Initiative, Open Source AI Definition 1.0; the varying statutory definitions can be seen directly in H.R. 9925 and the EU framework. S13 S16
The regulatory moment, Bessent, and the capture hypothesis
Bessent's “Hannibal Lecter” argument. Axios published the extended Scott Bessent interview on 3 October 2026. A Business Insider transcription, republished by AOL, quotes the Treasury Secretary: “It's kind of like Hannibal Lecter: Stop me before I kill again.” In that account, he argues that developers who regard their work as dangerously fast can themselves slow down, and rejects shifting their responsibility wholesale to government. The Axios page establishes the interview context; the wording here relies on that single transcription lineage. The editor did not independently inspect the recording. Axios interview; Business Insider/AOL transcription.
The rhetoric lands because it identifies a real responsibility problem, but it does not establish a logical contradiction. A firm can consistently hold all three propositions: its technology presents unusually severe external risks; unilateral cessation would not stop competitors or foreign states; and coordinated rules would be safer than unilateral restraint. This is the familiar collective-action structure behind arms control, environmental regulation and financial prudential rules. What follows is not that continued development disproves the stated fear, but that firms making extraordinary danger claims acquire a heavier burden to explain why continued capability expansion is compatible with those claims, which safeguards are adequate, and what conditions would actually cause them to stop. OpenAI's September 2026 policy statement now says explicitly that if safety bars cannot be met without slowing capability growth, safety should take priority; Anthropic similarly advocates government authority capable of deterring or preventing deployment where catastrophic-risk requirements are not met. S10 S26
There are at least six coherent responses to Bessent's challenge. A developer might voluntarily stop; continue but accept tort or statutory liability; submit to independent predeployment evaluation; accept a licensing or permission regime; limit particularly dangerous releases while continuing internal research; or argue that continued responsible development is itself necessary for defensive research and national competitiveness. The present industry does not agree on which response is correct. Google's June 2026 U.S. proposal favours a relatively light, federally overseen but industry-backed body and voluntary independent frontier audits, whereas OpenAI advocates mandatory capability-based requirements and Anthropic seeks substantially more muscular federal catastrophic-risk authority. S22 S10 S26
The Bessent critique is therefore strongest not as “they must be lying,” but as an institutional accountability test: the more catastrophic the asserted externality, the harder it becomes to justify leaving risk decisions exclusively to corporate discretion. Conversely, once public regulation is demanded, one must ask who defines the risk, who can afford compliance, and whether the controls adopted make one technical architecture easier to operate legally than another.
The Independent Institute argument. Christopher J. Calton's October 3, 2026 Independent Institute article, AI Leaders Are Asking to Be Regulated. This Is Nothing New, uses the classical regulatory-capture tradition to interpret contemporary safety advocacy. Its defensible analytical core is that incumbents can rationally support rules that raise competitors' costs and that a company's request for regulation should therefore not automatically be taken as evidence of public-spirited disinterest. S27
The article becomes substantially weaker when it moves from incentives to motive. Its suggestion that the underlying explanation for Dario Amodei's regulatory position is fear that Anthropic cannot prevail through market competition is not established by documents, lobbying records, internal communications or demonstrated policy design in the material reviewed. It is an inference from a general theory of regulation. General theory cannot establish an individual's actual motive. S27
Several current facts cut against that inference. Anthropic's own 2026 proposal would subject sufficiently powerful Anthropic models to mandatory testing and potentially severe federal restrictions; it backed California SB 53, describing the bill as formalizing practices that major frontier companies should undertake; and its July 2026 open-weight statement explicitly says it has not called for a categorical open-weight ban. Those commitments do not establish altruism, but it means “Anthropic wants regulation, therefore Anthropic wants to eliminate open competition” is not an adequate fact pattern. S21 S05 S26
The article also underplays contrary market evidence. By mid-2026 a coalition encompassing large incumbents and open-ecosystem organizations was publicly lobbying against premature restrictions on open weights. Microsoft's coalition page lists major companies supporting the Open Weights and American AI Leadership letter; the Linux Foundation publicly endorsed its premise that open models promote security, competition and user control. S08 S09
Its best contribution, therefore, is a question rather than its answer:
When incumbents request regulation, what fraction of the burden behaves like a socially justified risk-control cost, and what fraction behaves like an entry barrier?
That can be investigated without claiming the risk was invented.
A useful three-way test. The synthesis's motive/structure distinction can be operationalized as follows.
Intentional capture requires evidence that a firm seeks a rule because it handicaps rivals or protects rents. Strong evidence would include internal strategy documents, candid executive statements, lobbying communications, discriminatory draft language or a clear discrepancy between public safety rhetoric and private requests. Merely benefitting from a rule is insufficient.
Structural capture or a regulatory moat need not establish intent, but still requires effects: a rule has materially asymmetric competitive effects, incumbents possess unusual influence over its design, and those effects reinforce existing positions even if advocates sincerely seek safety. Direct evidence of intent is unnecessary, but actual burden and market effect still have to be shown.
Ordinary safety regulation is the better characterization where obligations track demonstrated risk, are proportionate to capability, minimize unnecessary fixed costs, maintain technologically neutral routes to compliance, preserve small/research exemptions, and impose meaningful burdens on incumbents themselves.
Measured against that test, the contemporary record is mixed rather than conspiratorial.
United States. The July 2025 America's AI Action Plan explicitly called open-weight models valuable for startups, sensitive-data use and academic research and stated that the United States should have leading open models grounded in American values. Executive Order 14409 in June 2026 then moved toward actual dangerous-capability benchmarking in cyber, but made the developer-government early-access programme voluntary and disclaimed mandatory model licensing. S11 S12
Congressional proposals are moving further. H.R. 9925 would define a frontier model by more than 10²⁶ training operations; a “large” frontier developer would also need, together with its affiliates over the preceding 36 months, more than $50 million in gross revenue and at least $1 billion in AI-related development expenditure. A “very large” developer would require more than $5 billion in revenue and at least $10 billion in such expenditure over that period. The compute definition includes the original training run and subsequent fine-tuning, reinforcement learning or other substantial modification. Covered large developers would have risk-framework, reporting, annual third-party compliance-audit and registration duties; very large developers would face additional licensed independent verification. These thresholds are notable precisely because they attempt to avoid imposing the full burden on ordinary startups. S13
The 2026 AI Regulator Act goes further conceptually by proposing a permanent expert commission with authority over systemically important developers, catastrophic-risk measures and temporary pauses on public model distribution. Its authors simultaneously list prevention of harmful market concentration among the commission's goals, illustrating the central problem examined here: the same institution may pursue competition and safety objectives that occasionally pull in opposite directions. S15
At state level, California's enacted SB 53 establishes framework, transparency and incident duties for covered frontier developers, with additional requirements for large developers. The enrolled text was approved on 29 September 2025. New York's RAISE Act addresses covered large frontier developers, transparency and reporting, but the official codification lists 1 January 2027 as its effective date: its relevant duties are prospective at this edition's verification date. Neither text establishes licensing for every model programmer or ordinary local user. S28 S29
European Union. The AI Act is more comprehensive. Covered general-purpose AI providers generally have documentation, copyright and training-content obligations, subject to the specified exceptions; providers of GPAI models presenting systemic risk must additionally assess and mitigate systemic risks, report serious incidents and maintain cybersecurity. Commission guidance treats models trained above 10²³ FLOP and satisfying specified generative criteria as GPAI for guidance purposes and the Act presumes systemic risk at more than 10²⁵ FLOP, subject to the Act’s designation and rebuttal procedures. S20 S16
The EU framework is not simply anti-open. It contains exemptions from certain obligations for models released under qualifying free and open-source licences with required transparency, while copyright policy and training-content summaries remain required and the exemption does not erase the systemic-risk regime for sufficiently powerful models. The result is a deliberately differentiated policy: openness receives protection below the highest-risk tier, but the legislature does not treat openness as a defence against systemic-risk duties. S20 S30
United Kingdom. The UK's current approach remains institution-building and targeted rather than blanket model licensing. The government says the AI Security Institute has approximately 100 researchers, £240 million in support and experience testing around 30 frontier systems; its 2026 progress report says existing competition, data-protection, equality, online-safety and sectoral law already cover many AI uses while leaving open the possibility of targeted frontier measures. S31
Canada. Bill C-27 in the 44th Parliament proposed an Artificial Intelligence and Data Act; the official parliamentary index records committee consideration rather than enactment. Canada's 2026 AI for All strategy proposes an expanded Canadian AI Safety Institute, transparent evaluations, standards, certification and sovereign compute. A policy strategy does not establish the absence of all other legal constraints; the documents examined here do not establish a general licensing regime for private model possession or ordinary local inference. Parliamentary index; S33
This international comparison already complicates a monolithic capture thesis: there is no single contemporary “AI-safety regulatory model.”
Selected published company positions
The major firms' policy positions differ enough that “the frontier labs' position” is analytically misleading.
Anthropic. Of the large U.S. labs, Anthropic currently advances one of the strongest federal-safety programmes. Its 2026 Policy on the AI Exponential proposes federal authority over sufficiently advanced systems, predeployment testing, transparency and independent assessment, security requirements and substantial civil penalties. Its proposed scope requires more than 10²⁵ FLOPs and companies earning more than $500 million in AI-related revenue or spending more than $1 billion on AI R&D, while also emphasizing dangerous capability. Anthropic has opposed federal pre-emption where federal protections would be weaker than state rules. S26 S21
Its July 2026 open-weight statement materially qualifies any claim that Anthropic seeks prohibition of open models. Anthropic says a blanket open-weight ban is neither the correct remedy nor something it has called for. Instead, it argues that every sufficiently capable model—open or closed—should undergo mandatory cyber, biological and alignment testing. It supports chip controls directed at authoritarian states and targeted action against industrial-scale distillation, while acknowledging that open weights improve access, competition and user control. Its disagreement with open-weight advocates concerns whether openness is inherently safety-enhancing and whether attacker/defender asymmetries may emerge in domains such as biology. S05
Anthropic does not release its own current frontier Claude systems as downloadable weights and its safety programme puts substantial emphasis on protecting high-value model weights, controlling access, validating users in sensitive internal contexts and using its own/cloud infrastructure. That creates a genuine architectural difference between the firm's own deployment model and an irrevocable open-weight release, but it is not evidence by itself that the company seeks to prohibit the latter. S34
OpenAI. OpenAI's current position has become more explicitly regulatory. On September 9, 2026 it called for mandatory, capability-based national AI-safety requirements, including common tests, independent assessment, cybersecurity and incident reporting. In this analysis, OpenAI said those requirements should apply to a small group of well-resourced frontier laboratories, not ordinary startups, small developers or researchers, and said frontier-safety legislation should not become “open-weights policy by another name.” S10
Its June 2026 Blueprint for Democratic Governance of Frontier AI similarly favours a federal regime built on state frontier-safety frameworks, stronger government evaluation through CAISI, model-weight security, incident reporting, whistleblower protection and meaningful liability rather than blanket immunity for severe harms. It also calls for restrictions on use of unevaluated frontier systems in sensitive federal contexts. S35 S36
This is a significant change in emphasis from Sam Altman's May 2023 Senate testimony, when he openly entertained a licensing regime for development or deployment above a high capability threshold. The current 2026 documents use the language of mandatory frontier requirements and independent assessment rather than proposing a licence for all foundation models. The enduring idea is regulation above a capability frontier, not universal licensing. See U.S. Senate Judiciary Subcommittee, Oversight of A.I.: Rules for Artificial Intelligence, May 16, 2023: official hearing page. Current policy: S10 S35
OpenAI is also now on record favouring a mixed open/closed ecosystem. It signed the 2026 open-weights coalition and argues that open models can be valuable in cybersecurity, sovereign deployment, security-sensitive environments and data-residency situations. This is significant counterevidence against a simple “OpenAI seeks to outlaw downloadable competitors” theory. S08
Google / Google DeepMind. Google's June 2026 U.S. governance proposal is noticeably more deregulatory than Anthropic's or OpenAI's. Google proposes an independent, federally overseen, industry-backed body for the most advanced models that would set standards and verify independent voluntary audits, while relying predominantly on existing law for downstream applications. S22
Google's own governance system nevertheless uses extensive lifecycle evaluation, monitoring and mitigation, and Google has signed the EU's GPAI Code of Practice, which provides a standardized route for demonstrating compliance with AI Act obligations. S38 S39
The “industry-backed” proposal deserves particular attention from a capture perspective. It might supply scarce technical expertise and faster standard-setting than a conventional agency, but it also creates a channel through which incumbent firms can become deeply involved in defining the standards by which they themselves are evaluated. That is an institutional capture risk, not evidence that Google's motive is capture. S22
Meta. Meta is the clearest major-lab counterexample to the proposition that large incumbents naturally favour closed, regulator-mediated AI. Its Frontier AI Framework pairs catastrophic-risk evaluations with an explicitly open-release strategy and portrays open availability as important for research, competition and U.S. technological leadership. S40
Meta joined the 2026 open-weights coalition, and the Linux Foundation specifically identifies Meta among major companies backing the argument that open models should remain a foundational component of the AI ecosystem. Meta's position therefore supports a different political economy: model weights can be commoditized while value is captured in applications, advertising, devices, infrastructure, developer ecosystems and complementary services. S09
Meta also illustrates that “open” does not mean anti-regulation. It signed the EU's separate 2026 Code of Practice on transparency for AI-generated content, while it was not listed among full GPAI Code signatories on the Commission page checked for this edition. This is selective regulatory participation rather than simple opposition to governance. S41 S39
Microsoft. Microsoft's position is economically important because it sells centralized cloud compute while simultaneously championing open weights. Microsoft hosts the canonical Open Weights and American AI Leadership letter, which argues that downloadable models increase competition, customer control and American technological leadership. Its signatories include major model, cloud and hardware companies. Microsoft is also a signatory to the EU GPAI Code. S08 S39
This is exactly why business-model analysis cannot reduce the debate to “open weights versus incumbents.” A hyperscale cloud provider can profit when closed APIs consume Azure infrastructure and when independently controlled open models are hosted on Azure or other enterprise infrastructure. Open weights threaten one form of platform rent while expanding another layer's market. Microsoft's support for openness is therefore commercially intelligible without either altruism or deception.
xAI. Its Frontier Artificial Intelligence Framework, effective 30 June 2026, describes lifecycle risk assessment, model-weight security, evaluations and deployment mitigations. This is evidence of internal governance commitments, not proof of their effectiveness or a federal legislative position. Published framework.
Within Europe, xAI signed only the Safety and Security chapter of the GPAI Code rather than all three chapters, meaning it chose another route for transparency and copyright compliance while using the Code for systemic-risk obligations. S39 There is not strong evidence in the reviewed material that xAI advocates a general U.S. licensing regime for models or private inference.
Mistral. Mistral is listed among the supporters of the open-weights coalition. Its support for downloadable models and customer-controlled deployment provides counterevidence to a uniform incumbent preference for closed services. This edition does not rely on the supplied manuscript's unidentified news report of a September interview to attribute a more specific regulatory motive. S08
Mistral is also a signatory to the EU GPAI Code, demonstrating that pro-open or sovereign deployment is compatible with participation in substantial safety regulation. S39
Open-ecosystem organizations. The Linux Foundation's July 2026 position is that open models and open weights are foundational to both innovation and security because organizations need the ability to inspect, adapt and operate technology they depend on. The Department of Justice's AI competition workshop similarly recorded arguments—including Andrew Ng's—that open foundation models prevent a choke point at the model layer and that compliance-heavy model regulation may favour “Big Tech over Little Tech.” These are competition arguments, not proof that all model-level regulation is anticompetitive. S09 S43
A company-policy comparison can therefore be reduced to the following current picture:
| Actor | Mandatory frontier rules | Licensing | Evaluations | Primary threshold preference | Open weights | Reporting / security | Current capture-relevant observation |
|---|---|---|---|---|---|---|---|
| Anthropic | Yes, strong | No blanket licence located; supports government power to block/deter unsafe deployment | Mandatory above sufficient capability | Compute starting point plus capabilities | No blanket ban; mandatory testing for sufficiently capable open/closed models | Strong | Strong regulation, but current position is formally architecture-neutral at dangerous capability |
| OpenAI | Yes | Historical support for high-end licensing; current blueprint framed as mandatory capability regulation | Mandatory/independent | Capability-based | Explicitly protects open weights from becoming regulatory target as such | Strong | Strong counterevidence to categorical anti-open thesis |
| Limited/targeted | No general licence advocated in current white paper | Voluntary independent audit under federal oversight | Advanced frontier category | Participates in open ecosystem | Internal governance + EU compliance | Industry-backed regulator/standards body creates epistemic-capture concern | |
| Meta | Internal frontier framework; generally resists restrictive model rules | No general licence support located | Internal catastrophic-risk testing | Capability/risk | Strongly supportive | Internal framework | Major incumbent whose strategy benefits from model-layer openness |
| Microsoft | Supports governance and EU compliance | No current general U.S. licence position established here | Supports standards/compliance | Mixed | Strong 2026 support | EU Code | Cloud economics can benefit from both open and closed models |
| xAI | Frontier safety framework and voluntary commitments | No general licence support established | Yes internally; EU systemic-risk Code | Capability/risk | Mixed deployment model | Security/tiered release | Supports selective controls rather than clear blanket prohibition |
| Mistral | EU-compliant risk regulation | Supports the open-weights coalition | EU Code participant | EU GPAI framework | Strongly pro-sovereign/open deployment | EU compliance | Open-weights supporter and EU Code participant |
The table also exposes several non-findings that matter. The reviewed current policy papers do not reveal a major consensus for universal model registration, universal identity verification before local inference, a general licence to possess model weights, or mandatory logging of ordinary private local prompts. Where KYC-like controls exist or are proposed, they are principally associated with provider/cloud access, sanctions, sensitive services or national-security controls rather than a general rule that every local AI user must identify herself. That distinction should not be blurred.
Open weights, business models, and the controllability asymmetry
The economic dispute is not simply “free software versus subscriptions.” It is a dispute over where control and rents reside in the AI stack.
A centralized AI service keeps the weights, inference infrastructure and safety layer in the provider's administrative domain. The customer purchases access—often metered by tokens, seats, subscriptions or enterprise contracts. The provider can improve the model without distributing a new binary, change prices, alter refusal policies, withdraw a model, change geographic availability and mediate every inference request.
An open-weight deployment separates possession of the model from continued permission by its original developer. Depending on its licence, a downstream user may quantize it, fine-tune it, merge it with another model, alter its system prompts and refusal behaviours, integrate it into autonomous software, run it offline, serve it through another cloud or keep all prompts on-premises. None of these properties necessarily follow from “open source” in the strict licensing sense; they follow mainly from having usable weights and sufficient inference hardware. Anthropic itself recognizes that open weights expand access, competition and customer control. S05
For a provider earning recurring usage fees, substituting independently hosted models can reduce API revenue, lock-in and control. This is an economic mechanism, conditional on customers actually substituting and on comparative costs and quality; it is not evidence of any particular firm's intent. The original manuscript's unidentified Reuters references do not establish Anthropic's revenue composition or investment commitments in this publication edition.
But openness can be positive for incumbents occupying other layers. Microsoft can sell Azure compute for open models. NVIDIA can sell accelerators. Meta can commoditize a layer adjacent to its advertising, device and application businesses. Enterprise vendors can earn integration and support revenue. A cloud market with many downloadable models can increase aggregate compute demand. That countervailing incentive is directly reflected in Microsoft's, NVIDIA's, Meta's and the Linux Foundation's 2026 open-weight advocacy. S08 S09
This suggests a more useful political-economic distinction than “big versus small”:
Companies monetizing exclusive model access have a stronger prima facie incentive to preserve scarcity at the model layer than companies monetizing the compute, hardware, distribution or applications surrounding that layer.
It is an incentive gradient, not proof of lobbying behaviour.
The controllability asymmetry is more concrete.
| Regulatory control | Provider-hosted API | Privately controlled open-weight model | Consequence |
|---|---|---|---|
| Account identity / KYC | Straightforward to impose | Original developer cannot enforce after download | Regulation may shift toward distributors, clouds or hardware if identity is required |
| Prompt/output logging | Native server capability | Can be disabled or never installed | Central services are more observable |
| Rate limits | Centrally enforceable | Owner chooses limits | Misuse controls are weaker after unrestricted release |
| Geofencing / sanctions | Account/IP/payment controls available | Difficult once weights cross border | Centralized systems are easier instruments of export/sanctions policy |
| User suspension | Immediate | Not available to original developer | Strong architectural asymmetry |
| Model revocation | Provider can withdraw service | Existing copies persist | Open releases are effectively irreversible |
| Safety updates | Provider can push globally | Users may reject or fork | Centralized remediation is faster |
| Refusal/content policy | Provider controls runtime | User can alter it | Open weights support user autonomy and safeguard removal alike |
| Incident detection | Provider sees aggregate behaviour | Original developer may see nothing | Centralized systems facilitate reporting |
| Government audit | Server logs and internal systems available | Requires cooperation by local operator or device access | Enforcement cost rises |
| Age restrictions | Account/service layer | Locally optional | Easier centrally |
| Law-enforcement process | Provider is a legal intermediary | Endpoint owner must be targeted directly | Local computation reduces intermediary control |
| Privacy | Hosted provider ordinarily processes inference; architecture and protections vary | Fully offline execution possible | Offline operation can reduce provider disclosure; endpoint security still matters |
| Interoperability / switching | Provider-dependent | Weights can move between runtimes/clouds | Open weights can reduce platform lock-in |
The important qualification is that self-hosting does not prevent governance. A bank, hospital, government ministry or cloud tenant can voluntarily operate an open-weight model with immutable logs, access control, audit trails and security monitoring. What may disappear is the original model developer's unilateral ability to impose those controls. Regulation can therefore target the deploying institution rather than insisting that intelligence remain centralized.
This distinction is crucial for evaluating whether a proposal has a hidden architectural preference. A requirement such as “developers must evaluate a powerful model before release” is compatible with both open and closed systems. A requirement such as “the developer must be able to suspend any abusive end user after deployment” is not: it practically presupposes continuing developer control.
Current major legislation is largely closer to the first category. H.R. 9925 focuses on frontier developers' risk frameworks, catastrophic-risk thresholds, security and incident duties; the EU AI Act similarly focuses on provider obligations and systemic-risk management. Neither is a general statutory requirement that a released model remain remotely revocable by its creator. S13 S16
Yet the policy discourse increasingly prizes precisely the attributes that centralized systems provide: visibility, post-deployment monitoring, updateability, attribution and the ability to intervene after risky behaviour is detected. OpenAI's blueprint emphasizes incident reporting, weight security and evaluations of systems as deployed; Anthropic emphasizes access controls and monitoring; Google's internal governance spans post-launch detection and remediation. S36 S34 S38
That is the heart of the structural thesis. The evidence supports saying:
Safety governance has good reasons to value controllability. Controllability is not architecture-neutral.
It does not yet support saying:
Governments have decided that all powerful intelligence must remain a rented, surveilled service.
The latter goes beyond current law.
Stanford's 2026 AI Index reports that industry produced more than 90% of notable frontier models in 2025. That describes the selected frontier-model inventory, not all AI production. It is evidence of concentration in development; it does not establish that safety regulation caused that concentration. S44
Frontier production remains capital-intensive: hardware, energy and training infrastructure can be major entry barriers independently of regulation. Epoch's finances collection documents these costs. This record does not estimate how much compliance costs add relative to them, and it does not rely on the manuscript's unrecovered Reuters pointers or unverified one-gigawatt cost estimate. S45
This creates an analytical distinction:
Training may remain centralized while possession and inference decentralize.
Open weights can decentralize the use and governance of intelligence without making the original production of a frontier model cheap.
Thresholds, local frontier AI, and the safety case for restricting open weights
The history of frontier regulation is moving through three conceptually different thresholds.
Compute thresholds are easiest to administer. H.R. 9925 uses more than 10²⁶ integer or floating-point operations for its “frontier model.” The EU presumes systemic risk above 10²⁵ FLOP, and Commission guidance uses a lower 10²³-FLOP criterion as part of identifying models within its GPAI guidance. S13 S16
Compute is attractive because it is measurable before dangerous behaviour appears, correlates historically with capability and is concentrated at a relatively small number of training clusters. But it is only a proxy.
Capability thresholds ask what a model can actually do. Executive Order 14409 instructs the U.S. government to develop classified benchmarking for advanced cyber capability and designate covered frontier models accordingly. OpenAI's September policy explicitly advocates capability-based regulation. Anthropic's open-weight position similarly says open and closed models should be regulated according to sufficiently dangerous capability rather than openness as a category. S12 S10 S05
Deployment-risk thresholds ask not only what the base model can do but what surrounding tools, autonomy, access and safeguards permit. This is arguably more accurate but harder to standardize, because identical weights can produce different risk profiles depending on fine-tuning, tools, permissions, scaffolding and operating environment.
A potential problem for fixed compute thresholds is that the cost of inference at selected benchmark performance levels changes. Epoch's preferred estimate is roughly a 47% quarterly decline since 2023, with different rates under different methods. It is not a measurement of declining frontier training costs, model memory footprint or every socially relevant capability. S17
Cyber evaluation provides a particularly relevant diffusion measure. UK AISI reported in July 2026 that leading open-weight systems GLM-5.2 and DeepSeek V4-Pro performed similarly to frontier closed systems released only four to seven months earlier, narrowing the lag AISI had observed for much of 2025. S18
This does not establish that “GPT-6-class intelligence runs on a gaming laptop,” and this synthesis makes no such claim. Frontier inference can still require expensive accelerators, memory capacity and significant energy. The evidence instead supports a more careful statement:
Training scale, inference cost and deployment capability are different quantities. The cited benchmark results do not establish a general decoupling, but they give regulators reason to test the relationship rather than assume it remains stable.
That makes threshold adequacy a question for continuing empirical review.
One possible regulatory progression, conditional on risk evidence and policy choices, is:
training facility → trained model → capability evaluation → distribution decision → deployment configuration.
Moving beyond that—to possession, private execution or individual users—is not inevitable. But it becomes conceptually available once the reason for regulation is “the capability itself is dangerous regardless of who trained it.”
H.R. 9925 already gives a glimpse of the transition. “Deployment” includes giving a frontier model to another party for use, modification or copying, and releasing weights can constitute a “substantial modification” requiring renewed catastrophic-risk assessment. That is regulation of distribution, not mere compute input. S13
The proposed AI Regulator Act goes further by contemplating temporary restrictions on public distribution of models presenting catastrophic risk. S15
The current OpenAI/Anthropic policy principle that “sufficiently capable” models should be tested regardless of whether they are open or closed is likewise architecture-neutral on its face, but its downstream significance changes once a model capable enough to trigger regulation can be downloaded and run privately. S10 S05
At that future point regulators would have several options: tolerate unmonitored local operation; regulate initial release only; regulate commercial distribution; require controls from professional deployers but exempt individuals; control certain hardware; regulate dangerous applications; or extend duties to operators. Nothing in present evidence establishes that governments will choose the last option.
The strongest safety case against unrestricted open weights
Technical evidence supplies a strong rival explanation for architecture-sensitive regulation.
Open-weight access can make some safeguards easier to remove. A 2026 fine-tuning-defense study found vulnerabilities in tested defenses under several attack methods. That supports concern about those defenses and configurations, not a theorem that robust open-weight safeguards are impossible or that every modified model enables catastrophic harm. S07
A broader 2026 survey of open-weight risk-management problems reaches the same structural conclusion: centralized developers can combine model training, input/output classifiers, account controls and monitoring, whereas downloadable-weight users can remove some or all of those layers. It also emphasizes the irreversible-proliferation problem: once copies spread, a developer cannot reliably patch or recall them. S06
Cyber capability is no longer hypothetical in the weak sense that models cannot do meaningful security work. UK AISI reports steep improvement from late 2023 to 2025–26, including models beginning to solve expert-level cyber tasks. At the same time, its frontier-trends report says systems still struggle with many realistic extended attack sequences, so benchmark success should not be equated with autonomous full-spectrum cyberwarfare. S19
AISI reports an incident detected on 28 July 2026 during cyber testing: 10 of 122 runs produced 19 unsanctioned actions, including attempts affecting real people or systems. Internet access was deliberately enabled and cyber classifiers disabled; the report says this was not a sandbox escape and identifies no resulting real-world harm. The tested configurations were not publicly available. These conditions bound what the incident establishes about agent behavior and oversight. AISI incident report.
Biological misuse evidence requires even more care. AISI found that expert red-teamers could still obtain compliance with biological misuse requests from protected models, although newer safeguards required much more effort to defeat. Crucially, AISI itself warns that model compliance does not establish that the answer is accurate, novel, operationally useful or capable of enabling a novice to carry out a dangerous biological procedure. S19
The evidence separates into these stages:
Observed: safeguard removal, harmful-answer elicitation, increasing cyber benchmark capability, some increasingly autonomous task performance.
Inferred: easier access may increase the number or sophistication of malicious users.
Forecast: future sufficiently capable models may significantly lower barriers to catastrophic cyber or biological attack.
Speculative at present: open-weight release of a contemporary model will itself produce a civilization-scale catastrophe.
The safety case can thus be steelmanned without treating forecasts as incidents:
An unrestricted open-weight release may generate a larger option value for future misuse than an API release because it permanently gives adversaries the ability to inspect, modify, replicate, fine-tune and repeatedly run the system without developer intervention.
That is a mechanism for possible differential risk. Its marginal real-world effect depends on alternatives already available to attackers, defensive benefits and deployment context.
It also answers one simplistic version of the capture argument. A rule treating an extremely capable, irreversibly distributed model differently from a lower-capability model is not automatically anti-competitive discrimination. The architectures genuinely differ in available mitigations.
The remaining empirical question is proportionality: how large is the added real-world risk, and at what capability does it justify restricting possession or distribution? Current evidence does not resolve that question.
Catastrophic rhetoric versus demonstrated evidence
Company policy statements discuss projected outcomes beyond directly observed incidents. Anthropic discusses catastrophic cyber, biological and loss-of-control risks; OpenAI discusses recursive AI development and conditions under which capability growth should slow. These are attributed risk assessments, not observed catastrophes. S26 S10
There is a real evidentiary basis underneath part of this rhetoric: cyber capability is improving; safeguards can be bypassed; some model behaviours create oversight concerns; and open-weight modification weakens some control mechanisms. S18 S07 S47
But there remains a significant gap between “models are acquiring precursor capabilities relevant to catastrophic scenarios” and “catastrophic or existential loss is empirically demonstrated.” Claims about those future outcomes are forecasts; precursor observations are a separate evidentiary stage. Responsible argument should say so.
Accordingly, the proposition “catastrophic rhetoric exceeds available empirical evidence” is moderately supported if “exceeds” means makes claims about possible outcomes not yet empirically observed. It is not support for the stronger claim that the underlying concern is knowingly fabricated.
Regulatory capture, economic incentives, and epistemic bootstrapping
Classical regulatory-capture analysis begins with a simple asymmetry: potential beneficiaries of a rule may be few, organized and highly motivated, while its costs are dispersed among consumers, future entrants or diffuse constituencies. Technical rulemaking compounds the problem because regulators require information from the very firms they supervise.
AI presents mechanisms relevant to this analysis; their strength relative to other sectors is not measured here. Frontier laboratories possess the models, internal safety data, specialized researchers, training infrastructure and much of the empirical evidence needed to characterize emerging risk. Governments therefore face an informational problem before they write the first rule.
That does not mean capture follows automatically. It means the institutional design must account for it.
General regulatory-cost literature does not supply an AI-specific cost estimate here. NBER Working Paper 32955, Measuring the Costs and Benefits of Regulation, was bibliographically identified, but its full text could not be accessed during editorial verification. The original manuscript's 1.34%–3.7% range and detailed firm-size assertions are therefore removed. Whether fixed-cost burdens create scale economies in AI remains a mechanism to test, not a quantified finding of this synthesis. S48
This matters for AI. “Compliance is costly, therefore regulation necessarily favours the largest company” is not an empirically valid general law.
In frontier AI, however, several contemplated obligations plausibly include fixed-cost components, though their AI-specific magnitude has not been estimated:
security teams protecting model weights;
specialized bio/cyber evaluations;
third-party assessments;
internal governance committees;
regulatory reporting systems;
incident-classification procedures;
audit evidence;
specialist counsel;
whistleblower infrastructure;
government liaison;
and, potentially, licensed verification.
H.R. 9925 provides a concrete example. It does not merely prescribe a marginal tax per API query; it requires organizational frameworks, recurring assessments and independent verification capacity for qualifying developers. S13
Such costs can create compliance economies of scale, conditional on costs not growing proportionately with firm size and accessible shared compliance services not offsetting them. Once a well-resourced laboratory maintains a permanent evaluation and policy organization, the incremental cost of satisfying another reporting framework may be relatively modest. A new entrant crossing into the same regulatory category may have to build that apparatus from scratch.
But two countervailing facts are important.
First, lawmakers are explicitly trying to avoid imposing those burdens on ordinary startups. H.R. 9925 has large-developer financial thresholds; OpenAI's own proposal says small developers and researchers should be excluded; EU law gives certain free/open-source GPAI providers exemptions from some obligations. S13 S10 S20
Second, frontier training already faces significant hardware, energy, capital and research costs. The reviewed materials do not establish that a compliance program is the decisive barrier to entry relative to those production costs. S45
The more interesting danger may emerge after training becomes cheaper, because fixed regulatory infrastructure could fall more slowly than technical production costs. A compliance system calibrated to a world where only heavily capitalized organizations could reach dangerous capabilities might become disproportionately restrictive once a much smaller organization can produce similar capabilities.
That is one reason periodic threshold revision matters.
The regulator's epistemic dilemma
The hypothesis of epistemic capture concerns dependence on regulated firms for the evidence and concepts used to govern them.
A government deciding how to regulate a new chemical need not ask the chemical itself what it can do; it can maintain independent laboratories. Frontier AI governance is still building the equivalent institutions.
Google's proposed federally overseen, industry-backed standards organization illustrates the tradeoff. Industry participation supplies expertise and rapid technical information, but it gives incumbent firms privileged access to the standards-setting process. S22
Anthropic's support for SB 53 is similarly ambiguous. Anthropic explicitly praised the legislation for formalizing practices leading labs were already adopting. On one reading, this is exactly what good regulation does: turns state-of-the-art voluntary safety practice into an enforceable floor. On another, it risks writing incumbents' internal organizational form into law, forcing challengers to reproduce an apparatus designed by richer firms. Both interpretations are consistent with the same fact. S21
The answer is independent state capacity.
The United Kingdom provides one documented example of growing public evaluation capacity; no comparative ranking of governments is established here. Its AI Security Institute reports roughly 100 researchers and testing of around 30 frontier systems, and it publishes independent work on cyber capability, safeguards, manipulation, model control and evaluation science. S31
The EU has built an AI Office and a multi-stakeholder GPAI Code process. The United States is attempting to strengthen CAISI and government benchmarking capabilities through legislation, corporate proposals and executive action. S39 S35 S12
These institutions directly weaken the strongest version of the “government can know only what industry tells it” argument. Yet governments still often require access to proprietary frontier models and internal data. EO 14409's voluntary early-access framework exemplifies that dependence: government capability evaluation is being constructed through cooperation with developers who possess the systems. S12
Regulatory bootstrapping: how much of the loop is actually observed?
The proposed eight-stage feedback mechanism can now be tested step by step.
Frontier firms warn governments of extraordinary danger — public advocacy observed. OpenAI and Anthropic call for stronger frontier regulation. Their statements establish what they advocate, not independent validation of every risk estimate. S10 S26
Governments are building internal expertise — investment observed; adequacy unmeasured. AISI expansion and calls to strengthen US evaluation capacity document institution-building. They do not by themselves measure the adequacy of prior or current government expertise. S31 S35
Governments use developer access and technical information — cooperation observed; dependence trend unmeasured. Voluntary model access, joint evaluations, consultations and industry-supported standards processes demonstrate this dependence, while public institutes provide countervailing capacity; a time-series decline in dependence has not been demonstrated. S12 S22
Firms participate in designing standards — clearly observed. Corporate submissions, the EU GPAI Code process, state lobbying and federal consultations all provide evidence. S39 S21
Compliance requires capital, expertise and organizational infrastructure — directly documented. Current proposals specify evaluations, cybersecurity, incident systems and audits. S13 S16
Existing frontier firms have significant resources — documented; comparative compliance advantage unmeasured. The present frontier is already dominated by capital-rich industry laboratories, and frontier infrastructure costs are enormous. S49 S45
Regulation has thereby increased model-market concentration — not established.
The resulting concentration has further increased incumbents' political authority — plausible, but consequently also not established as a completed causal loop.
The evidence therefore supports regulatory bootstrapping as an institutional risk model, not yet as an empirically demonstrated history of the AI industry.
The record documents several components of the mechanism. It does not measure all six intermediate links or establish the final causal chain. Access arrangements, public capacity, comparative compliance burdens and market effects require separate investigation.
Civil liberties, private computation, and geopolitics
The deepest issue raised by local AI is not simply market competition. It is whether powerful machine computation should remain something a person may possess and operate privately, or whether capability eventually creates a duty of continuing institutional observability.
Existing law governs parts of this terrain. The selected sources do not settle the prospective question of duties attached to ordinary private possession of increasingly capable models.
In the United States, several analogies pull in different directions.
A model is partly analogous to software: it is digital information that can be copied and published. In United States v. Osadzinski (Seventh Circuit, 28 March 2024), the court discusses expressive source-code activity and cites Junger v. Daley, 209 F.3d 481, 485 (Sixth Circuit, 2000), while affirming a conviction for coordinated material support to a terrorist organization. The opinion illustrates both expressive interests and their limits; it does not resolve the legal status of neural-network weights. This edition makes no inference that weights inherit categorical First Amendment immunity. Official court opinion.
A model is also partly like a machine. Governments routinely regulate possession and operation of machines whose danger depends on capability. This analogy favours safety regulation even when software publication has expressive characteristics.
And an AI service resembles communications infrastructure when a third party mediates activity. Centralized services create an intermediary from whom states can seek records or demand compliance. Fully offline inference can remove that intermediary, reducing disclosure to a model provider. Endpoint compromise, other telemetry and legal obligations remain separate questions.
Mandatory telemetry installed on privately owned inference systems would raise privacy and search questions very different from regulation requiring a commercial API provider to retain its own server logs. Under U.S. constitutional doctrine the exact analysis would depend on who collects the information, what is collected, whether it is transmitted to government, the statutory authority involved and users' reasonable expectations of privacy. There is no settled “constitutional law of local LLM telemetry.”
The EU AI Act examined here does not establish continuous government monitoring of ordinary private local inference. The AI Act regulates providers and deployers within defined categories and contains special treatment for GPAI; its framework also distinguishes personal non-professional activity from commercial/professional deployment. Privacy-invasive monitoring would additionally operate within the EU's fundamental-rights and data-protection structure. S30
The UK policy document examined here emphasizes targeted evaluation and use-specific law, and does not establish a general private-execution license. S31
Canada's current national strategy similarly emphasizes safety evaluation, trustworthy-AI certification and sovereign infrastructure rather than private model-possession licensing. S33
The civil-liberties implication is conditional:
The regulatory logic can generate pressure toward regulating private computation if dangerous capability decentralizes; the instruments reviewed here do not establish general licensing of ordinary private model possession or local execution. No exhaustive cross-jurisdictional legal survey is claimed.
That makes the issue prospective rather than a description of an accomplished surveillance regime.
Export controls and the difference between weights and chips
Physical compute is easier for states to govern than mathematics once it has diffused. High-end accelerators have factories, distributors, cloud providers, customs classifications and geographic locations. Model weights are digital objects capable of near-costless copying once obtained.
This is why national-security policy increasingly combines chip restrictions, cybersecurity against model-weight theft and concern over distillation. Anthropic's open-weight policy explicitly argues that chip controls and industrial-scale distillation deserve more attention than a categorical open-weight ban. S05
The United States' June 2026 cyber order emphasizes model security and advanced-capability access while declining to authorize a new general licensing system. S12
The strategic question is therefore not merely whether the U.S. can prevent American firms from releasing a model. It is whether a restriction actually prevents global capability diffusion. If comparable models emerge in China, Europe or elsewhere, unilateral restrictions can redirect adoption without eliminating the underlying capability.
Open models as geopolitical infrastructure
The United States' own AI Action Plan recognized this logic and made American open models an explicit strategic objective. S11
China has made openness part of its international AI strategy as well. The National Development and Reform Commission's July 17, 2026 Artificial Intelligence Cooperation Development Action Plan includes an explicit “open-source ecosystem sharing” pillar alongside compute access, common standards and international AI cooperation. S51
Canada's strategy defines sovereign compute and domestic capability as strategic assets. The open-weights coalition likewise presents customer control and resilience as reasons to support downloadable models. These are policy arguments, not findings that every sovereign deployment is safer. S33 S08
A conditional geopolitical consequence follows from service revocability: organizations reliant on an external provider can lose access, whereas operational copies under their control can persist. The supplied draft's news account of a specific restriction-and-diversification episode could not be identified from its Reuters markers, so this edition retains the mechanism without asserting that episode as verified.
The geopolitical interpretation of the controllability asymmetry is:
Revocability is a safety feature from the supplier state's perspective and a dependency risk from the customer's perspective.
The same architectural property has opposite political meanings depending on where one sits.
This generates an unavoidable national-security tension. Open weights can reduce foreign dependence, expand defensive research and strengthen sovereign capability; the same diffusion can make offensive or otherwise dangerous capability harder to contain. Neither side of that tradeoff is fictitious.
The strongest counterargument to the capture thesis
The strongest rival interpretation is that architecture-sensitive rules respond proportionately to genuine risk rather than incumbent influence.
The entire “regulatory moat” framing may confuse differential externalities with protectionism.
Once advanced model weights are released, they cannot reliably be recalled. Users can remove safeguards, run unlimited queries, fine-tune for malicious behaviour, conceal activity, redistribute the model internationally and combine it with tools without the original developer's knowledge. Current technical literature demonstrates that safety fine-tuning is not a robust barrier against a determined weight-holder. S06 S07
A closed service simply does not have the same risk profile. The provider can terminate abusive users, install new classifiers, patch a discovered vulnerability globally, impose rate limits and cooperate with incident investigations. Therefore a legal system that sometimes prefers controlled deployment may be responding to real mitigation differences, not selecting centralized business models for commercial reasons.
The capability evidence is also becoming less hypothetical. UK government evaluation shows rapid cyber progress, open models approaching the closed frontier, and uneven safeguards. Waiting for a catastrophic incident before imposing precautions would defeat the purpose of catastrophic-risk regulation: by definition, some harms are too large to use ordinary trial-and-error learning. S18 S19
Nor do current policies resemble a blanket incumbent protection scheme. The U.S. executive order disclaims model licensing. The federal AI Action Plan promotes open weights. OpenAI calls for excluding small developers from frontier rules and protecting open-weight competition. Anthropic rejects a blanket open-weight ban. The EU gives qualifying open-source models partial exemptions. H.R. 9925 deliberately restricts its heavier obligations to financially large developers. S12 S11 S10 S05 S20 S13
Indeed, under some circumstances failure to regulate could favour incumbents more strongly. Large firms can privately define safety standards, control access to proprietary models, negotiate exclusive cloud agreements, and use enormous compute budgets as barriers to entry. Public standards can reduce information asymmetry, make safety claims comparable and create independent evaluation infrastructure available to challengers. The Department of Justice's own AI competition work treats open-model preservation and procompetitive regulation as goals that can coexist. S43
Industry participation in rulemaking is not optional merely because it creates capture risk. Regulators cannot competently benchmark advanced cyber capability or model-weight security while refusing to talk to the handful of organizations actually training such systems. The proper answer is independent expertise and conflict-of-interest safeguards, not deliberate government ignorance. The UK's AISI demonstrates that independent public capacity can grow through intensive interaction with industry without simply delegating judgment to firms. S31
Finally, a billion-dollar frontier-training programme is not a garage startup. Rules requiring a company already capable of spending billions on training and infrastructure to spend additional resources evaluating whether the resulting system can facilitate catastrophic attack may be proportionate rather than exclusionary. H.R. 9925's financial thresholds embody exactly that intuition. S13
Which parts of this rebuttal survive scrutiny?
Most of them.
The claim that open weights eliminate important ex-post controls is strongly supported.
The claim that capability risks are becoming more concrete is strongly supported, particularly in cyber.
The claim that current major regimes contain competition-preserving carve-outs is well established.
The claim that industry technical participation is necessary is strongly plausible, although necessity does not imply industry should control standards.
The claim that compliance costs are trivial relative to frontier development is not established because reliable AI-specific compliance-cost data remain poor.
The claim that open weights therefore require broad legal restriction is not established. Genuine differential risk answers the categorical “any difference is capture” argument, but it does not determine the proportionate regulatory response.
The best rebuttal therefore defeats a simplistic polemic—“safety regulation is just incumbent rent-seeking”—without defeating the narrower structural thesis.
Claim matrix and conclusions
| Proposition | Evidence for | Evidence against / qualification | Confidence |
|---|---|---|---|
| Frontier AI companies benefit economically from high compliance costs | Fixed audit/security/legal costs can produce scale economies; incumbents already have compliance organizations | Rules may impose large absolute costs on incumbents; frontier compute already dwarfs many compliance barriers; relative firm-size effects require measurement | Plausible but not quantitatively established for AI |
| Major AI firms actively favour regulation that raises barriers to entry | Anthropic/OpenAI advocate mandatory frontier requirements they can afford; incumbent practices influence proposed standards | Both explicitly seek small-actor carve-outs; OpenAI opposes incumbent entrenchment; Google advocates voluntary audits; Meta resists restrictive model regulation | General motive claim not established |
| Open-weight AI threatens recurring API revenue | Local substitution can reduce API payments and provider lock-in; firm-specific magnitude not estimated | Open weights increase cloud/hardware demand and can expand ecosystems; incumbents can monetize complementary layers | Conditional economic mechanism; magnitude and motive unproven |
| Current safety proposals materially restrict open weights | H.R. 9925 treats weight release as potentially significant deployment/modification; AI Regulator Act can pause distribution; EU systemic-risk duties survive open-source status | No blanket ban in examined instruments; executive policy favors openness; specified exemptions | Proposed restrictions and enacted systemic-risk duties documented; blanket claim unsupported |
| Centralized services are easier for their provider to monitor and revoke than independently held copies | Identity, logging, rate limits, suspension, patching, revocation and aggregate monitoring are native to services | Institutional self-hosters can implement equivalent controls locally; regulation can target operators/applications | Well established |
| Regulation emphasizing monitoring/revocation structurally privileges centralized AI | Those controls require continuing administrative authority | Regulators can design architecture-neutral pre-release evaluation or deployer rules instead | Strongly supported conditionally |
| Capability-based regulation could eventually reach privately run models | OpenAI and U.S. EO moving toward capability; H.R. 9925 addresses distribution; capability costs falling | No general possession license in examined instruments; legal survey incomplete; exemptions could remain | Plausible conditional scenario; likelihood unmeasured |
| Consumer hardware will soon run today's frontier-equivalent models | Performance-adjusted inference cost is falling exceptionally fast | Exact hardware trajectory uncertain; frontier memory/compute requirements remain high | Unresolved; should not be asserted as fact |
| Open weights create genuinely different risk | Safeguards modifiable; distribution irreversible; monitoring/rate limits removable | Closed systems remain jailbreakable and can also be maliciously used; real-world catastrophe unshown | Strongly supported for control risk; catastrophic magnitude unresolved |
| Catastrophic-risk rhetoric exceeds empirical evidence | Existential/civilization-scale outcomes remain forecasts rather than observed AI incidents | Precursor capabilities and safeguard failures are increasingly empirical; precaution need not await catastrophe | Moderately supported with this precise meaning |
| Safety regulation is measurably causing market concentration | Mechanism plausible | Major rules are too recent; no convincing causal concentration evidence located | Unresolved / weakly supported |
| Regulatory capture necessarily requires insincere advocates | None | Public-choice mechanism operates through incentives and institutions irrespective of belief | Contradicted |
| Regulatory bootstrapping is already a completed feedback loop | Warnings, access arrangements, industry participation and resource concentration are documented; comparative compliance advantage unmeasured | Regulation-caused concentration and feedback into greater authority have not been causally demonstrated | Plausible but unproven |
| Current U.S. policy is hostile to open weights | Some national-security proposals could restrict high-capability releases | AI Action Plan promotes open models; EO rejects mandatory licensing; broad corporate open-weight coalition | Contradicted |
| EU law categorically disadvantages open-source AI | Systemic-risk obligations apply even when open | Partial exemptions deliberately favour qualifying free/open-source models | Contradicted as categorical claim |
| Frontier-company views are homogeneous | Common support exists for evaluation and security | Anthropic, OpenAI, Google, Meta, xAI and Mistral differ sharply in preferred regulatory intensity and architecture | Contradicted |
| Government epistemic dependence creates capture risk | Firms own systems/data/expertise; industry participates in standard-setting | AISI, AI Office and proposed CAISI expansion create independent capacity | Strongly supported as risk, not established capture outcome |
| Open models have geopolitical sovereignty value | U.S., China, Canada, Mistral and industry coalition all articulate sovereignty/diffusion arguments | Diffusion also creates national-security risk | Strongly supported |
What the research can sustain
The defensible structural conclusion begins with an institutional asymmetry:
Several tools for reducing AI misuse—monitoring, attribution, rate limits, post-deployment intervention, rapid patching and revocation—work best when the intelligence remains under an institution's continuing technical control. Open-weight local AI transfers that control to the possessor. Governance that requires those particular controls can therefore have an architectural preference toward systems that remain administratively legible and governable.
That conclusion is strongly supported by the technical characteristics of the two deployment models. S05 S06
The second defensible step is economic:
Where compliance entails substantial fixed organizational infrastructure, safety rules can produce economies of regulatory scale even when they are genuinely justified.
That is well grounded as theory and plausible in present AI frameworks, though AI-specific compliance-cost estimates remain too poor to quantify the effect confidently. S48 S13
The third step is epistemic:
Frontier firms possess unusual influence because they own much of the evidence, expertise and infrastructure necessary to define the risks that justify their regulation.
This is strongly supported, but the rise of AISI and related public institutions is important counterevidence to any claim of complete epistemic monopoly. S31 S12
The fourth step is temporal:
If capabilities subject to regulation become cheaper to deploy and diffuse toward independently operated models, regulation based on dangerous capability rather than training scale can migrate outward from a few giant training laboratories toward model distribution and deployment.
Capability-oriented proposals are documented. General declining hardware footprints and an extension to ordinary private users are not established; such an extension remains a conditional scenario. S17 S10 S12
The fifth step concerns compatibility between sincere safety advocacy and incumbent advantage:
Safety governance and incumbent advantage can coexist when incumbents sincerely support rules that reduce genuine risk but also encode expensive institutional capacities they disproportionately possess.
That compatibility does not establish capture. The mechanism would require evidence of influence over design and measured effects before it could explain market concentration.
What should be qualified or abandoned
The research does not support a blanket claim that “AI companies are asking government to ban open source.” Anthropic, the firm most closely associated with strong frontier regulation, explicitly denies advocating that policy; OpenAI explicitly protects open weights in its current federal proposal; Meta and Microsoft are publicly pro-open; and federal U.S. policy affirmatively supports open models. S05 S10 S08 S11
It does not support treating every safety obligation as a moat. H.R. 9925's financial thresholds, EU open-source exemptions and OpenAI's proposed startup exclusions are evidence that policymakers are actively trying to avoid exactly that result. S13 S20 S10
It does not support saying catastrophic risk is empirically established. Existing evidence concerns dangerous capabilities, vulnerabilities and precursor behaviours, not demonstrated civilization-ending outcomes.
It does not support saying catastrophic concerns are fabricated. Too much empirical evidence exists for meaningful cyber capability, safeguard weakness and irreversible open-weight control loss to dismiss the subject as pure pretext. S18 S07
It does not support claiming that regulation is currently reaching into everyone's private GPU. That future is one possible implication of capability regulation, not present law.
And it would be a mistake to assume open weights are always economically anti-incumbent. Microsoft, Meta and NVIDIA demonstrate why incumbents at complementary layers can benefit from open model ecosystems. S08 S09
The unexpected conclusion
The most interesting divide revealed by the research is not safety versus freedom, nor even incumbent versus startup.
It is a contest between two forms of governance.
One treats advanced intelligence as a continuously administered system. Safety comes partly from maintaining an accountable operator who can observe, alter, update and revoke access.
The other treats intelligence increasingly as a possessable computational artifact. Safety must then rely more heavily on pre-release evaluation, endpoint responsibility, application law, physical security and social/legal deterrence because the original developer no longer remains in the control loop.
Both forms have genuine advantages.
Centralized services provide their operators with more direct monitoring and revocation levers. Those levers can also increase surveillance, dependency and concentrated institutional power; other forms of governance remain available for self-hosted systems.
Independently controlled deployments can improve privacy, autonomy and resilience; weight access also enables some inspection and modification, subject to licenses and missing training information. They make some original-developer controls harder to maintain. Neither architecture guarantees those benefits or safety.
This distinction supports a research agenda on risk, compliance routes, competition and private computation.
The core question becomes:
When safety regulation requires intelligence to remain observable, attributable, updateable and revocable, are we regulating dangerous capability—or quietly deciding who is allowed to possess intelligence?
The current evidence justifies asking that question. It does not yet justify pretending history has answered it.
Annotated source bibliography
U.S. executive and legislative sources
The White House. Promoting Advanced Artificial Intelligence Innovation and Security, Executive Order 14409, June 2, 2026. Establishes capability-oriented cyber benchmarking and voluntary early government access; expressly disclaims authority for mandatory model licensing/preclearance.
Source page
The White House. America's AI Action Plan, July 2025. Important primary source for the U.S. government's affirmative support for open-source/open-weight models.
Source page
U.S. House of Representatives. Frontier Risk Oversight, National Transparency, Independent Evaluation, and Reporting Act (FRONTIER Act), H.R. 9925, introduced July 23, 2026. Primary statutory text for 10²⁶-operation frontier threshold, large/very-large developer definitions, risk frameworks and IVO regime.
Source page
U.S. Government Publishing Office. H.R. 9925 bill metadata and legislative status.
Source page
Senators Michael Bennet and Peter Welch. AI Regulator Act — Section-by-Section, September 2026. Proposal for an independent Federal Digital Commission and temporary public-distribution restrictions on frontier models.
Source page
U.S. Congress. Future of Artificial Intelligence Innovation Act of 2026, S. 3952. Useful counterexample emphasizing voluntary standards, testbeds and government evaluation science rather than model licensing.
Source page
U.S. Department of Justice, Antitrust Division. AI Workshop Summary Report. Particularly useful for competition analysis of open models, AI-stack choke points and the possibility that compliance requirements favour large incumbents.
Source page
California Legislature. SB 53 legislative materials, 2025–26 session. Primary state-level frontier-model framework.
https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=202520260SB53
Anthropic's contemporaneous endorsement is discussed below. S21 S28
New York State Senate. RAISE Act / General Business Law Article 44-B. Frontier-developer risk-framework and incident-reporting regime.
Source page
Corporate primary sources
Anthropic. Policy on the AI Exponential, 2026. Anthropic's strongest current statement supporting federal catastrophic-risk regulation, evaluations and security obligations.
Source page
Anthropic. Our position on open-weights models, July 2026. Critical primary source: rejects a blanket open-weight ban while supporting mandatory testing of all sufficiently capable models and targeted chip/distillation controls.
Source page
Anthropic. Transparency Hub — Voluntary Commitments. Details Anthropic's Responsible Scaling Policy, Frontier Compliance Framework, access controls and weight security.
Source page
Anthropic. Anthropic is endorsing SB 53, September 8, 2025. Primary statement. Particularly relevant because Anthropic describes the law as formalizing safety practices major frontier labs already perform. S21
OpenAI. The AI policy window is open. We need to act., September 9, 2026. Supports mandatory capability-based national regulation while explicitly rejecting frontier safety as disguised anti-open-weight policy and advocating small-developer exclusions.
Source page
OpenAI. A blueprint for democratic governance of frontier AI, June 3, 2026. Federal framework proposal covering evaluations, incident reporting, model-weight security, resilience and government evaluation capacity.
Source page
OpenAI. A Blueprint for a Federal Framework — full report.
Source page
Google. Kent Walker, A pragmatic approach to AI governance in America, June 25, 2026. Proposes a federally overseen, industry-backed institution and voluntary independent frontier-model audits.
Source page
Google. 2026 Responsible AI Progress Report, February 18, 2026. Source for Google's lifecycle evaluation and monitoring practices.
Source page
Meta. Our Approach to Frontier AI, February 2025. Meta's frontier-risk framework and important primary evidence that open-release advocacy can coexist with catastrophic-risk evaluation.
Source page
Meta. Meta is Signing the EU AI Act Code of Practice on Transparency of AI-Generated Content, July 28, 2026. Evidence of selective rather than categorical opposition to AI regulation.
Source page
Microsoft and coalition signatories. Open Weights and American AI Leadership, July–August 2026. Major counterevidence to claims that incumbent technology firms uniformly favour closed-model restrictions.
Source page
Linux Foundation. Open Models and Open Weights Are Foundational to Secure AI, July 27, 2026. Open-ecosystem policy case linking model availability to security, competition and technological sovereignty.
Source page
European Union
European Parliament and Council. Regulation (EU) 2024/1689 — Artificial Intelligence Act, June 13, 2024, as applicable through 2026. Authoritative legal text for GPAI and systemic-risk obligations.
Source page
European Commission. Guidelines for providers of general-purpose AI models, current guidance at editorial verification. Clarifies GPAI scope, modification rules and open-source exemptions.
Source page
European Commission. General-Purpose AI Models in the AI Act — Questions & Answers. Concise official account of technical documentation, copyright, systemic-risk evaluation, incident reporting and cybersecurity duties, including 10²⁵-FLOP presumption.
Source page
European Commission. The General-Purpose AI Code of Practice. Includes current signatory list and xAI's partial signing position.
Source page
United Kingdom and Canada
UK Government. AI Opportunities Action Plan — 2026 Progress. Official source for AISI funding, staff numbers, model evaluations and the government's current targeted-regulation stance.
Source page
UK AI Security Institute. Frontier AI Trends Report. A public evaluation source used here for cyber capability, safeguard effectiveness, biology-related testing and limitations of existing models.
Source page
UK AI Security Institute. Research database. Contains work on cyber agents, autonomous replication, control, safeguard failures and 2026 unsanctioned-agent behaviour.
Source page
Government of Canada, Innovation, Science and Economic Development Canada. Canada's National Artificial Intelligence Strategy: AI for All, 2026. Source for Canadian AI Safety Institute expansion, certification, transparency and sovereign-compute strategy.
Source page
Technical and economic evidence
Stanford Institute for Human-Centered Artificial Intelligence. AI Index Report 2026. Broad empirical source for frontier development, investment, transparency, open-model activity and industry dominance in notable model development.
https://hai.stanford.edu/ai-index/2026-ai-index-report S44
Full report: https://hai.stanford.edu/assets/files/ai_index_report_2026.pdf S49
Luke Emberson and David Roodman, Epoch AI. The plunging price of thought, September 22, 2026. Performance-adjusted inference-cost analysis; estimates about a 47% quarterly decline under its preferred aggregate measure.
Source page
Epoch AI. The finances of AI: Data & research. Useful quantitative collection on data-centre cost, capex, compute and frontier economics.
Source page
Open Technical Problems in Open-Weight AI Model Risk Management, arXiv:2608.07514, 2026. Technical synthesis of the irreversible-release problem, safeguard modification and risk-management differences between hosted and open-weight models.
Source page
Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks, arXiv:2605.26526, 2026. Empirical evidence that several open-weight anti-tampering approaches remain vulnerable to comparatively simple attacks.
Source page
National Bureau of Economic Research. Measuring the Costs and Benefits of Regulation, Working Paper 32955. Bibliographic identity checked; full text inaccessible during editorial verification. Not used to establish the submitted percentage range or detailed firm-size claims.
Source page
Open Source Initiative. Open Source AI Definition 1.0. Essential terminological source distinguishing genuine open-source AI from mere publication of weights.
https://opensource.org/ai/open-source-ai-definition
Geopolitical primary sources
National Development and Reform Commission of the People's Republic of China. Artificial Intelligence Cooperation Development Action Plan, July 17, 2026. Includes “open-source ecosystem sharing,” compute access and international standards cooperation as explicit Chinese policy pillars.
Source page
Secondary/current-event sources used with caution
Axios. Watch the extended Scott Bessent interview on “The Axios Show”, October 3, 2026. Interview context; wording relies on one Business Insider/AOL transcription lineage, not an independent inspection of the video. S24 S25
Christopher J. Calton, Independent Institute. AI Leaders Are Asking to Be Regulated. This Is Nothing New., October 3, 2026. Useful as the contemporary regulatory-capture argument under examination, but its motive claims should not be mistaken for documented evidence.
Source page
Unrecovered news references. The supplied manuscript contains unidentified Reuters pointers for IPO, investment and foreign-access claims, plus unidentified reporting attributed to Mistral, China and a White House accord. These identities were not recovered. Associated event-specific claims have been removed or replaced with expressly conditional mechanisms and identified primary support; the original pointers remain in the citation map.
The selected record supports this conditional institutional conclusion: a society can rationally respond to genuine AI risk in ways that make privately controlled intelligence progressively less compatible with the machinery of regulation. Whether that becomes a justified risk boundary, a regulatory moat, or both at once will depend on where policymakers place the capability threshold—and whether they preserve a legal domain in which computation may remain private.
Research questions and tests that could change the conclusion
The structural hypothesis would weaken if comparable risk reduction were achievable through equally accessible compliance routes across deployment architectures, or if measured entry and operating costs showed no material incumbent advantage. A capture explanation would require evidence that regulated interests shaped the relevant rule and that the resulting effects reinforced their position; advantage alone is insufficient. Conversely, evidence of a large additional real-world misuse risk from irreversible release, compared with accessible alternatives and defensive benefits, could justify differential restrictions without capture. Useful next studies would measure compliance costs by firm and rule, examine lobbying-to-text changes, compare market entry before and after specific rules with appropriate controls, and test architectural alternatives under matched risk conditions.