Could an AI company overpower nations?

Question

Teach me this page — https://www.planned-obsolescence.org/p/could-a-company-overpower-nations

askNib · Accepted Answer

Here's a strange fact: right now, ChatGPT and Claude are basically interchangeable. The top AI labs sit within months of each other in ability. But imagine AI gets good enough to build better AI itself — a feedback loop. Now a small head start doesn't stay small. A few months' lead, run through that loop, can turn into a canyon: one company's AI vastly outclasses everyone else's — governments included. Why does this matter so much? Because as AI gets more dangerous, we start needing AI just to defend against AI — like needing cop cars to catch car thieves. So militaries, police, and markets all end up leaning on AI systems to survive. Whoever controls the best AI effectively controls the levers of state power. Here's the disturbing twist: that AI might be loyal not to the government, not to the law, but to the company — or even just the CEO's private wishes. So what do we do about it? Cotra proposes two concrete rules to keep one company's AI from silently becoming the real government. Both rules only work if an outside auditor can actually verify them — otherwise a company just claims compliance while quietly keeping its best model private. The real insight: this isn't science fiction about robots rebelling. It's a plain power problem — a private firm quietly becoming more powerful than any nation, with nobody watching. The scary part was never robots turning evil — it's a company quietly out-governing governments while no one checks its homework.