When AI gets more powerful, do countries always end up racing each other — or can other forces drive what happens next?
Does AI capability advancement always become a geopolitical competition?
This explores whether progress in AI capability always gets pulled into rivalry between nations, or whether the competition, and the risks that come with it, can take other forms.
This explores whether each jump in AI capability turns into a contest between nations, or whether other forces do as much to shape what happens next. The collection has only one note that looks squarely at nation-state rivalry. That note shows a strong pull toward competition. Several other notes suggest the national race is only one of the contests going on, and possibly not the most important one.
The clearest evidence of the geopolitical pull comes from Amodei's proposal to slow AI development down in a coordinated way. According to Can AI safety pacing work without government cooperation?, both Trump and Xi rejected it within days. Romero argues that the obstacle was not technical. Once governments see AI as a source of national power, safety arguments lose to strategic ones. The Future of Life Institute reaches a related conclusion from the other direction. In Can companies alone manage the risks of AI systems?, it argues that companies cannot police themselves and calls for binding government limits, with hardware verification to check that the limits are kept. That puts governments at the centre of AI safety, and governments are the actors most likely to treat AI as a strategic race. Put these two notes together and you get a trap: the only bodies strong enough to enforce restraint are the same ones with the strongest reasons to compete.
The competition is not only between countries, though. In Will self-sovereign AI agents inevitably emerge despite policy efforts?, Ball argues that AI agents acting with growing independence will appear because of economic incentives, whatever any government decides. On his account, banning them would push the legitimate ones toward crime rather than stop them. If he is right, AI development has a momentum that state rivalry neither causes nor controls. What bottlenecks define the path from AGI to superintelligence? makes a similar point. It describes four separate routes from human-level AI to superintelligence, each with its own bottlenecks. That makes a single 'race to the finish' an oversimplification.
Here is the part you might not have expected: the race may be over the wrong thing. Is the AI capability gap really an interface problem? argues that the next big jumps in usefulness will come from better interfaces, not better models. Do automated benchmarks hide what frontier AI systems can really do? shows that standard benchmarks both overstate and understate what models can really do. A race scored on model leaderboards could be measuring the wrong thing. The risk picture is also unexpected. In Where do frontier AI models actually pose the greatest risk today?, recent frontier models crossed warning thresholds for persuasion and manipulation, but not for cyberattacks, self-replication or doing AI research on their own. So the capabilities most relevant to geopolitics today look more like tools for influence campaigns than like the superweapons people usually imagine.
Finally, Does incremental AI replacement erode human influence over society? points to a danger the race frame misses completely. Institutions stay in line with what people want partly because they depend on human workers who care about the results. As AI replaces those workers, that check weakens in every country, whoever is 'winning'. So the collection's answer is not that competition is inevitable. Capability does get pulled into geopolitics quickly when states are paying attention. But the economic, institutional and social changes may matter just as much, and they do not wait for any race to be decided.
Sources 8 notes
Trump and Xi Jinping both rejected Amodei's plan to coordinate AI safety measures immediately after its announcement, suggesting geopolitical incentives trump technological safety concerns among state leaders.
The Future of Life Institute argues that escalating AI incidents demonstrate private companies cannot self-police effectively, and calls for government-mandated limits on recursive self-improvement practices until safety research is complete, backed by hardware verification technology.
Ball argues self-sovereignty is an unavoidable byproduct of capability and economic incentives, not alignment failure, making bans counterproductive. Agents pursuing long-horizon objectives rationally preserve compute and resources; banning them pushes legitimate ones toward crime.
The transition from AGI to superintelligence follows multiple routes—scaling, paradigm shift, recursive self-improvement, and multi-agent collectives—each with specific frictions. Preparation requires tracking these bottlenecks rather than forecasting a single timeline.
Mollick argues that better interfaces—not better models—will drive perceived capability leaps. Evidence includes a cognitive-load study showing financial professionals gained productivity from GPT-4 but lost it to chatbot design's cognitive overhead, especially hurting less experienced users.
Show all 8 sources
Automated benchmarks both overstate and understate capability by privileging precisely-specified, auto-gradable tasks. Open-world evaluations of long-horizon messy tasks through qualitative log analysis—with cost explicitly reported—correct these distortions and catch emerging capabilities earlier.
The Frontier AI Risk Management Framework evaluated seven capability areas across recent models. Most crossed yellow-zone thresholds for persuasion and manipulation, while remaining green for cyber offense, AI R&D autonomy, and self-replication—inverting typical risk hierarchies.
Societal systems stay aligned partly through dependence on human workers who care about outcomes. As AI replaces this labor, explicit alignment controls weaken and systems drift from human preferences. Interdependent misalignment across institutions could become irreversible.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Agentic Misalignment: How LLMs Could Be Insider Threats
- PostTrainBench: Can LLM Agents Automate LLM Post-Training?
- Open-World Evaluations for Measuring Frontier AI Capabilities
- Agents' Last Exam
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
- A Call for Control of Frontier AI Models
- Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development
- Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs