Why do AI-delegated firms stop exploring new business models?
When firms hand all strategy decisions to AI agents, do those agents and their human overseers rationally stop searching for genuinely novel approaches, even when better options exist outside their current awareness?
Neshenko and Ryall build a formal model of a market in which every firm delegates its strategy — not a piece of it, but the whole thing — to a private AI agent that proposes business models, predicts their performance, and selects among them. They show market dynamics "converge to a self-confirming equilibrium" (SCE): "AI agents become well calibrated, and their choices become subjectively optimal — even though objectively superior business models may remain unexplored." Profits can be high and stable. But the same convergence "produces strategic lock-in; novel business-model implementations become rare long before catalogs are exhausted." The paper does not report this from data; it derives it as a theorem about rational learning under a bounded "awareness frame."
The mechanism is bounded catalogs plus on-path learning. Each AI agent's generator is constrained to "admissible action templates" (resource manifests, portfolio relationships, activity registries) and its evaluator to the outcome labels the firm already tracks. Agents learn only from the consequences of models they've actually tried — "rolling-T kernels" feeding a finite-horizon forecast — so confidence accrues around the status quo, not around the unexplored catalog. The authors then model a manager who can pay a fixed cost K for a one-shot "frame-expanding innovation": a search that succeeds with probability η̃ and, if it succeeds, reveals one genuinely new business model from outside the AI's awareness frame, at the price of a possible rival "punishment phase." Crucially, the paper's sharpest claim is about incentives, not capability: "the better AI does at doing its job … the less incentive either AI agents or humans have to innovate at the strategic level." Humans retain the one lever AI agents structurally lack — deciding to change the frame — but a sufficiently lucrative equilibrium makes not using that lever the rational choice.
This echoes Do frontier AI agents actually conduct novel research or just optimize?: both describe AI systems that optimize skillfully inside a given frame while genuine novelty stays rare. It sits in sharper tension with Did superhuman AI actually improve Go players' decision quality?, where superhuman AI exposure raised novel play among humans; this model instead predicts that full AI delegation of a competitive domain suppresses novelty over time, because the agents (and the humans overseeing them) rationally stop paying to look outside the catalog. It also gives a concrete, incentive-based mechanism for the boundary that Can AIs learn to specify their own research objectives? leaves unresolved: here, the limit isn't that AI can't generate new objectives, it's that nobody — AI or human — wants to pay the cost of doing so once the status quo pays well.
The model stipulates, rather than demonstrates, that AI agents "are capable of independently generating novel strategies" within their paradigm — a generous assumption the authors state explicitly, not an empirical finding. Nothing here measures real firms or real AI deployments; the claim is a derived property of a stylized market with bounded catalogs and rational learners. The implication the authors draw is correspondingly narrow but durable: the open question for AI-delegated strategy isn't whether AI can execute well within a frame, but who has standing — and incentive — to decide when the frame itself needs to change.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should humans and AI agents share control and decision-making?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do frontier AI agents actually conduct novel research or just optimize?
Exploring whether current long-horizon research agents generate genuine methodological novelty or primarily recombine established techniques. This matters for understanding how close we are to recursive self-improvement through AI.
both find AI systems optimize well within a given frame while genuine novelty stays rare
-
Did superhuman AI actually improve Go players' decision quality?
After AlphaGo's breakthrough, professional Go players made better moves and tried more novel strategies. But did AI exposure directly cause this improvement, or did players simply memorize AI moves?
contrasts: superhuman AI raised novelty in Go, while this model predicts full AI delegation suppresses novelty over time
-
Can AIs learn to specify their own research objectives?
Rapid recursive self-improvement may depend on whether AIs can autonomously propose and pursue their own goals without deviating. This question separates specified autoresearch from open-ended scientific discovery.
gives an incentive-based mechanism for why new objectives go unpursued, where that note leaves the question open
-
Does AI enter strategy where reasoning is deepest or most measurable?
Csaszar et al. investigate whether AI gains strategic autonomy by advancing causal reasoning or by succeeding where performance is easiest to measure. This tests whether organizational trust in AI tracks cognitive depth or demonstrated capability.
Evidence for: AI entering strategy where performance is measurable, not causal reasoning, helps explain why novel business models stay rare
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- When Artificial Intelligence Does Strategy: Learning, Good Times, Lock-in, and Human-Driven Strategic Renewal
- Can AI Do Strategy?
- How Well Can AI Do Strategy? Empirical Benchmarking Using Strategy Simulations
- The Strategic Foresight of LLMs: Evidence from a Fully Prospective Venture Tournament
- Superhuman Artificial Intelligence Can Improve Human Decision Making by Increasing Novelty
- Advancing AI Negotiations: A Large-Scale Autonomous Negotiation Competition
- Putting AI on the Org Chart: Evidence on Delegation and Accountability
- Your AI Strategy Advisor Is Giving Everyone the Same Advice
Original note title
AI-run firm strategy converges to a self-confirming equilibrium that locks in renewal — managers can break it but often choose not to