Tim Genewein, Matija Franklin, Alexander Lerchner, et al. · arXiv:2606.12683
As AI researcher timelines continue to compress, the question of what comes after human-level AGI has shifted from theoretical curiosity to urgent practical concern—yet the paths from AGI to superintelligence remain poorly mapped. This report stakes out that terrain by proposing four potential trajectories (scaling, paradigm shifts, recursive improvement, and multi-agent emergence) while acknowledging that progress uncertainties make the distinction between a single transformative step and a cascade of distributed breakthroughs genuinely unclear. What's particularly unresolved is whether recursive improvement loops that accelerate AI research itself represent a fundamental bottleneck or a runaway dynamic—and relatedly, whether human-AI research collaboration can remain competitive as systems approach and potentially exceed organizational-level capability. The report's call for interdisciplinary preparation suggests the real uncertainty isn't whether ASI-level systems are possible, but whether institutions can anticipate and shape change across multiple simultaneous domains rather than bracing for a single discontinuity.
Bishwas Mandal, Shmuel Berman, Akshay Vegesna, et al. · arXiv:2606.03938
As compute budgets outpace text availability, the pretraining paradigm faces a fundamental constraint: a single model exhausts its learning signal long before exhausting its allocation. This work proposes a conceptual reorientation toward population-based training, where the budget funds diversity rather than refinement—a shift with deep implications for how we think about model aggregation. The approach echoes existing insights about how models trained on diverse imperfect experts develop implicit consensus, but inverts the setup: instead of training on external experts, here the population is grown in parallel and combined at inference time. The use of chain distillation to compound quality across generations, paired with a learned prior to weight ensemble members, also connects to broader questions about how to allocate compute between parallel coverage and sequential refinement. What remains unclear is whether this population strategy generalizes beyond the multi-epoch regime—whether the principles that make diverse trajectories valuable during saturation hold when architectural choices and inference constraints reshape the efficiency frontier.
The standard wisdom in multi-agent AI design has long favored consensus—through voting, debate, or aggregation protocols—as the path to reliability, yet recent work on agent confidence as a routing signal and consensus failures in LLM teams has begun exposing the limits of that approach. This paper reframes disagreement itself as potentially informative rather than merely an error to be corrected, arguing that in normatively complex domains like content moderation, the *pattern* of disagreement—whether agents diverge in reasoning, conclusions, or both—carries meaning that should shape downstream decisions rather than be suppressed. By mapping disagreement into symbolic states that distinguish convergent from divergent reasoning, the work sits at the intersection of two unresolved tensions: whether LLM debate mechanisms can capture what human expert disagreement actually signals, and whether routing decisions informed by disagreement patterns can gracefully handle the kind of value-laden uncertainty that no amount of agent coordination will fully resolve. The question emerging from this framework is whether we've been asking the wrong question all along—not "how do we eliminate disagreement?" but rather "what decisions are best made *by* disagreement, rather than *despite* it?"
Jiachen Liu, Jiaxin Pei, Jintao Huang, et al. · arXiv:2604.24658
The compression of scientific research into linear papers has long been understood as a necessity of human communication, but this work reframes it as a fundamental liability for AI-native research—one that becomes acute when agents must not only read papers but extend them. Rather than accept the traditional publication format as inevitable, the authors propose restructuring research artifacts around what machines actually need: executable specifications, preserved dead ends, and grounded evidence chains. This connects to broader tensions in AI-accelerated science: autonomous research mechanisms work better together than apart, yet AI-generated research outpaces verification in ways that may require new venue models with closed-loop automated review. The question emerging is whether formalizing research as executable packages will accelerate discovery or whether the loss of narrative flexibility might constrain the kinds of conceptual leaps that have historically driven paradigm shifts.