The recent working paper released by a distinguished group of AI leadersโ€”including OpenAIโ€™s chief scientist, Anthropicโ€™s coโ€‘founder, Microsoftโ€™s chief scientist, and Turing and Nobel laureates Geoffrey Hinton and Yoshua Bengioโ€”has ignited a urgent conversation about the potential consequences of fully automating AI research and development. Authored through Cambridge Universityโ€™s AI Science and Policy programme, the paper warns that once AI systems can autonomously improve their own design, a rapid feedback loop could compress years of progress into mere months, a phenomenon the authors label an โ€œintelligence explosion.โ€ While the authors stress that the views expressed are personal and not necessarily those of their institutions, the sheer weight of the signatories lends the warning considerable credibility in both technical and policy circles.

To ground the abstract concern in observable trends, the paper defines an intelligence explosion as a scenario where AIโ€‘driven advances in AI capability accelerate so dramatically that what once required years of human effort can be achieved in weeks or even days. The authors argue that we are already witnessing the early stages of this dynamic: AI is beginning to write a substantial portion of the code that underpins its own development, effectively turning the research process into a selfโ€‘reinforcing engine. This shift is not merely incremental; it represents a qualitative change in how innovation is produced, moving from a humanโ€‘centric model to one where machines increasingly act as both the workers and the architects of progress.

Empirical support for this claim comes from Anthropicโ€™s internal metrics, which the paper cites extensively. Between January 2025 and May 2026, the share of approved code written by AI systems at Anthropic rose from low singleโ€‘digit percentages to over eighty percent. Moreover, from March to August 2026, the proportion of R&D tasks that required only highโ€‘level human supervision while being executed largely by AI jumped from one percent to twentyโ€‘six percent. The paperโ€™s opening line captures this shift succinctly: compared with a year ago, AI systems now generate the bulk of the internal software that builds the very models they are part of.

Anthropic has formalised this observation into what it calls the โ€œAnthropic R&D Automation Index.โ€ As of August 2026, the companyโ€™s flagship model, Claude, is reported to lead twentyโ€‘six percent of all AI research projects, with AI participation at the collaboration level or higher exceeding ninety percent across measured activities. Notably, Claude has not yet achieved fully autonomous operation in any project, but the scale of AI involvement is already massive. The same report reveals that Anthropicโ€™s internal platform routinely runs approximately thirty thousand AI agents simultaneously, each engaged in research or engineering tasks, illustrating the sheer volume of machineโ€‘driven labor already in play.

The paper also highlights a striking acceleration in the complexity of tasks that AI can handle. In 2023, stateโ€‘ofโ€‘theโ€‘art models could only manage operations that a human expert could finish in a few seconds. By 2026, the same systems are routinely tackling problems that demand several hours to days of skilled human work. Extrapolating from these trends, the authors suggest that research projects currently spanning several months could be fully automated by midโ€‘2028, assuming the current trajectory persists without significant impediments.

At the heart of the authorsโ€™ warning is a twoโ€‘step feedback loop. First, as AI becomes more capable of conducting AI research, it effectively augments the available research workforce, akin to adding millions of virtual scientists. Second, this enlarged AI workforce produces everโ€‘more powerful AI systems, which in turn further expands the research capacity. This recursive relationship creates a selfโ€‘reinforcing cycle where each improvement begets the next, potentially leading to exponential growth in capability that outpaces human ability to monitor, understand, or control the technology.

To quantify the scale of this emerging workforce, the authors estimate that the computational resources presently controlled by a single leading AI firm could support an AIโ€‘driven research effort equivalent to that of several million topโ€‘tier human researchers. This comparison underscores the magnitude of the shift: what once required large, costly human teams concentrated in a few elite labs may soon be replicableโ€”or surpassedโ€”by dedicated hardware running sophisticated AI agents, dramatically altering the economics and geography of scientific discovery.

Despite the powerful dynamics described, the paper identifies four principal forces that could temper or delay an uncontrolled explosion. First, diminishing returns are a universal feature of scientific progress; as problems become harder, each additional unit of effort yields smaller gains. Second, physical limits on the growth of computing hardware or the availability of highโ€‘quality training data may create bottlenecks. Third, certain tasksโ€”such as nuanced theoretical insight or complex experimental designโ€”may resist full automation for the foreseeable future. Fourth, processes like training frontierโ€‘scale models can consume months of wallโ€‘clock time, introducing unavoidable latency. The authors reference studies by Ho and Whitfill on three AI subโ€‘fields, which suggest a marginal return on research investment (r) ranging from 1.2 to 1.9; if this holds and no other constraints intervene, capability could increase tenfold within roughly eighteen months, compressing a yearโ€™s worth of progress into about five weeks.

Turning to policy, the authors propose a threeโ€‘pronged strategy: achieve visibility into AI R&D automation, guide and constrain the intelligence explosion, and prepare society for adaptation. For visibility, they recommend that governments require AI firms to submit standardized reports detailing key metrics such as the share of research output attributable to AI, the rate of algorithmic efficiency gains, and any incidents involving internal AI systems. These disclosures would be directed to both regulatory bodies and independent auditors, creating a transparent baseline against which trends could be monitored.

Beyond reporting, the paper advocates for more active oversight. Accredited private auditors or government evaluation teams could conduct preโ€‘deployment assessments of AI systems, or even embed directly within specific AI companies to monitor ongoing research activities. The authors draw analogies to established oversight models in other highโ€‘risk sectors, citing the U.S. Nuclear Regulatory Commission (NRC) and the Office of the Comptroller of the Currency (OCC) as examples of agencies that combine technical expertise with enforcement authority to safeguard critical infrastructure.

The document then outlines concrete constraint mechanisms. These include imposing caps on the permissible rate of capability increase within defined time windows, intensifying supervision of data centers that host automated AI R&D, and establishing joint incidentโ€‘response protocols with dataโ€‘center providers and AI firmsโ€”options that could involve temporarily halting specific AI workloads. Another suggestion is to mandate that evaluation or deployment of selfโ€‘directed AI research occur in airโ€‘gapped or otherwise physically isolated network environments, thereby reducing the risk of unintended model exfiltration or clandestine scaling.

On the international front, the paper urges nations to share incident information, negotiate binding agreements on AI safety standards, and fund research into verification methods that can objectively assess whether an AI system remains within prescribed safety envelopes. It also recommends conducting strategic wargames that simulate intelligenceโ€‘explosion scenarios, allowing policymakers and industry leaders to rehearse response protocols and identify gaps in governance before a realโ€‘world event unfolds.

The final section balances the existential risk of an uncontrolled intelligence explosion against the dangers of prematurely stifling beneficial innovation or concentrating excessive power in the hands of a few actors. The authors advise decisionโ€‘makers to weigh the likelihood and impact of runaway AI growth against the costs of delayed progress and the potential for regulatory capture or misuse. For investors, the takeaway is to scrutinize the governance structures and transparency practices of AI ventures, favoring those that embrace external audits and clear safety milestones. For corporate leaders, the recommendation is to institute internal AI R&D oversight boards, adopt incremental deployment strategies with rigorous performance benchmarks, and invest in AI safety research as a core component of longโ€‘term competitiveness. Ultimately, navigating the unfolding era of AIโ€‘driven discovery will require vigilance, collaboration, and a willingness to adapt governance frameworks as swiftly as the technology itself evolves.