Intelligence Report

Nadella warns AI-driven bug discovery is forcing rushed patches and more outages

Microsoft's chief executive said AI tools expose flaws faster than they can be safely fixed, and set out a log-based approach to keeping AI models in check.

INSIGHTEX Editorial Desk

2 min read

Nadella warns AI-driven bug discovery is forcing rushed patches and more outagesIntelligence Report

What happened

Microsoft chief executive Satya Nadella said he expects more software outages because AI tools now uncover security weaknesses faster than businesses can safely repair them, TNW | Microsoft reported. In a Wednesday conversation in New York with Andrew Ross Sorkin at the DealBook Summit hosted by The New York Times, he apologised for the Outlook outage, which he said had no direct connection to the trend. Later on CNBC with Jim Cramer, he said Microsoft should have tested more and isolated the fault before it spread globally.

Nadella said a fix for a critical banking system used to go through about a week of testing. Because attackers now exploit weaknesses as soon as they appear, he said, patches are pushed straight into production, which brings instability. He noted that three critical open-source patches had arrived on the day he spoke. He also said AI models allow almost anyone to operate like a persistent attacker with nation-state capabilities.

On AI safety, Nadella said scaling had delivered results, but alignment and reliable model debugging had not come with it. He proposed what he called a trust architecture. It would bar models that reason in a shorthand humans cannot read and would require tamper-proof reasoning records that other models could check. He said deployers are currently liable for what their AI systems do, and he anticipates that insurers will put a price on that exposure and ask to see the logs.

Context

Microsoft holds stakes in OpenAI and Anthropic. Nadella said that under its OpenAI agreement, Microsoft can use a frontier model without paying royalties through 2032. He said this allows it to develop its own MAI models that trail the leading edge by three to six months with only 5% to 20% of the compute. Microsoft has also offered buyouts to 60,000 staff, and its Cowork agent is built by a team of 11 developers.

SourceTNW | Microsoft

The briefing

The week in tech, in one email.

The stories worth your time, every week. Unsubscribe anytime.