Stories
Slash Boxes
Comments

SoylentNews is people

Submission Preview

Link to Story

Reality Check: Microsoft Azure CTO Pushes Back on AI Vibe Coding Hype, Sees ‘Upper Limit’

Accepted submission by upstart at 2025-06-05 14:15:17
News

upstart [soylentnews.org] writes:

████ # This file was generated bot-o-matically! Edit at your own risk. ████

Reality check: Microsoft Azure CTO pushes back on AI vibe coding hype, sees ‘upper limit’ [geekwire.com]:

REDMOND, Wash. — Microsoft Azure CTO Mark Russinovich [linkedin.com] cautioned that “vibe coding” and AI-driven software development tools aren’t capable of replacing human programmers for complex software projects, contrary to the industry’s most optimistic aspirations for artificial intelligence.

Russinovich, giving the keynote Tuesday at a Technology Alliance [technology-alliance.com] startup and investor event, acknowledged the effectiveness of AI coding tools for simple web applications, basic database projects, and rapid prototyping, even when used by people with little or no programming experience.

However, he said these tools often break down when handling the most complex software projects that span multiple files and folders, and where different parts of the code rely on each other in complicated ways — the kinds of real-world development work that many professional developers tackle daily.

“These things are right now still beyond the capabilities of our AI systems,” he said. “You’re going to see progress made. They’re going to get better. But I think that there’s an upper limit with the way that autoregressive transformers work that we just won’t get past.”

Even five years from now, he predicted, AI systems won’t be independently building complex software on the highest level, or working with the most sophisticated code bases.

Instead, he said, the future lies in AI-assisted coding, where AI helps developers write code but humans maintain oversight of architecture and complex decision-making. This is more in line with Microsoft’s original vision of AI as a “Copilot,” a term that originated with the company’s GitHub Copilot AI-powered coding assistant.

Russinovich, a longtime Microsoft technical and cloud leader, gave an insider’s overview of the AI landscape, including reasoning models that can think through complex problems before responding; the decline in unit costs for training and running AI models; and the growing importance of small language models that can run efficiently on edge devices.

He described the flip that has taken place in computing resources, from primarily training AI models in the past to now focusing more on AI inference, as usage of artificial intelligence has soared.

He also discussed the emergence of agentic AI systems that can operate autonomously — reflecting a big push this year for Microsoft and other tech giants — as well as AI’s growing contributions to scientific discoveries, such as the newly announced Microsoft Discovery [microsoft.com].

But Russinovich, who is also Azure’s chief information security officer, kept gravitating back to AI limitations, offering a healthy reality check overall.

He discussed his own AI safety research, including a technique that he and other Microsoft researchers developed called “crescendo” [arxiv.org] that can trick AI models into providing information they’d otherwise refuse to give.

The crescendo method works like a “foot in the door” psychological attack, he explained, where someone starts with innocent questions about a forbidden topic and gradually pushes the AI to reveal more detailed information.

Ironically, he noted, the crescendo technique was referenced in a recent research paper [alphaxiv.org] that made history as the first largely AI-generated research ever accepted into a tier-one scientific conference.

Russinovich also delved extensively into ongoing AI hallucination problems — showing examples of Google and Microsoft Bing giving incorrect AI-generated answers to questions about the time of day in the Cook Islands, and the current year, respectively.

“AI is very unreliable. That’s the takeaway here,” he said. “And you’ve got to do what you can to control what goes into the model, ground it, and then also verify what comes out of the model.”

Depending on the use case, Russinovich added, “you need to be more rigorous or not, because of the implications of what’s going to happen.”

GeekWire Newsletters

Subscribe to GeekWire's free newsletters to catch every headline

Email addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Send Us a Tip

Have a scoop that you'd like GeekWire to cover? Let us know.

Send Us a Tip [geekwire.com]

Microsoft expands AI roster with Anthropic and xAI integrations, looking beyond OpenAI alliance [geekwire.com]

Why startups should pay attention to ‘vibe coding’ — and approach with caution [geekwire.com]

Microsoft details ‘largest cybersecurity engineering effort in history’ — securing its own code [geekwire.com]

Nadella and Zuckerberg: Microsoft and Meta see surge in AI-generated code at their own companies [geekwire.com]

Like what you're reading? Subscribe to GeekWire's free newsletters to catch every headlineEmail addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Find more jobs on GeekWork [geekwire.com]. Employers, post a job here [geekwire.com].About

Follow

GeekWire Newsletters

Catch every headline in your inbox

Email addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Read GeekWire

Legal

Return to Top of Page© 2011-2025 GeekWire, LLCDo Not Sell or Share My Personal information [termly.io]Limit the Use Of My Sensitive Personal Information [termly.io]Consent Preferences×Get smart with GeekWire. Sign up for our new daily newsletter. Sign UpDo not show again.

REDMOND, Wash. — Microsoft Azure CTO Mark Russinovich [linkedin.com] cautioned that “vibe coding” and AI-driven software development tools aren’t capable of replacing human programmers for complex software projects, contrary to the industry’s most optimistic aspirations for artificial intelligence.

Russinovich, giving the keynote Tuesday at a Technology Alliance [technology-alliance.com] startup and investor event, acknowledged the effectiveness of AI coding tools for simple web applications, basic database projects, and rapid prototyping, even when used by people with little or no programming experience.

However, he said these tools often break down when handling the most complex software projects that span multiple files and folders, and where different parts of the code rely on each other in complicated ways — the kinds of real-world development work that many professional developers tackle daily.

“These things are right now still beyond the capabilities of our AI systems,” he said. “You’re going to see progress made. They’re going to get better. But I think that there’s an upper limit with the way that autoregressive transformers work that we just won’t get past.”

Even five years from now, he predicted, AI systems won’t be independently building complex software on the highest level, or working with the most sophisticated code bases.

Instead, he said, the future lies in AI-assisted coding, where AI helps developers write code but humans maintain oversight of architecture and complex decision-making. This is more in line with Microsoft’s original vision of AI as a “Copilot,” a term that originated with the company’s GitHub Copilot AI-powered coding assistant.

Russinovich, a longtime Microsoft technical and cloud leader, gave an insider’s overview of the AI landscape, including reasoning models that can think through complex problems before responding; the decline in unit costs for training and running AI models; and the growing importance of small language models that can run efficiently on edge devices.

He described the flip that has taken place in computing resources, from primarily training AI models in the past to now focusing more on AI inference, as usage of artificial intelligence has soared.

He also discussed the emergence of agentic AI systems that can operate autonomously — reflecting a big push this year for Microsoft and other tech giants — as well as AI’s growing contributions to scientific discoveries, such as the newly announced Microsoft Discovery [microsoft.com].

But Russinovich, who is also Azure’s chief information security officer, kept gravitating back to AI limitations, offering a healthy reality check overall.

He discussed his own AI safety research, including a technique that he and other Microsoft researchers developed called “crescendo” [arxiv.org] that can trick AI models into providing information they’d otherwise refuse to give.

The crescendo method works like a “foot in the door” psychological attack, he explained, where someone starts with innocent questions about a forbidden topic and gradually pushes the AI to reveal more detailed information.

Ironically, he noted, the crescendo technique was referenced in a recent research paper [alphaxiv.org] that made history as the first largely AI-generated research ever accepted into a tier-one scientific conference.

Russinovich also delved extensively into ongoing AI hallucination problems — showing examples of Google and Microsoft Bing giving incorrect AI-generated answers to questions about the time of day in the Cook Islands, and the current year, respectively.

“AI is very unreliable. That’s the takeaway here,” he said. “And you’ve got to do what you can to control what goes into the model, ground it, and then also verify what comes out of the model.”

Depending on the use case, Russinovich added, “you need to be more rigorous or not, because of the implications of what’s going to happen.”

GeekWire Newsletters

Subscribe to GeekWire's free newsletters to catch every headline

Email addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Send Us a Tip

Have a scoop that you'd like GeekWire to cover? Let us know.

Send Us a Tip [geekwire.com]

Microsoft expands AI roster with Anthropic and xAI integrations, looking beyond OpenAI alliance [geekwire.com]

Why startups should pay attention to ‘vibe coding’ — and approach with caution [geekwire.com]

Microsoft details ‘largest cybersecurity engineering effort in history’ — securing its own code [geekwire.com]

Nadella and Zuckerberg: Microsoft and Meta see surge in AI-generated code at their own companies [geekwire.com]

Like what you're reading? Subscribe to GeekWire's free newsletters to catch every headlineEmail addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Find more jobs on GeekWork [geekwire.com]. Employers, post a job here [geekwire.com].About

Follow

GeekWire Newsletters

Catch every headline in your inbox

Email addressSubscribeGeekWire Daily - Top headlines daily GeekWire Weekly - Most-read stories of the week, delivered Sunday Breaking News Alerts - Important news as it happens GeekWire Startups - News, analysis, insights from the Pacific Northwest startup ecosystem, delivered Friday GeekWire Mid-week Update — Most-read stories so far this week, delivered Wednesday GeekWire Partner Content — Special offers and sponsored content from GeekWire partners Read GeekWire

Legal

Return to Top of Page© 2011-2025 GeekWire, LLCDo Not Sell or Share My Personal information [termly.io]Limit the Use Of My Sensitive Personal Information [termly.io]Consent Preferences×Get smart with GeekWire. Sign up for our new daily newsletter. Sign UpDo not show again.

Original Submission