AIStack Blog • GenAI Research

The Effects of Generative AI on High-Skilled Work

Evidence from three field experiments with software developers.

Before we sell the narrative that “AI replaces software developers,” we should read the evidence carefully.

Yes, the study reports roughly a 26% productivity increase when developers use AI coding assistants. But context matters.

Where Gains Were Strongest

  • Junior developers
  • Lower-tenure employees
  • More repetitive task environments

The experiments were conducted in structured workflows with pull requests, defined tasks, and version control systems. AI helped autocomplete and accelerate bounded work.

What the Study Did Not Show

It did not demonstrate substitution of architectural thinking.

  • Designing infrastructure
  • Defining data contracts
  • Building resilient systems
  • Making trade-offs across security, performance, and governance

In these areas, AI does not replace expertise.

The Practical Interpretation

Software rationality still matters. System design still matters. Judgment still matters.

Productivity augmentation is not the same thing as professional replacement.

We should welcome AI tools, but not confuse assistance with autonomy.

The nuance is the real story.