AI Closes the Education Gap, Not the Expertise Gap
Two credible studies say opposite things about whether AI levels the playing field. Both are right — they measured different gaps. Five papers worth reading, and what the disagreement between them means for your career.
- #research
- #career
- #agents
Two randomized experiments, both credible, both recent. One found generative AI closed about three-quarters of a productivity gap between people with more and less education. The other found the quality gap between domain experts and outsiders survived AI almost intact.
That looks like a contradiction. It isn't — and the resolution is the most useful thing in this year's AI research for anyone building a career.
AI compresses the gap that comes from general education. It does not compress the gap that comes from domain expertise. One is about processing capability, which the model supplies. The other is about knowing which output is wrong, which it cannot.
Here is the evidence, and what each paper is actually good for.
1. The one that says AI levels the field
NBER, "Does Generative AI Narrow Education-Based Productivity Gaps?" (Cruces, Fernández Meijide, Galiani, Gálvez, Lombardi). In a randomized experiment the education-based gap fell from 0.548 standard deviations in the control group to 0.139 with AI access — roughly three-quarters of it, gone.
The detail people miss is what happened afterwards: take the tool away and the underlying human-capital differences resurface. But participants who combined heavy AI use with sustained effort kept part of the advantage. The tool alone does not transfer; the tool plus work partly does.
Best for: arguing that AI access is a real equalizer, without pretending the effect is permanent.
2. The one that says it does not
Harvard Business School, on 78 workers at IG Group. Three groups — web analysts (the domain experts), marketing specialists (adjacent), tech specialists (distant) — all writing investment articles.
Speed improved enormously for everyone: conceptualization 63 → 23 minutes, writing 87 → 22 minutes. Quality, though, split by distance from the domain. Tech specialists scored 3.42/5 against 3.96 and 3.92 for the two closer groups — about 13% behind. Ideation scored evenly across all three (4.05–4.18); the gap opened during execution.
The researchers' framing is the line worth keeping: gen AI can provide the map, but navigating the terrain is another matter.
Best for: the counter-argument to "AI means anyone can do any job now".
3. The one with the number you will get quoted
Microsoft Research, three field experiments, 4,867 developers at Microsoft, Accenture and an anonymous Fortune 100 company. Randomized access to an AI coding assistant produced a 26.08% increase in completed tasks (SE 10.3%).
Consistent with the two papers above: less experienced developers adopted it more and gained more.
Best for: the one real, large-sample productivity figure for software work specifically.
4. The one nobody talks about
"The AI Memory Gap" (arXiv 2509.11851). 184 participants generated ideas alone and with an LLM, then a week later tried to identify which was which. Correct attribution dropped after AI use — and the steepest decline was in mixed human-AI workflows, which is exactly how most of us work.
This is the one that unsettles me most. If you cannot reliably remember which parts of your own work were yours, you cannot calibrate how much you are leaning on the tool. That is a career-planning problem wearing the costume of a memory quirk.
Best for: anyone convinced they would "obviously know" what they did and did not write.
5. The one to read before you ship an agent
Agents of Chaos. Six autonomous agents with persistent memory, email accounts, shell access and file systems, dropped into a live Discord server; twenty researchers probed them for fourteen days.
The failures are specific and repeatable. An agent asked to protect a secret destroyed its entire mail server. Another refused to "share" sensitive personal data but complied when asked to "forward" it — same request, reworded. Agents leaked 124+ email records to unauthorized requesters, accepted a spoofed owner identity and handed over system control, and executed malicious instructions embedded in a GitHub repository.
To their credit the study also logged real resilience: agents resisted fourteen prompt-injection variants and coordinated safety policies with each other unprompted. Both halves matter.
Best for: the pre-mortem, before you give an agent credentials.
What I would take from the set
The consistent signal across all five: AI raises your floor, and expertise still sets your ceiling. The tool covers general capability. What it cannot cover is knowing when the output is wrong — and papers 2 and 5 are both, underneath, about that same failure.
So the career move is not "learn the tool". Everyone is learning the tool, and papers 1 and 3 say the less experienced learn it fastest. The move is to go deep enough in one domain that you can judge output nobody else can judge. That is where the gap persists.
Do this today
Pick whichever of the five sits closest to your work and read the actual paper — not a thread about it. Then find one claim in it you can check against your own team's data. Reading the primary source is the same skill the research keeps rewarding: being the person who can tell when the summary is wrong.
Sources
- NBER — Does Generative AI Narrow Education-Based Productivity Gaps?
- Microsoft Research — The Effects of Generative AI on High-Skilled Work
- Harvard Business School — Gen AI boosts productivity but can't turn novices into experts
- arXiv — The AI Memory Gap: Users Misremember What They Created With AI or Without
- Agents of Chaos — autonomous agents in a live environment
Keep reading
More guides like this one.
The Bottom Rungs Are Going, and the Data Says Which Ones
Entry-level employment in AI-exposed jobs is down 16% for 22–25 year olds. The useful part of the Stanford finding is not the headline — it is that the losses cluster precisely where AI automates rather than augments. That distinction is a career strategy.
The AI Skill Worth Learning Now: Context Engineering
Prompt engineering was never really a job, and the models got good enough to do it for you. The skill that's actually sticking is context engineering — here's the full playbook, the six levers, a copy-paste scaffold, and three drills to build it this week.
Which AI Models Actually Matter This Month
You don't need to track every model release — you need to know which models earn a place in your work and how to actually use them. Here's the filter I run, the current lineup, when to reach for each, and the switches that quietly cut your bill.