Judgment Lab

Strengthening human judgment in AI-enabled work.

Failure mode 2 of 7

Fluency substitution

PME means professional military education. The Classroom version is also available for high school.

Two students in an invention class get the same task, the same inventor's notes and the same AI: draft patent claims for the inventor's wearable, the sentences that set what an invention protects. A claim has to be new: no earlier device does it. The class allows AI, and both say they used it. The first has the AI draft the claims, reads the draft closely and agrees with it. The second first writes down what's new and how it works, then has the AI draft from that. Suppose both hand in the very same claims. The same goes for any polished work a student hands in: change one fact, and you find out whether the reasoning in it is theirs. This is fluency substitution: polished analysis stands in for owned reasoning. Illustration based on Autor et al. (2026). The study followed practising patent lawyers; no students took part. The students, the class, the invention and the older patent are constructed.

1:41 · Read the figure

Fluency substitution, an animated figure in twelve beats

An animated figure that opens on its name, Fluency substitution, failure mode 2 of 7, and builds a table. A red dot stands for a student in an invention class with an example task: draft the patent claims for an inventor's wearable that reads heart rate. The class allows AI, and its use is disclosed. An AI drafts polished claims, shown in grey on a beige band, the figure's mark for words the AI wrote: main claim, reading through clothing, since no earlier device does it; second claim, the sensor's fabric adjustment; backup claim, the battery design. The student reads it closely and agrees with every line. A second student first writes down in a red note what is new and how it works, "it reads heart rate through clothing, by adjusting its sensor to each fabric", then has an AI draft from it. Suppose that draft matches the first one word for word. The teacher receives two identical drafts, both tagged as drafted with AI. With the drafts set aside, the teacher asks each student what they would claim and why, and both explain clearly: reading through clothing, which no device has done before. Their answers appear in plain ink, as the teacher would hear them. Then one fact changes: an older patent already covers reading through clothing. The first student takes the draft's backup claim: lead with the battery design. The second leads with the sensor that adjusts to each fabric. Then the teacher adds that the older patent covers the battery too, and the battery answer is struck through: only the sensor is still new. Both drafts listed the sensor, but only the second student knew it was the new part. Only then do the answers take their colours, to show whose words they are: the draft's words in the first student's answers turn the AI's grey, and the students' own words turn red. The figure ends on the name and its definition, "Polished analysis stands in for owned reasoning.", then the teacher’s check and the follow-up, with a source line: illustration based on Autor et al. (2026). Each beat is listed below with what is on screen.

  1. Fluency substitution · Failure mode 2 of 7

    On screen: the name, "Fluency substitution", appears large over the stage with "Failure mode 2 of 7" above it, then moves into the top-left corner, where it stays.

  2. A student in an invention class drafts patent claims.

    On screen: a task card appears at the top left: "Example task: Draft the patent claims: what does the inventor's wearable protect?" A red dot labelled Student appears below it.

  3. The student asks an AI for a draft. It writes polished claims.

    On screen: the dot pulses. A sheet labelled "AI's draft" appears, and a paragraph writes itself line by line in grey on a beige band, and a key below names that band "Written by AI": "Main claim: reading through clothing, since no earlier device does it. Second claim: the sensor's fabric adjustment. Backup claim: the battery design."

  4. The student reads it closely and agrees with every line.

    On screen: the dot reads along each line at a steady pace. Nothing is cut. The label changes to "Their claims, drafted with AI".

  5. A second student first writes down what's new and how it works.

    On screen: the first draft moves into a column headed First student. A second red dot heads a column labelled Second student and writes on a large note card in red, "What's new: it reads heart rate through clothing, by adjusting its sensor to each fabric.", and the key adds "Student's own work" in red.

  6. An AI drafts from the note. Suppose it matches the first draft word for word.

    On screen: the note moves into the top row of the second column. The dot pulses, and a sheet labelled "AI's draft" fills with the same grey paragraph, the second claim on the sensor included. Suppose it is the same as the first draft, word for word. The dot reads each line at the same pace, and a thin line pairs each line with the same line of the first draft.

  7. The teacher receives two identical drafts, made with AI.

    On screen: the second draft moves into its column beside the first, in a row labelled "What the teacher receives". The top row is labelled "Their own work / not handed in": empty for the first student, the note for the second. Both drafts are tagged "Their claims, drafted with AI".

  8. Without the drafts, both explain the claims clearly.

    On screen: both drafts dim. A row labelled "The teacher asks: Drafts aside: what do you claim, and why?" fills. In plain ink, the first student says, "Reading through clothing. No earlier device does it." The second student says, "Reading through clothing. No one has done that before."

  9. Change one fact.

    On screen: a new row appears: "Then one fact changes: What if an older patent covers reading through clothing?"

  10. Both drafts list the sensor. Only the second student knows it's new.

    On screen: in plain ink, the first student says, "Then lead with the battery design." The second student says, "Then lead with the sensor that adjusts to each fabric."

  11. But the older patent covers the battery too.

    On screen: under the answers, a line appears at the same size: "The teacher adds: “It covers the battery too.”" In the first student's answer, "the battery design" is struck through in ink. Of the claims both handed in, only the sensor that adjusts to each fabric is still new.

  12. The colours show whose words these are.

    On screen: the answers take their colours. Words the AI wrote turn grey on a beige band: all of the first student's first answer, and "the battery design". The same words in the first draft are underlined for a few seconds. The students' own words turn red: "Then lead with" and both of the second student's answers.

  13. Teacher’s check: Can the student explain their claims plainly, without the draft? Then change one fact. What would they claim now?

    On screen: both lines appear under the picture at the same size, and a source line, "Illustration based on Autor et al., NBER (2026)", appears under the table. The whole table stays in view.

Teacher’s check

Can the student explain their claims plainly, without the draft?

Then change one fact. What would they claim now?

Both students in the figure explain the claims clearly without the draft. The second line separates them. It comes from The Irreducible Officer, an essay written for military education, which looks for the person who "revises under challenge rather than retreating to the artifact's language".

The study behind this example

Researchers led by David Autor ran a three-month experiment with 133 patent lawyers at eleven U.S. law firms. Some got a custom AI tool for drafting patents and some didn't, and 91 lawyers finished. Expert lawyers, who didn't know who had the tool, graded the work. No students took part. The headline: tested without AI at the end, the experienced lawyers got better, and the newer lawyers split, some better and some worse.

With the AI tool, the lawyers' drafts scored higher after 10 days and again after 90 days, and the newer lawyers gained the most.

At the end, the 91 lawyers who finished each fixed a flawed patent application without AI. Those who had used the tool did better overall, but only because the experienced lawyers did better. The newer lawyers, with fewer than seven years on the job, didn't improve on average: fewer of them scored in the middle, and more scored low or high. The authors suggest AI was a springboard for some newer lawyers and a cushion for others.

Fifteen of the 91 final tests showed signs of AI use. Leave them out, and the overall gain is too small to be sure of, while the experienced lawyers' gain still holds by a looser test.

The authors say plainly that the experiment doesn't explain why AI helped some lawyers and not others. It covers one job, the group of newer lawyers was small, and the AI tool was custom-built. Google ran the study, paid for it, and works with all eleven firms.

The figure's two students show one way such a split could happen in a class. The study measured scores, so it didn't test the figure's explanation: writing down what's new before drafting, and reworking the claims from it when a fact changes. The authors suggest one possible reason for the split: newer lawyers using AI worked faster but didn't get better without it.

Source: Autor, Rodchenko, Martin, Iscenko, Strand, Pearl & Ferere, "Does AI Assistance Enhance or Erode Expertise? Evidence from a Three-Month Field Experiment in Patent Drafting," NBER Working Paper 35720 (revised October 2026). Quotes are from the abstract unless a page is given. The students, the class, the invention, the claims, the older patent and the check are constructed.

From the original PME essay

Fluency substitution is easier to miss. AI produces the tone of analytic maturity (balanced paragraphs, caveats in the right places, the measured voice of a considered judgment) and the student mistakes well-ordered language for well-owned reasoning. Researchers studying AI's effects on student cognition have introduced the concept of epistemic confinement to describe this condition: an illusion of competence while operating entirely within AI-constructed analytical boundaries, where the student believes they are thinking independently while the frame doing the work was never theirs (Chow et al., 2026). In strategy, fluency substitutes for deciding. A paragraph that balances every consideration may never identify which risk actually matters most.

The Irreducible Officer, Section II, What the Problem Looks Like

Go further

All failure modes