← Back to blog

Why AI Editors Feel Like They Didn't Read Your Book

You ran your novel through an AI editor, read the report, and something felt off. The notes on your opening chapter were sharp. Specific. The notes on your ending were sharp too. And the two hundred pages in between... came back vague. Generic. The kind of feedback that could apply to anybody's manuscript, or to a book the tool had only heard about secondhand.

You're not imagining that. And you're not being paranoid about AI. What you noticed is real, it happens constantly, and it has an actual name in the research. So let's talk about why the middle of your book is exactly where these tools go blind.

The short version: large language models read the start and end of a long document closely and get hazy in the middle, so an AI editor handed your whole novel at once tends to skim the exact chapters where your plot, pacing, and continuity live.

The middle is where your book actually lives

Think about what's IN your middle chapters.

Your opening is doing a specific job (hook, promise, character, world). Your ending is doing a specific job too (payoff, resolution, the emotional landing). Those are the easy parts to talk about because they're structurally load-bearing and everybody's craft vocabulary already points at them.

But the middle? The middle is where your subplot threads weave, where your pacing either holds or sags, where a character says one thing in chapter four and contradicts it in chapter eleven. It's where act two lives or dies. Any working writer will tell you the saggy middle is the hardest part of a novel to get right (I've rewritten a few of my own middles into oblivion, so believe me, I know).

So if a tool reads your bookends carefully and then goes fuzzy across the entire middle... it went fuzzy on the part you most needed help with.

Why does AI feedback go vague in your middle chapters?

Here's what I learned when I started digging into this, and it genuinely surprised me.

When you hand a very long document to a large language model, it does not read it the way you'd read it, front to back, weighing every page evenly. What tends to happen is the model pays close attention to the beginning and the end of the input, and gets progressively hazier about everything in the middle. Researchers have a name for it. They call it "lost in the middle". It's well documented, it shows up across basically every model, and it's not a bug somebody forgot to fix. It's just how these systems handle a big pile of text.

So picture your twenty-four-chapter manuscript going into one of these tools as a single giant prompt. The model reads chapter one closely. It reads chapter twenty-four closely. And chapters two through twenty-three get... compressed. Skimmed. Turned into a rough summary of what the model THINKS happened, rather than a real reading of what actually happened.

And a rough summary is where the trouble starts.

The part that should worry you

A vague note is annoying. A CONFIDENT vague note is dangerous.

When the model summarizes your middle instead of reading it, it doesn't tell you it summarized. It just writes feedback based on its compressed impression. And because these models are built to sound fluent and sure of themselves, that feedback arrives sounding exactly as authoritative as the good notes on your first chapter.

So you get things like a "continuity issue" for a contradiction that isn't actually in your text. Or praise for a scene that reads nothing like what you wrote. Or two of your characters quietly blended into one because the model lost track of who was who somewhere around chapter seven. This is hallucination, and it breeds in the middle precisely because that's where the model stopped really reading and started guessing.

Now here's the honest gut-punch: how would you even catch it? You wrote the book. You know chapter seven cold. But a first-time author trusting the tool, or anyone reading a report on a manuscript they drafted months ago, might revise a perfectly good scene to fix a "problem" the AI invented. That's not a small thing. That's you doing damage to your own book on the advice of a tool that skimmed it.

How to tell if this happened to your report

You don't need to understand the engineering to spot the symptom. A few tells:

  • The feedback on your opening and ending is concrete and quotes your actual text, but the middle notes stay abstract and quote nothing.
  • An event or detail gets described "back to you" slightly wrong (a name, a location, who did what to whom).
  • The report flags a contradiction, you go check, and... there's no contradiction.
  • Characters get merged, swapped, or attributed dialogue they never spoke.

If you're seeing that pattern, the tool didn't read your whole book. It read the edges and filled in the rest.

What it actually takes to fix this

The fix isn't a smarter model or a longer prompt. Bigger context windows have not made "lost in the middle" go away (people keep hoping, it keeps not happening).

The fix is to stop shoving the entire novel in as one blob and hoping. You break the manuscript down and analyze it in pieces small enough that the model has nowhere to hide and nothing to skim. Every chapter gets read on its own terms, with the model's full attention on that chapter, not on some compressed memory of it competing with twenty-three others.

This is the whole reason FirstReader exists, honestly. I hit this exact wall, got tired of feedback that clearly hadn't read the middle of my book, and went looking for a way to force a real reading out of these tools. The answer turned out to be a lot of unglamorous engineering. Analyze each chapter separately. Feed the model measured facts about your text before it opines on anything. Verify that every quoted excerpt actually appears in your manuscript, word for word, so a "quote" can't be something the model reconstructed from a hazy summary. (If you want the full ugly plumbing, I laid it out in How FirstReader Actually Works and in Your Editing Pipeline Has a Blind Spot.)

None of that is magic. It's just the difference between a tool that reads your book and a tool that reads the cover and the last page and bluffs the rest.

Where this doesn't apply

Let me be square with you. This isn't me saying every AI tool is useless and only mine reads carefully. If your manuscript is short (a single chapter, a short story, a query), the "middle" is small enough that most tools handle it fine. And plenty of AI feedback on your OPENING is genuinely useful, because the opening is the part these tools read well no matter what.

FirstReader isn't magic either. It gets things wrong sometimes (I've got two separate accuracy passes running specifically because I assume it will). And it will never replace a sharp human developmental editor who's read your genre for twenty years. What it will do is actually read all of your book, middle included, before it tells you what's wrong with it. Which, it turns out, is a surprisingly high bar.

So before you revise a single scene based on an AI report, ask the tool one quiet question: did you actually read chapter seven? If the report can't quote it, you have your answer.

If you want to see what a real reading of your manuscript looks like, run a free chapter through FirstReader and read the notes. Then go check them against your text. That's the whole test.

Common questions

Does AI actually read my whole manuscript?

Not always. Handed an entire novel in one pass, most large language models read the opening and ending closely and skim the middle. So the feedback on your middle chapters is often built from a rough summary, not a real reading.

Why is AI feedback on my middle chapters so generic?

Because the model paid less attention there. It compresses the middle of a long input into a hazy summary, then writes notes from that summary. Generic middle feedback usually means the tool skimmed those chapters instead of reading them.

How can I tell if an AI editor skimmed my book?

Check whether the notes quote your actual text. Sharp, quoted feedback on your first chapter but vague, quote-free notes in the middle is the tell. Wrong details, invented contradictions, or two characters merged into one also point to skimming.

Does a bigger context window fix this?

Not on its own. Larger context windows let a model accept longer inputs, but it still pays less attention to the middle. The reliable fix is analyzing a manuscript chapter by chapter, so nothing gets skimmed in the first place.


If this was useful, drop a comment and let me know. If it wasn't, I want to hear that too. And if you're not on the list yet, subscribe so you don't miss the next one.

Also on Substack

Comments

No comments yet. Be the first.

Leave a comment

Don't have a FirstReader account yet? Sign up free and get a free chapter analysis.