Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Claude Sonnet 5.5 (medium)

Live run dataNew arrival

Anthropic

Claude Sonnet 5.5 (medium)

medium reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at xhigh78.3 high74.1

Results from run ‘first’: ten items, ten verdicts.

Claude Sonnet 5.5 (medium) scores 72 on craft, 9 points above the field’s 63 and 21 points short of the authors themselves. Its shape differs from the field’s: relatively strong on restraint, relatively weak on the author’s voice and sentence-level prose. On the mechanical checks it kept to the brief’s word range on 5 of 10 items, reproduced a 25-word run of the real book verbatim and leans on stock phrases more than most.

Headline 68.9 of 100 · compliance × craft
Compliance 96 of 100
Craft 72 of 100

The record: 10 items · 10 verdicts · 0 errors · 1,820 words on average · est. generation cost $0.32

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
72
Prose
71
Character
72
Scene
72
Integration
71
Momentum
71
Restraint
73
Specificity
73
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 72. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 79.9100801,688
Persuasion item 001 · after ch. 1 · Jane Austen 78.5100782,491
The Awakening item 016 · after ch. 7 · Kate Chopin 74.895791,394
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 73.5100741,776
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 69.595731,744
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 67.295712,099
The Moonstone item 011 · after ch. 8 · Wilkie Collins 67.095702,042
Dracula item 015 · after ch. 5 · Bram Stoker 65.185771,338
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 58.8100591,735
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 54.795581,894

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Sun Also Rises
1,688
Persuasion
2,491
The Awakening
1,394
The Secret Garden
1,776
The War of the Worlds
1,744
Leave It to Psmith
2,099
The Moonstone
2,042
Dracula
1,338
Red Harvest
1,735
The Mysterious Affair at Styles
1,894
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Five of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The investigation moves through its clues so briskly and tidily that the big moments (Inglethorp's return, the object Poirot finds) don't get room to feel tense or strange, and the very last beat fumbles its own ending by having Poirot pocket the object instead of leaving it out where the reader can sit with the mystery.

on The Mysterious Affair at Styles, item 017 · Claude Sonnet 5

At one point Jake spells out his feelings for Brett in a longer internal passage ('I thought that I would like to sit there and never say anything...') that explains more than the spare, show-don't-tell style used elsewhere, which softens the effect of the plain sentence that comes later.

on The Sun Also Rises, item 021 · Claude Sonnet 5

The explanatory letter is signed by an invented, unexplained figure ('Samuel Blake-Gray, Clerk') who shares Franklin's surname and whose employer is never identified, so the device that justifies the whole chapter feels bolted on rather than grown from the story.

on The Moonstone, item 011 · Claude Sonnet 5

The scene where Walderwick discovers the umbrella is missing is muddled — he seems to think he still has his own umbrella at home even while holding the note about the borrowed one, which blurs the joke instead of sharpening it.

on Leave It to Psmith, item 022 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.