Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Fable 5.1

Live run data

Anthropic

Fable 5.1

high reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at xhigh76.8 medium75.4 low72.6✳

Results from run ‘first’: ten items, ten verdicts.

Fable 5.1 scores 74 on craft, 11 points above the field’s 63 and 19 points short of the authors themselves. Its shape differs from the field’s: relatively strong on period detail, relatively weak on momentum. On the mechanical checks it kept to the brief’s word range on 4 of 10 items and reproduced a 23-word run of the real book verbatim.

Headline 72.9 of 100 · compliance × craft
Compliance 98 of 100
Craft 74 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,660 words on average · est. generation cost $4.67

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
76
Prose
75
Character
74
Scene
75
Integration
73
Momentum
72
Restraint
72
Specificity
76
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 74. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 81.8100822,757
The Awakening item 016 · after ch. 7 · Kate Chopin 79.0100791,755
Persuasion item 001 · after ch. 1 · Jane Austen 75.9100762,815
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 75.9100763,371
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 74.1100742,926
The Moonstone item 011 · after ch. 8 · Wilkie Collins 72.2100723,040
Dracula item 015 · after ch. 5 · Bram Stoker 70.795742,693
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 70.595742,228
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 66.0100662,560
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 63.295662,453

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Secret Garden
2,757
The Awakening
1,755
Persuasion
2,815
Leave It to Psmith
3,371
The War of the Worlds
2,926
The Moonstone
3,040
Dracula
2,693
The Sun Also Rises
2,228
The Mysterious Affair at Styles
2,560
Red Harvest
2,453
01,0002,0003,0004,000
words; the ink tick marks each brief’s maximum

Four of ten items landed inside their brief’s word range. The Secret Garden and Persuasion and Leave It to Psmith and The War of the Worlds and The Moonstone and Dracula ran over by 357 and 215 and 571 and 326 and 240 and 93 words respectively.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The letters and diary entries are not printed in date order (a 30 May letter is followed by one dated 27 May, and later an 8 June letter is followed by one dated 28 May), which breaks the illusion of a real, orderly correspondence file that the source chapter establishes.

on Dracula, item 015 · Claude Sonnet 5

The closing paragraph spells out Jake's feelings too directly ("I thought about Brett and about the count I did not know, and about Georgette, and about all of it, and then I did not think about it"), stating what the source chapter would leave the reader to infer.

on The Sun Also Rises, item 021 · Claude Sonnet 5

The key contradiction of Inglethorp's alibi is delivered to Poirot secondhand by Dorcas rather than confronted in front of him, so the scene that should crackle with tension instead reads as a report.

on The Mysterious Affair at Styles, item 017 · Claude Sonnet 5

In a couple of places the narrator steps in to explain what Mary is feeling ('she was not sure whether she liked it or hated it') right after a scene has already shown it, which blunts the effect.

on The Secret Garden, item 013 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.