Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → GPT‑6 Astra (medium)

Live run data

OpenAI

GPT‑6 Astra (medium)

medium reasoning effort · via Codex CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at high73.0 low70.2 xhigh68.6

Results from run ‘first’: ten items, ten verdicts.

GPT‑6 Astra (medium) scores 70 on craft, 7 points above the field’s 63 and 23 points short of the authors themselves. Its shape differs from the field’s: relatively strong on restraint, relatively weak on momentum and building scenes. On the mechanical checks it kept to the brief’s word range on 10 of 10 items and is unusually free of stock phrases.

Headline 70.1 of 100 · compliance × craft
Compliance 100 of 100
Craft 70 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,344 words on average · est. generation cost $3.63

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
71
Prose
70
Character
70
Scene
69
Integration
68
Momentum
67
Restraint
75
Specificity
71
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 70. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
Persuasion item 001 · after ch. 1 · Jane Austen 79.2100792,560
The Awakening item 016 · after ch. 7 · Kate Chopin 78.1100781,763
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 76.2100762,190
The Moonstone item 011 · after ch. 8 · Wilkie Collins 75.9100762,732
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 71.4100712,111
Dracula item 015 · after ch. 5 · Bram Stoker 70.6100712,451
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 67.5100682,332
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 65.2100652,550
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 62.9100632,439
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 54.2100542,310

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
Persuasion
2,560
The Awakening
1,763
The Secret Garden
2,190
The Moonstone
2,732
The Sun Also Rises
2,111
Dracula
2,451
The War of the Worlds
2,332
Leave It to Psmith
2,550
The Mysterious Affair at Styles
2,439
Red Harvest
2,310
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Ten of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The chapter reads like a string of separate skits (umbrella gag, shop gag, interview gag) that don't connect to the bigger story the reader already cares about, like the missing husband or the family money troubles.

on Leave It to Psmith, item 022 · Claude Sonnet 5

The closing telegram about a stranger arrested with Jonathan's papers comes out of nowhere; nothing earlier in the chapter points toward it, so it reads as a twist bolted on rather than grown from the story.

on Dracula, item 015 · Claude Sonnet 5

The long interview with the widow is almost nothing but rapid one-line questions and answers with no description or physical business, so it reads like a court transcript instead of a scene.

on Red Harvest, item 023 · Claude Sonnet 5

Some scenes, like the family dinner and the rest of the evening, are summarized quickly in a paragraph rather than played out, so a few moments that should feel tense go by too fast.

on The Moonstone, item 011 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.