Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → GPT‑6 Sol (medium)

Live run data

OpenAI

GPT‑6 Sol (medium)

medium reasoning effort · via Codex CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at high63.8 xhigh61.5

Results from run ‘first’: ten items, ten verdicts.

GPT‑6 Sol (medium) scores 64 on craft, 1 points above the field’s 63 and 29 points short of the authors themselves. Its shape differs from the field’s: relatively strong on restraint, relatively weak on period detail and building scenes. On the mechanical checks it kept to the brief’s word range on 9 of 10 items and is unusually free of stock phrases.

Headline 62.9 of 100 · compliance × craft
Compliance 98 of 100
Craft 64 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,415 words on average · est. generation cost $0.81

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
65
Prose
63
Character
65
Scene
63
Integration
63
Momentum
62
Restraint
70
Specificity
63
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 64. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 77.0100772,190
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 73.4100732,458
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 70.0100702,505
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 67.6100682,586
Persuasion item 001 · after ch. 1 · Jane Austen 63.7100642,535
Dracula item 015 · after ch. 5 · Bram Stoker 62.395662,500
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 59.9100602,507
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 57.295602,375
The Moonstone item 011 · after ch. 8 · Wilkie Collins 53.395562,796
The Awakening item 016 · after ch. 7 · Kate Chopin 44.290491,696

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Sun Also Rises
2,190
The Secret Garden
2,458
The War of the Worlds
2,505
The Mysterious Affair at Styles
2,586
Persuasion
2,535
Dracula
2,500
Leave It to Psmith
2,507
Red Harvest
2,375
The Moonstone
2,796
The Awakening
1,696
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Nine of ten items landed inside their brief’s word range. The Secret Garden ran over by 58 words.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The widow interrogation is a long string of short mechanical questions and one-line answers that reads like a transcript rather than a scene, and it creates a timeline problem: she says a caller told her Donald 'had been hurt' in Hurricane Street, but the established facts have her leaving the house at ten-twenty, twenty minutes before the ten-forty shooting, so no caller could have reported him hurt yet.

on Red Harvest, item 023 · Claude Sonnet 5

The dates don't add up -- an entry headed '6 June' refers to a letter dated 12 June that hasn't happened yet, and a letter dated 18 June is later said to have enclosed 'Jonathan's letter dated 19 June,' which postdates it -- breaking the illusion of a real paper trail.

on Dracula, item 015 · Claude Sonnet 5

It completely drops the Indian jugglers and the boy's prophecy that the previous chapter set up, so the chapter reads like an unrelated errand-list of letter, packet, and Rosanna rather than the next step in the mystery the book had just started.

on The Moonstone, item 011 · Claude Sonnet 5

Most of the chapter's key moments (the dinner-table telegram news, the swim, Robert passing by) are told in quick summary rather than played out as scenes, so the reader is kept at a distance from what's happening.

on The Awakening, item 016 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.