OCG LabTask-Domain Decision System
Search evidence
Live
中文

Domain Decision Packet

multi-needle retrieval is the capability cliff for Sonnet 4.6

Back to domains
c

I need to extract key facts from a 300-page technical report

r

locate@document_analysis/long_pdf_extraction

C'

Opus 4.8 for multi-section cross-reference and citation precision. Sonnet 4.6 for single-pass structured extraction at lower cost. All outputs require source verification regardless of model.

Decision Stack

Use

structured PDF, single extraction pass, cost-sensitive

claude/sonnet-4.6
Use

multi-section cross-reference, citation accuracy required, >100 pages

claude/opus-4.8
Avoid

output will be used without manual verification

openai/gpt-5.5
Verify

any model output used for citation

human

Cognitive Transitions

model layer
IDRelationActorResultOutput
CT-D4-001locate@cross_sectionclaude/opus-4.8acceptedstrong multi-needle retrieval; improved citation precision; cheaper token cost in workflow tests
CT-D4-002locate@cross_sectionclaude/sonnet-4.6boundedmatches Opus on single-pass structured docs; degrades on multi-needle retrieval
CT-D4-003validate@citationopenai/gpt-5.5rejectedhigh hallucination rate makes unverified extraction unreliable
E-D4-001bounded

Opus 4.8 on 8-needle 1M MRCR v2: 76%; Sonnet baseline: 18.5%

E-GLOBAL-010
E-D4-002bounded

Sonnet 4.6 matches Opus 4.6 on OfficeQA enterprise document reading

E-GLOBAL-005
E-D4-003bounded

GPT-5.5 hallucination rate 86% on AA-Omniscience

E-GLOBAL-003