Science Machine · PCOS, audited

How it works

Code counts. The model reads.

The rule

Wherever an answer can be counted (dates, citation counts, how many papers match a search, intervals), code does it. The model is kept for reading and judgement. SPEC.md:81 The code never calls a model. SPEC.md:56

The tool

The pipeline that sweeps a topic for open questions, its guardrails and how it is tested are described on The tool. This page covers how the studies on this site were run and which models did what.

A study, step by step

The results on this site come from studies built on the same parts. A plan is written and committed before any reading. AI readers code each paper against a fixed codebook and give a quote for every code. Code checks the quotes and computes every count and interval. Where a check by another model or a person exists, the page says so in its status box.

AI-use statement

Every model used for the results on this site, and what it did.

ModelJob
Claude Sonnet (Anthropic)Main reader of PCOS trial reports in the outcomes count; second-reader monitor in the three-condition count; both readers in the methods study; both readers for the priorities map; the agents that rate abstracts, pull out gaps, search for prior work and score. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:260,273 experiments/measurand_tiers/repass/REPORT_v3.md:40 experiments/mismatch_map/pmos/PREREG.md:20 .claude/agents/*.md
Claude Haiku (Anthropic)Reader for part of the PCOS trial reports; main reader for endometriosis and male infertility. docs/REVIEW_PMOS_AUDIT_2026-10-26.md:175 experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:259
Claude Opus 5.5 (Anthropic)Reader of companion papers in the outcomes count; independent reviews and red-team reviews; drafted the pages of this site. experiments/outcome_audit/LINKAGE_RESULTS.md:151 docs/REVIEW_PMOS_AUDIT_2026-10-26.md:3
Claude Fable (Anthropic)One benchmark of outcome coding only. experiments/outcome_audit/BENCH.md:11
Gemini 4 argon (Google)Independent re-read of 169 outcome-count records. experiments/outcome_audit/crosscheck/RESULTS_full.md:37-42
DeepSeek v4.1 flash (DeepSeek)Independent re-read of the same 169 records. experiments/outcome_audit/crosscheck/RESULTS_full.md:5-10
No modelAll counts, intervals and tests; the gut gene counts (sequence alignment by code).

Claude drafts the prose on this site from the results files, and Dan Bonomo edits it. Each page says at the foot whether his edit is done. Formal papers with a DOI are written by Dan.

What it cost

Model work for the Claude readers runs under a subscription, so most costs are counted in tokens rather than dollars.