Science Machine · PCOS, audited

Fertility trials and how treatment feels

The same count, run on three conditions: PCOS, endometriosis and male infertility.

Fertility trials rarely report how treatment feels

Fertility trials reporting quality of life, treatment satisfaction, depression or anxiety, in the abstract or the open full text: experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:21-26

ConditionAll fertility trialsWith open full text
PCOS4 of 1493 of 66
Endometriosis1 of 271 of 7
Male infertility1 of 1801 of 63
experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:23-26

These four outcomes are not everything a patient feels. Sexual function is counted separately; 9 of 180 male fertility trials report it. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:27-28

Live birth depends on trial design

Most male-infertility trials are short semen trials that never follow couples to a pregnancy: 106 of 180 report no pregnancy outcome of any kind. Among trials that do follow couples to a pregnancy, live birth is reported about as often in male infertility as in PCOS. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:29-36

Fertility trials reporting live birthPCOSEndometriosisMale infertility
All30/149 (20.1%)10/27 (37.0%)16/180 (8.9%)
Reporting any pregnancy outcome30/119 (25.2%)10/18 (55.6%)16/74 (21.6%)
Treatment-cycle trials24/93 (25.8%)7/20 (35.0%)7/24 (29.2%)
Added after the first results, at the reviewer's request. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:87-95

PCOS minus male infertility, among trials reporting any pregnancy outcome: +3.6 points (−9.1 to 15.2), not called. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:33-34

Outside fertility (exploratory)

Not registered in advance. Outside fertility trials, endometriosis trials report quality of life or satisfaction more often than PCOS trials: 42.0% (84/200) against 13.6% (58/428), a difference of +28.4 points (20.9 to 36.0). experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:39-41

The two groups have different purposes. Endometriosis trials here are mostly pain trials; PCOS trials are mostly metabolic and hormonal. The gap was already there in 2016 to 2019 (34.7% against 8.7%), before either condition's core outcome set was published. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:42-47,128-130

Journals that signed up to report core outcomes

Within each condition, trials in journals on the 2022 CROWN list do not report quality of life or satisfaction more often than trials in other journals. PCOS, all trials: 6.2% (5/80) against 11.3% (56/497), not called. experiments/outcome_audit/CROSS_CONDITION_RESULTS.md:150-158

Limits