Physicians Mistook Synthetic Charts for Real Ones

Synthetic Hospital builds longitudinal electronic-health-record cases from public medical-education material, with ontology-grounded diagnoses, findings and time relations rather than protected patient data. In a blinded review, physicians distinguished its charts from real records at a near-chance 53%. The best of ten tested models scored 0.73 severity-weighted F1 on reconstructing problem lists—matching the seven-physician mean on a subset but below the best physician's 0.89—and missed roughly half of clinically relevant findings in chart summaries.