JMIR AI · Published 2026-06-22 · DOI 10.2196/90590
Abstract BackgroundSynthetic electronic health record generation is limited not only by statistical fidelity but also by clinical validity. Records that appear statistically plausible may still violate hard structural, physiological, or relational constraints. ObjectiveThis study evaluated best-of-N constraint-minimizing selection as an inference-time strategy for improving clinical validity and characterized when such selection succeeds or fails as a function of the generator’s valid support mass (pvalid MethodsWe evaluated Wasserstein generative adversarial network with gradient penalty (WGAN-GP) and conditional tabular generative adversarial network (CTGAN) on 3 public clinical tabular datasets: stroke prediction (n=5110), diabetes health indicators (n=100,000), and cardiovascular disease (n=68,599). For each generator, we compared random sampling, naive clipping, and best-of-N selection (N ∈ {8, 16, 128}). Validity was assessed via dataset-specific rule violations; fidelity via Kolmogorov-Smirnov (KS) statistics and correlation preservation; utility via TSTR (train-on-synthetic-test-on-real) AUC (area under the receiver operating characteristic curve); and privacy via membership inference attack (MIA) AUC and distance to closest record (DCR). ResultsBest-of-N effectiveness was governed by the base generator’s valid support mass. In stroke, WGAN-GP had pvalidpvalid ConclusionsBest-of-N functions as a bounded-budget feasibility filter rather than a universal repair mechanism. Its effectiveness depends critically on the generator’s valid support mass. CTGAN+best-of-16 offered the strongest overall trade-off across clinical validity, fidelity, utility, and privacy in our experiments.
Abstract from DOAJ. Public domain (CC0 1.0).
Read the article at the publisher →
Masud, M., Hasan, M. (2026). Improving Clinical Validity in Synthetic Electronic Health Record Generation Using Best-of-N Sampling: Comparative Evaluation Study. JMIR AI. https://doi.org/10.2196/90590