Risk-prediction models for health outcomes are used in practice as part of clinical decision-making, and it is essential that their performance be externally validated. An important aspect in the... Show moreRisk-prediction models for health outcomes are used in practice as part of clinical decision-making, and it is essential that their performance be externally validated. An important aspect in the design of a validation study is choosing an adequate sample size. In this paper, we investigate the sample size requirements for validation studies with binary outcomes to estimate measures of predictive performance (C-statistic for discrimination and calibration slope and calibration in the large). We aim for sufficient precision in the estimated measures. In addition, we investigate the sample size to achieve sufficient power to detect a difference from a target value. Under normality assumptions on the distribution of the linear predictor, we obtain simple estimators for sample size calculations based on the measures above. Simulation studies show that the estimators perform well for common values of the C-statistic and outcome prevalence when the linear predictor is marginally Normal. Their performance deteriorates only slightly when the normality assumptions are violated. We also propose estimators which do not require normality assumptions but require specification of the marginal distribution of the linear predictor and require the use of numerical integration. These estimators were also seen to perform very well under marginal normality. Our sample size equations require a specified standard error (SE) and the anticipated C-statistic and outcome prevalence. The sample size requirement varies according to the prognostic strength of the model, outcome prevalence, choice of the performance measure and study objective. For example, to achieve an SE < 0.025 for the C-statistic, 60-170 events are required if the true C-statistic and outcome prevalence are between 0.64-0.85 and 0.05-0.3, respectively. For the calibration slope and calibration in the large, achieving SE < 0.15 would require 40-280 and 50-100 events, respectively. Our estimators may also be used for survival outcomes when the proportion of censored observations is high. Show less
Aims The 12-lead electrocardiogram (ECG) is routinely performed in children with hypertrophic cardiomyopathy (HCM). An ECG risk score has been suggested as a useful tool for risk stratification,... Show moreAims The 12-lead electrocardiogram (ECG) is routinely performed in children with hypertrophic cardiomyopathy (HCM). An ECG risk score has been suggested as a useful tool for risk stratification, but this has not been independently validated. This aim of this study was to describe the ECG phenotype of childhood HCM in a large, international, multi-centre cohort and investigate its role in risk prediction for arrhythmic events. Methods and results Data from 356 childhood HCM patients with a mean age of 10.1 years (+/- 4.5) were collected from a retrospective, multi-centre international cohort. Three hundred and forty-seven (97.5%) patients had ECG abnormalities at baseline, most commonly repolarization abnormalities (n = 277, 77.8%); left ventricular hypertrophy (n = 240, 67.7%); abnormal QRS axis (n = 126, 35.4%); or QT prolongation (n = 131, 36.8%). Over a median follow-up of 3.9 years (interquartile range 2.0-7.7), 25 (7%) had an arrhythmic event, with an overall annual event rate of 1.38 (95% CI 0.93-2.04). No ECG variables were associated with 5-year arrhythmic event on univariable or multivariable analysis. The ECG risk score threshold of >5 had modest discriminatory ability [C-index 0.60 (95% CI 0.484-0.715)], with corresponding negative and positive predictive values of 96.7% and 6.7% Conclusion In a large, international, multi-centre cohort of childhood HCM, ECG abnormalities were common and varied. No ECG characteristic, either in isolation or combined in the previously described ECG risk score, was associated with 5-year sudden cardiac death risk. This suggests that the role of baseline ECG phenotype in improving risk stratification in childhood HCM is limited. Show less
