This thesis addresses potential threats to the validity of observational epidemiological studies. Examples of these potential sources of bias are confounding, missing data, selection bias, and... Show moreThis thesis addresses potential threats to the validity of observational epidemiological studies. Examples of these potential sources of bias are confounding, missing data, selection bias, and measurement error. Although various methods have been developed to mitigate these biases, it is often unclear which methods can be used in which empirical settings. It is also common that issues discussed in methodological studies are overlooked in clinical research. Thus, we investigated problems ofmissing data, selection bias, and measurement error occurring in several specific observational settings and discuss how to optimally handle them. Show less
Measurement error is common in epidemiologic research and may affect the validity of research results. It is therefore important to scrutinise the effects of measurement error in epidemiologic... Show moreMeasurement error is common in epidemiologic research and may affect the validity of research results. It is therefore important to scrutinise the effects of measurement error in epidemiologic research. Even simple forms of measurement error, for instance random measurement error in an exposure, can introduce bias in exposure-outcome associations. And even though there are situations in which measurement error does not introduce bias in the exposure-outcome association, for instance in case of random measurement error in a continuous outcome, it nearly always affects the precision and power of a study. In addition, other forms of measurement error, for example systematic measurement error or differential measurement error in an exposure, covariate or outcome, can affect exposure-outcome associations in complex ways that may not easily be anticipated. Adjusting for measurement error using measurement error correction methods may thus be necessary to obtain reliable estimates of exposure-outcome associations.To facilitate measurement error correction, information about the underlying measurement error mechanism (i.e., model) and its parameters is needed. The measurement error model can sometimes be estimated from internal or external validation data, replicates data or calibration data. Collection and the use of such measurement error mechanism data will likely improve the quality of epidemiologic analyses in the presence of measurement error. This can be done through the application of measurement error correction methods, which adjust the analyses taking into account the information from the measurement error mechanism. Alternatively, in the absence of concrete data about the mechanisms or the parameters of measurement error, sensitivity analysis for measurement error can be used, in which the impact on the epidemiologic analyses of one or a range of hypothesised measurement error mechanisms or their parameters can be investigated. The studies described in the thesis were set out to improve the understanding of the impact of measurement error, to facilitate the application of measurement error correction methods, to improve the design of epidemiologic studies when measurement error in a variable is suspected and, to develop tools to quantitatively assess the impact of measurement error in epidemiologic research. Show less
This thesis describes studies on methods for answering questions about causality, specifically so-called what-if questions, in the presence of methodological obstacles such as confounding, missing... Show moreThis thesis describes studies on methods for answering questions about causality, specifically so-called what-if questions, in the presence of methodological obstacles such as confounding, missing data, and measurement error. Show less
Objectives: Epidemiologic studies often suffer from incomplete data, measurement error (or misclassification), and confounding. Each of these can cause bias and imprecision in estimates of exposure... Show moreObjectives: Epidemiologic studies often suffer from incomplete data, measurement error (or misclassification), and confounding. Each of these can cause bias and imprecision in estimates of exposure-outcome relations. We describe and compare statistical approaches that aim to control all three sources of bias simultaneously.Study Design and Setting: We illustrate four statistical approaches that address all three sources of bias, namely, multiple imputation for missing data and measurement error, multiple imputation combined with regression calibration, full information maximum likelihood within a structural equation modeling framework, and a Bayesian model. In a simulation study, we assess the performance of the four approaches compared with more commonly used approaches that do not account for measurement error, missing values, or confounding.Results: The results demonstrate that the four approaches consistently outperform the alternative approaches on all performance metrics (bias, mean squared error, and confidence interval coverage). Even in simulated data of 100 subjects, these approaches perform well.Conclusion: There can be a large benefit of addressing measurement error, missing values, and confounding to improve the estimation of exposure-outcome relations, even when the available sample size is relatively small. (C) 2020 The Authors. Published by Elsevier Inc. Show less
Luijken, K.; Wynants, L.; Smeden, M. van; Calster, B. van; Steyerberg, E.W.; Groenwold, R.H.H. 2020
Objectives: The aim of this study was to quantify the impact of predictor measurement heterogeneity on prediction model performance. Predictor measurement heterogeneity refers to variation in the... Show moreObjectives: The aim of this study was to quantify the impact of predictor measurement heterogeneity on prediction model performance. Predictor measurement heterogeneity refers to variation in the measurement of predictor(s) between the derivation of a prediction model and its validation or application. It arises, for instance, when predictors are measured using different measurement instruments or protocols.Study Design and Setting: We examined the effects of various scenarios of predictor measurement heterogeneity in real-world clinical examples using previously developed prediction models for diagnosis of ovarian cancer, mutation carriers for Lynch syndrome, and intrauterine pregnancy.Results: Changing the measurement procedure of a predictor influenced the performance at validation of the prediction models in nine clinical examples. Notably, it induced model miscalibration. The calibration intercept at validation ranged from -0.70 to 1.43 (0 for good calibration), whereas the calibration slope ranged from 0.50 to 1.67 (1 for good calibration). The difference in C-statistic and scaled Brier score between derivation and validation ranged from -0.08 to +0.08 and from -0.40 to +0.16, respectively.Conclusion: This study illustrates that predictor measurement heterogeneity can influence the performance of a prediction model substantially, underlining that predictor measurements used in research settings should resemble clinical practice. Specification of measurement heterogeneity can help researchers explaining discrepancies in predictive performance between derivation and validation setting. (C) 2019 The Authors. Published by Elsevier Inc. Show less
Smeden, M. van; Lash, T.L.; Groenwold, R.H.H. 2020
Epidemiologists are often confronted with datasets to analyse which contain measurement error due to, for instance, mistaken data entries, inaccurate recordings and measurement instrument or... Show moreEpidemiologists are often confronted with datasets to analyse which contain measurement error due to, for instance, mistaken data entries, inaccurate recordings and measurement instrument or procedural errors. If the effect of measurement error is misjudged, the data analyses are hampered and the validity of the study's inferences may be affected. In this paper, we describe five myths that contribute to misjudgments about measurement error, regarding expected structure, impact and solutions to mitigate the problems resulting from mismeasurements. The aim is to clarify these measurement error misconceptions. We show that the influence of measurement error in an epidemiological data analysis can play out in ways that go beyond simple heuristics, such as heuristics about whether or not to expect attenuation of the effect estimates. Whereas we encourage epidemiologists to deliberate about the structure and potential impact of measurement error in their analyses, we also recommend exercising restraint when making claims about the magnitude or even direction of effect of measurement error if not accompanied by statistical measurement error corrections or quantitative bias analysis. Suggestions for alleviating the problems or investigating the structure and magnitude of measurement error are given. Show less
Pajouheshnia, R.; Smeden, M. van; Peelen, L.M.; Groenwold, R.H.H. 2019