In clinical settings, the absolute risk reduction due to treatment that can be expected in a particular patient is of key interest. However, logistic regression, the default regression model for... Show moreIn clinical settings, the absolute risk reduction due to treatment that can be expected in a particular patient is of key interest. However, logistic regression, the default regression model for trials with a binary outcome, produces estimates of the effect of treatment measured as a difference in log odds. We explored options to estimate treatment effects directly as a difference in risk, specifically in the network meta-analysis setting. We propose a novel Bayesian (meta-)regression model for binary outcomes on the additive risk scale. The model allows treatment effects, covariate effects, interactions and variance parameters to be estimated directly on the linear scale of clinical interest. We compared effect estimates from this model to (1) a previously proposed additive risk model by Warn, Thompson and Spiegelhalter ( "WTS model ") and (2) backtransforming the predictions from a logistic model to the natural scale after regression. The models were compared in a network meta-analysis of 20 hepatitis C trials, as well as in the analysis of simulated single trial settings. The resulting estimates diverged, in particular for small sample sizes or true risks close to 0% or 100%. Researchers should be aware that modelling untransformed risk can yield very different results from default logistic models. The treatment effect in participants with such extreme predicted risks weighed more heavily on the overall treatment effect estimate from our proposed model compared to the WTS model. In our network meta-analysis, this sensitivity of our proposed model was needed to detect all information in the data. Show less
Huinink, S.T.; Jong, D.C. de; Nieboer, D.; Thomassen, D.; Steyerberg, E.W.; Dijkgraaf, M.G.W.; ... ; Vries, A.C. de 2022
Background Anti-tumor necrosis factor (TNF) therapy is effective for the treatment of Crohn's disease. Cessation may be considered in patients with a low risk of relapse. We aimed to externally... Show moreBackground Anti-tumor necrosis factor (TNF) therapy is effective for the treatment of Crohn's disease. Cessation may be considered in patients with a low risk of relapse. We aimed to externally validate and update our previously developed prediction model to estimate the risk of relapse after cessation of anti-TNF therapy. Methods We performed a retrospective cohort study in 17 Dutch hospitals. Crohn's disease patients in clinical, biochemical or endoscopic remission were included after anti-TNF cessation. Primary outcome was a relapse necessitating treatment. Discrimination and calibration of the previously developed model were assessed. After external validation, the model was updated. The performance of the updated prediction model was assessed in internal-external validation and by using decision curve analysis. Results 486 patients were included with a median follow-up of 1.7 years. Relapse rates were 35 and 54% after 1 and 2 years. At external validation, the discriminative ability of the prediction model was equal to that found at the development of the model [c-statistic 0.58 (95% confidence interval (CI) 0.54-0.62)], though the model was not well-calibrated on our cohort [calibration slope: 0.52 (0.28-0.76)]. After an update, a c-statistic of 0.60 (0.58-0.63) and calibration slope of 0.89 (0.69-1.09) were reported in internal-external validation. Conclusion Our previously developed and updated prediction model for the risk of relapse after cessation of anti-TNF in Crohn's disease shows reasonable performance. The use of the model may support clinical decision-making to optimize patient selection in whom anti-TNF can be withdrawn. Clinical validation is ongoing in a prospective randomized trial. Show less
