BackgroundActive engagement with feedback is crucial for feedback to be effective and improve students' learning and achievement. Medical students are provided feedback on their development in the... Show moreBackgroundActive engagement with feedback is crucial for feedback to be effective and improve students' learning and achievement. Medical students are provided feedback on their development in the progress test (PT), which has been implemented in various medical curricula, although its format, integration and feedback differ across institutions. Existing research on engagement with feedback in the context of PT is not sufficient to make a definitive judgement on what works and which barriers exist. Therefore, we conducted an interview study to explore students' feedback use in medical progress testing.MethodsAll Dutch medical students participate in a national, curriculum-independent PT four times a year. This mandatory test, composed of multiple-choice questions, provides students with written feedback on their scores. Furthermore, an answer key is available to review their answers. Semi-structured interviews were conducted with 21 preclinical and clinical medical students who participated in the PT. Template analysis was performed on the qualitative data using a priori themes based on previous research on feedback use.ResultsTemplate analysis revealed that students faced challenges in crucial internal psychological processes that impact feedback use, including 'awareness', 'cognizance', 'agency' and 'volition'. Factors such as stakes, available time, feedback timing and feedback presentation contributed to these difficulties, ultimately hindering feedback use. Notably, feedback engagement was higher during clinical rotations, and students were interested in the feedback when seeking insights into their performance level and career perspectives.ConclusionOur study enhanced the understanding of students' feedback utilisation in medical progress testing by identifying key processes and factors that impact feedback use. By recognising and addressing barriers in feedback use, we can improve both student and teacher feedback literacy, thereby transforming the PT into a more valuable learning tool. Show less
Milders, J.; Ramspek, C.L.; Janse, R.J.; Bos, W.J.W.; Rotmans, J.I.; Dekker, F.W.; Diepen, M. van 2023
Prognostic models can strongly support individualized care provision and well-informed shared decision making. There has been an upsurge of prognostic research in the field of nephrology, but the... Show morePrognostic models can strongly support individualized care provision and well-informed shared decision making. There has been an upsurge of prognostic research in the field of nephrology, but the uptake of prognostic models in clinical practice remains limited. Therefore, we map out the research field of prognostic models for kidney patients and provide directions on how to proceed from here. We performed a scoping review of studies developing, validating, or updating a prognostic model for patients with CKD. We searched all published models in PubMed and Embase and report predicted outcomes, methodological quality, and validation and/or updating efforts. We found 602 studies, of which 30.1% concerned CKD populations, 31.6% dialysis populations, and 38.4% kidney transplantation populations. The most frequently predicted outcomes were mortality (n=129), kidney disease progression (n=75), and kidney graft survival (n=54). Most studies provided discrimination measures (80.4%), but much less showed calibration results (43.4%). Of the 415 development studies, 28.0% did not perform any validation and 57.6% performed only internal validation. Moreover, only 111 models (26.7%) were externally validated either in the development study itself or in an independent external validation study. Finally, in 45.8% of development studies no useable version of the model was reported. To conclude, many prognostic models have been developed for patients with CKD, mainly for outcomes related to kidney disease progression and patient/graft survival. To bridge the gap between prediction research and kidney patient care, patient-reported outcomes, methodological rigor, complete reporting of prognostic models, external validation, updating, and impact assessment urgently need more attention. Show less
Wijk, E.V. van; Janse, R.J.; Ruijter, B.N.; Rohling, J.H.T.; Kraan, J. van der; Crobach, S.; ... ; Langers, A.M.J. 2023
Multiple choice questions (MCQs) offer high reliability and easy machine-marking, but allow for cueing and stimulate recognition-based learning. Very short answer questions (VSAQs), which are open... Show moreMultiple choice questions (MCQs) offer high reliability and easy machine-marking, but allow for cueing and stimulate recognition-based learning. Very short answer questions (VSAQs), which are open-ended questions requiring a very short answer, may circumvent these limitations. Although VSAQ use in medical assessment increases, almost all research on reliability and validity of VSAQs in medical education has been performed by a single research group with extensive experience in the development of VSAQs. Therefore, we aimed to validate previous findings about VSAQ reliability, discrimination, and acceptability in undergraduate medical students and teachers with limited experience in VSAQs development. To validate the results presented in previous studies, we partially replicated a previous study and extended results on student experiences. Dutch undergraduate medical students (n = 375) were randomized to VSAQs first and MCQs second or vice versa in a formative exam in two courses, to determine reliability, discrimination, and cueing. Acceptability for teachers (i.e., VSAQ review time) was determined in the summative exam. Reliability (Cronbach's & alpha;) was 0.74 for VSAQs and 0.57 for MCQs in one course. In the other course, Cronbach's & alpha; was 0.87 for VSAQs and 0.83 for MCQs. Discrimination (average R-ir) was 0.27 vs. 0.17 and 0.43 vs. 0.39 for VSAQs vs. MCQs, respectively. Reviewing time of one VSAQ for the entire student cohort was & PLUSMN;2 minutes on average. Positive cueing occurred more in MCQs than in VSAQs (20% vs. 4% and 20.8% vs. 8.3% of questions per person in both courses). This study validates the positive results regarding VSAQs reliability, discrimination, and acceptability in undergraduate medical students. Furthermore, we demonstrate that VSAQ use is reliable among teachers with limited experience in writing and marking VSAQs. The short learning curve for teachers, favourable marking time and applicability regardless of the topic suggest that VSAQs might also be valuable beyond medical assessment. Show less
Wijk, E.V. van; Janse, R.J.; Ruijter, B.N.; Rohling, J.H.T.; Kraan, J. van der; Crobach S.; ... ; Langers, A.M.J. 2023
Multiple choice questions (MCQs) offer high reliability and easy machine-marking, but allow for cueing and stimulate recognition-based learning. Very short answer questions (VSAQs), which are open... Show moreMultiple choice questions (MCQs) offer high reliability and easy machine-marking, but allow for cueing and stimulate recognition-based learning. Very short answer questions (VSAQs), which are open-ended questions requiring a very short answer, may circumvent these limitations. Although VSAQ use in medical assessment increases, almost all research on reliability and validity of VSAQs in medical education has been performed by a single research group with extensive experience in the development of VSAQs. Therefore, we aimed to validate previous findings about VSAQ reliability, discrimination, and acceptability in undergraduate medical students and teachers with limited experience in VSAQs development. To validate the results presented in previous studies, we partially replicated a previous study and extended results on student experiences. Dutch undergraduate medical students (n = 375) were randomized to VSAQs first and MCQs second or vice versa in a formative exam in two courses, to determine reliability, discrimination, and cueing. Acceptability for teachers (i.e., VSAQ review time) was determined in the summative exam. Reliability (Cronbach's α) was 0.74 for VSAQs and 0.57 for MCQs in one course. In the other course, Cronbach's α was 0.87 for VSAQs and 0.83 for MCQs. Discrimination (average Rir) was 0.27 vs. 0.17 and 0.43 vs. 0.39 for VSAQs vs. MCQs, respectively. Reviewing time of one VSAQ for the entire student cohort was ±2 minutes on average. Positive cueing occurred more in MCQs than in VSAQs (20% vs. 4% and 20.8% vs. 8.3% of questions per person in both courses). This study validates the positive results regarding VSAQs reliability, discrimination, and acceptability in undergraduate medical students. Furthermore, we demonstrate that VSAQ use is reliable among teachers with limited experience in writing and marking VSAQs. The short learning curve for teachers, favourable marking time and applicability regardless of the topic suggest that VSAQs might also be valuable beyond medical assessment. Show less
Langenhuijsen, L.F.S.; Janse, R.J.; Venema, E.; Kent, D.M.; Diepen, M. van; Dekker, F.W.; ... ; Jong, Y. de 2023
Objectives: To (1) explore trends of risk of bias (ROB) in prediction research over time following key methodological publications, using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)... Show moreObjectives: To (1) explore trends of risk of bias (ROB) in prediction research over time following key methodological publications, using the Prediction model Risk Of Bias ASsessment Tool (PROBAST) and (2) assess the inter-rater agreement of the PROBAST.Study Design and Setting: PubMed and Web of Science were searched for reviews with extractable PROBAST scores on domain and signaling question (SQ) level. ROB trends were visually correlated with yearly citations of key publications. Inter-rater agreement was asResults: One hundred and thirty nine systematic reviews were included, of which 85 reviews (containing 2,477 single studies) on domain level and 54 reviews (containing 2,458 single studies) on SQ level. High ROB was prevalent, especially in the Analysis domain, and overall trends of ROB remained relatively stable over time. The inter-rater agreement was low, both on domain (Kappa 0.04-0.26) and SQ level (Kappa -0.14 to 0.49). Conclusion: Prediction model studies are at high ROB and time trends in ROB as assessed with the PROBAST remain relatively stable. These results might be explained by key publications having no influence on ROB or recency of key publications. Moreover, the trend may suffer from the low inter-rater agreement and ceiling effect of the PROBAST. The inter-rater agreement could potentially be improved by altering the PROBAST or providing training on how to apply the PROBAST.& COPY; 2023 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). Show less
Aim Half of heart failure (HF) patients have chronic kidney disease (CKD) complicating their pharmacological management. We evaluated physicians' and patients' patterns of use of evidence-based... Show moreAim Half of heart failure (HF) patients have chronic kidney disease (CKD) complicating their pharmacological management. We evaluated physicians' and patients' patterns of use of evidence-based medical therapies in HF across CKD stages.Methods and results We studied HF patients with reduced (HFrEF) and mildly reduced (HFmrEF) ejection fraction enrolled in the Swedish Heart Failure Registry in 2009-2018. We investigated the likelihood of physicians to prescribe guideline-recommended therapies to patients with CKD, and of patients to fill the prescriptions within 90 days of incident HF (initiating therapy), to adhere (proportion of days covered >= 80%) and persist (continued use) on these treatments during the first year of therapy. We identified 31 668 patients with HFrEF (median age 74 years, 46% CKD). The proportions receiving a prescription for angiotensin-converting enzyme inhibitors/angiotensin receptor blockers/angiotensin receptor-neprilysin inhibitors (ACEi/ARB/ARNi) were 96%, 92%, 86%, and 68%, for estimated glomerular filtration rate (eGFR) >= 60, 45-59, 30-44, and <30 ml/min/1.73m(2), respectively; for beta-blockers 94%, 93%, 92%, and 92%, for mineralocorticoid receptor antagonists (MRAs) 45%, 44%, 37%, 24%; and for triple therapy (combination of ACEi/ARB/ARNi+ beta-blockers+ MRA) 38%, 35%, 28%, and 15%. Patients with CKD were less likely to initiate these medications, and less likely to adhere to and persist on ACEi/ARB/ARNi, MRA, and triple therapy. Among stoppers, CKD patients were less likely to restart these medications. Results were consistent after multivariable adjustment and in patients with HFmrEF (n = 15114).Conclusions Patients with HF and CKD are less likely to be prescribed and to fill prescriptions for evidence-based therapies, showing lower adherence and persistence, even at eGFR categories where these therapies are recommended and have shown efficacy in clinical trials.[GRAPHICS]. Show less
Background: To investigate the comparative effectiveness of sodium-glucose cotransporter 2 inhibitors (SGLT2i) and glucagon-like peptide 1 receptor agonists (GLP1-RA) on cardiovascular outcomes in... Show moreBackground: To investigate the comparative effectiveness of sodium-glucose cotransporter 2 inhibitors (SGLT2i) and glucagon-like peptide 1 receptor agonists (GLP1-RA) on cardiovascular outcomes in routine clinical practice, which have never been directly compared in head-to-head outcome trials. Methods: We compared outcomes of adults who newly started SGLT2i or GLP1-RA therapy in Stockholm, Sweden, during 2013-2019. The primary outcome was major adverse cardiovascular events (MACE), a composite of cardiovascular (CV) death, myocardial infarction and stroke. Secondary outcomes included the individual MACE components and hospitalization for heart failure. Cox regression with propensity score overlap weighting was used to estimate hazard ratios (HRs) with 95% confidence intervals and adjust for 57 covariates. Results: We included 12,375 individuals, of which 5489 initiated SGLT2i and 6886 GLP1-RA therapy, followed for median 1.6 years. Mean age was 61 years and 37.6% were women. Compared with GLP1-RA, SGLT2i new users had similar risk of MACE risk (adjusted HR 1.04; 95% CI 0.83-1.31). The adjusted HRs (95% CI) for SGLT2i vs. GLP1-RA were 0.80 (0.59-1.09) for heart failure hospitalization, 0.95 (0.58-1.55) for cardiovascular death, 0.91 (0.67-1.24) for myocardial infarction and 1.71 (1.14-2.59) for ischemic stroke (5-year absolute risk dif-ference for stroke 1.9% [95% CI 0.8-3.0]). Conclusions: In a largely primary-prevention population of people undergoing routine care, no differences were observed in MACE risk among initiators of SGLT2i and GLP1-RA. However, compared with GLP1RA, the use of SGLT2i was associated with an increased risk of ischemic stroke that was small in absolute magnitude. Show less
Background The risk-benefit ratio of continuing with renin-angiotensin system inhibitors (RASi) after an episode of acute kidney injury (AKI) is unclear. While stopping RASi may prevent recurrent... Show moreBackground The risk-benefit ratio of continuing with renin-angiotensin system inhibitors (RASi) after an episode of acute kidney injury (AKI) is unclear. While stopping RASi may prevent recurrent AKI or hyperkalaemia, it may deprive patients of the cardiovascular benefits of using RASi. Methods We analysed outcomes of long-term RASi users experiencing AKI (stage 2 or 3, or clinically coded) during hospitalization in Stockholm and Sweden during 2007-18. We compared stopping RASi within 3 months after discharge with continuing RASi. The primary study outcome was the composite of all-cause mortality, myocardial infarction (MI) and stroke. Recurrent AKI was our secondary outcome and we considered hyperkalaemia as a positive control outcome. Propensity score overlap weighted Cox models were used to estimate hazard ratios (HRs), balancing 75 confounders. Weighted absolute risk differences (ARDs) were also determined. Results We included 10 165 individuals, of whom 4429 stopped and 5736 continued RASi, with a median follow-up of 2.3 years. The median age was 78 years; 45% were women and median kidney function before the index episode of AKI was 55 mL/min/1.73 m(2). After weighting, those who stopped had an increased risk [HR, 95% confidence interval (CI)] of the composite of death, MI and stroke [1.13, 1.07-1.19; ARD 3.7, 95% CI 2.6-4.8] compared with those who continued, a similar risk of recurrent AKI (0.94, 0.84-1.05) and a decreased risk of hyperkalaemia (0.79, 0.71-0.88). Discussion Stopping RASi use among survivors of moderate-to-severe AKI was associated with a similar risk of recurrent AKI, but higher risk of the composite of death, MI and stroke. Show less
Janse, R.J.; Hoekstra, T.; Jager, K.J.; Zoccali, C.; Tripepi, G.; Dekker, F.W.; Diepen, M. van 2021
The correlation coefficient is a statistical measure often used in studies to show an association between variables or to look at the agreement between two methods. In this paper, we will discuss... Show moreThe correlation coefficient is a statistical measure often used in studies to show an association between variables or to look at the agreement between two methods. In this paper, we will discuss not only the basics of the correlation coefficient, such as its assumptions and how it is interpreted, but also important limitations when using the correlation coefficient, such as its assumption of a linear association and its sensitivity to the range of observations. We will also discuss why the coefficient is invalid when used to assess agreement of two methods aiming to measure a certain value, and discuss better alternatives, such as the intraclass coefficient and Bland-Altman's limits of agreement. The concepts discussed in this paper are supported with examples from literature in the field of nephrology. Show less
Fu, E.L.; Janse, R.J.; Jong, Y. de; Endt, V.H.W. van der; Milders, J.; Willik, E.M. van der; ... ; Diepen, M. van 2020
Background. Acute kidney injury (AKI) can affect hospitalized patients with coronavirus disease 2019 (COVID-19), with estimates ranging between 0.5% and 40%. We performed a systematic review and... Show moreBackground. Acute kidney injury (AKI) can affect hospitalized patients with coronavirus disease 2019 (COVID-19), with estimates ranging between 0.5% and 40%. We performed a systematic review and meta-analysis of studies reporting incidence, mortality and risk factors for AKI in hospitalized COVID-19 patients.Methods. We systematically searched 11 electronic databases until 29 May 2020 for studies in English reporting original data on AKI and kidney replacement therapy (KRT) in hospitalized COVID-19 patients. Incidences of AKI and KRT and risk ratios for mortality associated with AKI were pooled using generalized linear mixed and random-effects models. Potential risk factors for AKI were assessed using meta-regression. Incidences were stratified by geographic location and disease severity.Results. A total of 3042 articles were identified, of which 142 studies were included, with 49 048 hospitalized COVID-19 patients including 5152 AKI events. The risk of bias of included studies was generally low. The pooled incidence of AKI was 28.6% [95% confidence interval (CI) 19.8-39.5] among hospitalized COVID-19 patients from the USA and Europe (20 studies) and 5.5% (95% CI 4.1-7.4) among patients from China (62 studies), whereas the pooled incidence of KRT was 7.7% (95% CI 5.1-11.4; 18 studies) and 2.2% (95% CI 1.5-3.3; 52 studies), respectively. Among patients admitted to the intensive care unit, the incidence of KRT was 20.6% (95% CI 15.7-26.7; 38 studies). Meta-regression analyses showed that age, male sex, cardiovascular disease, diabetes mellitus, hypertension and chronic kidney disease were associated with the occurrence of AKI; in itself, AKI was associated with an increased risk of mortality, with a pooled risk ratio of 4.6 (95% CI 3.3-6.5).Conclusions. AKI and KRT are common events in hospitalized COVID-19 patients, with estimates varying across geographic locations. Additional studies are needed to better understand the underlying mechanisms and optimal treatment of AKI in these patients. Show less
