BackgroundA good educational climate is essential for delivering high-quality training for medical trainees, professional development, and patient care. The aim of this study was to (1) validate... Show moreBackgroundA good educational climate is essential for delivering high-quality training for medical trainees, professional development, and patient care. The aim of this study was to (1) validate the Dutch Residency Educational Climate Test (D-RECT) in a Danish setting and (2) describe and evaluate the educational climate among medical trainees.MethodsD-RECT was adopted in a three-step process: translation of D-RECT into Danish (DK-RECT), psychometric validation, and evaluation of educational climate. Trainees from 31 medical specialties at Copenhagen University Hospital - Rigshospitalet, Denmark were asked to complete an online survey in a cross-sectional study.ResultsWe performed a forward-backward translation from Dutch to Danish. Confirmatory factor analysis showed that DK-RECT was robust and valid. The reliability analysis showed that only seven trainees from one specialty were needed for a reliable result. With 304 trainees completing DK-RECT, the response rate was 68%. The subsequent analysis indicated a positive overall educational climate, with a median score of 4.0 (interquartile range (IQR): 3.0-5.0) on a five-point Likert scale. Analysis of the subscales showed that the subscale Feedback received the lowest ratings, while Supervision and Peer collaboration were evaluated highest.ConclusionsPsychometric validation of D-RECT in a Danish context demonstrated valid results on the educational climate in specialist training. DK-RECT can be used to evaluate the effectiveness of interventions in the future and can facilitate the conversation on the educational climate. Show less
Poot, C.C.; Meijer, E.; Fokkema, M.; Chavannes, N.H.; Osborne, R.H.; Kayser, L. 2023
Background: The digitalization of healthcare requires users to have sufficient competence in using digital health technologies. In the Netherlands, as well as in other countries, there is a need... Show moreBackground: The digitalization of healthcare requires users to have sufficient competence in using digital health technologies. In the Netherlands, as well as in other countries, there is a need for a comprehensive, person-centered assessment of eHealth literacy to understand and address eHealth literacy related needs, to improve equitable uptake and use of digital health technologies. Objective: We aimed to translate and culturally adapt the original eHealth Literacy Questionnaire (eHLQ) to Dutch and to collect initial validity evidence. Methods: The eHLQ was translated using a systematic approach with forward translation, an item intent matrix, back translation, and consensus meetings with the developer. A validity-driven and multi-study approach was used to collect validity evidence on 1) test content, 2) response processes and 3) internal structure. Cognitive interviews (n = 14) were held to assess test content and response processes (Study 1). A pre-final eHLQ version was completed by 1650 people participating in an eHealth study (Study 2). A seven-factor Confirmatory Factor Analysis (CFA) model was fitted to the data to assess the internal structure of the eHLQ. Invariance testing was performed across gender, age, education and current diagnosis. Results: Cognitive interviews showed some problems in wording, phrasing and resonance with individual's world views. CFA demonstrated an equivalent internal structure to the hypothesized (original) eHLQ with acceptable fit indices. All items loaded substantially on their corresponding latent factors (range 0.51-0.81). The model was partially metric invariant across all subgroups. Comparison of scores between groups showed that people who were younger, higher educated and who had a current diagnosis generally scored higher across domains, however effect sizes were small. Data from both studies were triangulated, resulting in minor refinements to eight items and recommendations on use, score interpretation and reporting. Conclusion: The Dutch version of the eHLQ showed strong properties for assessing eHealth literacy in the Dutch context. While ongoing collection of validity evidence is recommended, the evidence presented indicate that the eHLQ can be used by researchers, eHealth developers and policy makers to identify eHealth literacy needs and inform the development of eHealth interventions to ensure that people with limited digital access and skills are not left behind. Show less
Poot, C.C.; Meijer, E.; Fokkema, M.; Chavannes, N.H.; Osborne, R.H.; Kayser, L. 2023
BackgroundThe digitalization of healthcare requires users to have sufficient competence in using digital health technologies. In the Netherlands, as well as in other countries, there is a need for... Show moreBackgroundThe digitalization of healthcare requires users to have sufficient competence in using digital health technologies. In the Netherlands, as well as in other countries, there is a need for a comprehensive, person-centered assessment of eHealth literacy to understand and address eHealth literacy related needs, to improve equitable uptake and use of digital health technologies.ObjectiveWe aimed to translate and culturally adapt the original eHealth Literacy Questionnaire (eHLQ) to Dutch and to collect initial validity evidence.MethodsThe eHLQ was translated using a systematic approach with forward translation, an item intent matrix, back translation, and consensus meetings with the developer. A validity-driven and multi-study approach was used to collect validity evidence on 1) test content, 2) response processes and 3) internal structure. Cognitive interviews (n = 14) were held to assess test content and response processes (Study 1). A pre-final eHLQ version was completed by 1650 people participating in an eHealth study (Study 2). A seven-factor Confirmatory Factor Analysis (CFA) model was fitted to the data to assess the internal structure of the eHLQ. Invariance testing was performed across gender, age, education and current diagnosis.ResultsCognitive interviews showed some problems in wording, phrasing and resonance with individual’s world views. CFA demonstrated an equivalent internal structure to the hypothesized (original) eHLQ with acceptable fit indices. All items loaded substantially on their corresponding latent factors (range 0.51–0.81). The model was partially metric invariant across all subgroups. Comparison of scores between groups showed that people who were younger, higher educated and who had a current diagnosis generally scored higher across domains, however effect sizes were small. Data from both studies were triangulated, resulting in minor refinements to eight items and recommendations on use, score interpretation and reporting.ConclusionThe Dutch version of the eHLQ showed strong properties for assessing eHealth literacy in the Dutch context. While ongoing collection of validity evidence is recommended, the evidence presented indicate that the eHLQ can be used by researchers, eHealth developers and policy makers to identify eHealth literacy needs and inform the development of eHealth interventions to ensure that people with limited digital access and skills are not left behind. Show less
Pratiwi Bunga, C.; Dusseldorp, E.; Karch, J.D.; de Rooij, M. 2023
Purpose Both the International Consortium for Health Outcomes Measurement and the National Institutes of Health recommend the use of Patient-Reported Outcomes Measurement Information System (PROMIS... Show morePurpose Both the International Consortium for Health Outcomes Measurement and the National Institutes of Health recommend the use of Patient-Reported Outcomes Measurement Information System (PROMIS (R)) measures in clinical care and research for stroke patients. This study aimed to systematically review the literature on the measurement properties and interpretability of PROMIS measures in stroke patients. Methods Nine databases were searched from January 1st, 2007 till April 12th, 2021 for studies concerning the measurement properties and interpretability of PROMIS measures in stroke patients. The findings of these studies were analyzed according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guideline for systematic reviews of Patient-Reported Outcome Measures (PROMs). Results Ten studies were included. The PROMIS Global Health was studied the most: its two subscales had sufficient structural validity in one study of very good quality, sufficient construct validity with > 75% of hypotheses tested confirmed (high GRADE rating), sufficient internal consistency, i.e. alpha >= 0.70 in two studies (high GRADE rating), sufficient reliability, i.e. ICC >= 0.70 in one study of doubtful quality, and indeterminate responsiveness in one study of inadequate quality. For other PROMIS measures, the measurement properties and interpretability were limitedly studied. Conclusion The PROMIS Global Health showed sufficient structural and construct validity and internal consistency in stroke patients. There is a need for further research on content validity, structural validity, and measurement invariance of PROMIS measures in stroke patients. Show less
Objective: One of the most commonly used tools to measure fatigue is the Multidimensional Fatigue Inventory (MFI). Studies into the scale structure of the MFI show discrepant findings. The... Show moreObjective: One of the most commonly used tools to measure fatigue is the Multidimensional Fatigue Inventory (MFI). Studies into the scale structure of the MFI show discrepant findings. The objective of this study was to investigate the scale structure of the MFI in the general Dutch population.Study design and Setting: Using data from a Dutch probability-based internet panel (n = 2512), the original 5-factor model, a 4-factor, and a 5-and 4-bifactor model of the MFI were tested with confirmatory factor analyses. Additional models were investigated using exploratory factor analysis.Results: Results neither confirmed a 5-factor (RMSEA = 0.120, CFI = 0.933, TLI = 0.920) nor a 4-factor model (RMSEA = 0.122, CFI = 0.928, TLI = 0.917). The two bi-factor models also showed a poor fit (bi-4-factor: RMSEA = 0.151, CFI = 0.895, TLI = 0.873; bi-5-factor: RMSEA = 0.153, CFI = 0.894, TLI = 0.871). Exploratory factor analysis did not support an alternative model, but seemed to show robustness in the loading of the original general fatigue items.Conclusion: Our results did not provide empirical support for a four or five (bi-)factor structure of the MFI, nor for an alternative model. The most reliable scale of the MFI seems to be the general fatigue scale that could be used as a general indicator of fatigue. (C) 2021 The Authors. Published by Elsevier Inc. Show less
This White Paper by the European Society for Swallowing Disorders (ESSD) reports on the current state of screening and non-instrumental assessment for dysphagia in adults. An overview is provided... Show moreThis White Paper by the European Society for Swallowing Disorders (ESSD) reports on the current state of screening and non-instrumental assessment for dysphagia in adults. An overview is provided on the measures that are available, and how to select screening tools and assessments. Emphasis is placed on different types of screening, patient-reported measures, assessment of anatomy and physiology of the swallowing act, and clinical swallowing evaluation. Many screening and non-instrumental assessments are available for evaluating dysphagia in adults; however, their use may not be warranted due to poor diagnostic performance or lacking robust psychometric properties. This white paper provides recommendations on how to select best evidence-based screening tools and non-instrumental assessments for use in clinical practice targeting different constructs, target populations and respondents, based on criteria for diagnostic performance, psychometric properties (reliability, validity, and responsiveness), and feasibility. In addition, gaps in research that need to be addressed in future studies are discussed. The following recommendations are made: (1) discontinue the use of non-validated dysphagia screening tools and assessments; (2) implement screening using tools that have optimal diagnostic performance in selected populations that are at risk of dysphagia, such as stroke patients, frail older persons, patients with progressive neurological diseases, persons with cerebral palsy, and patients with head and neck cancer; (3) implement measures that demonstrate robust psychometric properties; and (4) provide quality training in dysphagia screening and assessment to all clinicians involved in the care and management of persons with dysphagia. Show less
The Deglutition Handicap Index (DHI) is a self-report measure for patients at risk of oropharyngeal dysphagia on deglutition-related aspects of functional health status (FHS) and health-related... Show moreThe Deglutition Handicap Index (DHI) is a self-report measure for patients at risk of oropharyngeal dysphagia on deglutition-related aspects of functional health status (FHS) and health-related quality of life (HR-QoL). The DHI consists of 30 items which are subsumed within the Symptom, Functional and Emotional subscales. The purpose of this study was to evaluate the psychometric properties of the DHI using Classic Test Theory according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. A total of 453 patients with dysphagia with different aetiologies were recruited concurrently at two academic hospitals. Dysphagia was confirmed by fiberoptic endoscopic and/or videofluoroscopic evaluation of swallowing. In addition, a healthy control group of 132 participants were recruited. Structural validity was determined using exploratory and confirmatory factor analyses and internal consistency by calculating Cronbach's alpha coefficients. Hypothesis testing was evaluated using Mann-Whitney U-tests, linear regression analysis and correlations analysis. Diagnostic performance and receiver operating characteristic curves analysis were calculated. Factor analyses indicated that the DHI is a unidimensional measure. The DHI has good internal consistency with some indication of item redundancy, weak to moderate structural validity and strong hypothesis testing for construct validity. The DHI shows high diagnostic performance as part of criterion validity. These findings support that the DHI is an appropriate choice as a patient self-report measure to evaluate FHS and HR-QoL in dysphagia. Ongoing validation to assess the measure for possible item redundancy and to examine the dimensionality of the DHI using item response theory is recommended. Show less
Fibreoptic Endoscopic Evaluation of Swallowing (FEES) and Videofluoroscopic Swallow Studies (VFSS) are instrumental assessments of dysphagia which provide videos of the internal structures of... Show moreFibreoptic Endoscopic Evaluation of Swallowing (FEES) and Videofluoroscopic Swallow Studies (VFSS) are instrumental assessments of dysphagia which provide videos of the internal structures of swallowing. They are commonly regarded as gold-standard' assessments; however, there is no consensus regarding a gold-standard measure to analyse the video recordings that they produce. Measures require sound psychometric properties to be suitable for clinical or research purposes. To date, no review of psychometric properties of FEES and VFSS measures has been undertaken or formally reported. This review assessed the quality of the psychometric properties of visuoperceptual measures of FEES and VFSS. Electronic databases were searched for studies reporting on psychometric qualities of visuoperceptual measures which are used to analyse recordings from FEES and VFSS. All dates until February 2017 were included. The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist was used to evaluate the methodical quality of studies. The measures' overall quality was then assessed by combining COSMIN ratings with quality criteria. Forty-five studies, reporting on 39 measures, met the inclusion criteria for this review. Data about the measures' psychometric properties were very limited. Twenty-one measures had information available about reliability only, while 18 had information on up to five of the possible nine psychometric properties categorised within the COSMIN framework. The majority of the FEES and VFSS measures' psychometric properties were rated as indeterminate' overall, due to the small number of studies, issues with design, statistical analyses, and reporting practices of extant studies. There is insufficient evidence to recommend any individual measure included in this review as valid and reliable to interpret VFSS and FEES recordings. Further research, which utilises robust methodological design and reporting, is needed to examine the psychometric properties of measures for FEES and VFSS. Show less
The Swallowing Quality of Life questionnaire (SWAL-QOL) is widely used clinically and in research to evaluate quality of life related to swallowing difficulties. It has been described as a valid... Show moreThe Swallowing Quality of Life questionnaire (SWAL-QOL) is widely used clinically and in research to evaluate quality of life related to swallowing difficulties. It has been described as a valid and reliable tool, but was developed and tested using classic test theory. This study describes the reliability and validity of the SWAL-QOL using item response theory (IRT; Rasch analysis). SWAL-QOL data were gathered from 507 participants at risk of oropharyngeal dysphagia (OD) across four European countries. OD was confirmed in 75.7% of participants via videofluoroscopy and/or fiberoptic endoscopic evaluation, or a clinical diagnosis based on meeting selected criteria. Patients with esophageal dysphagia were excluded. Data were analysed using Rasch analysis. Item and person reliability was good for all the items combined. However, person reliability was poor for 8 subscales and item reliability was poor for one subscale. Eight subscales exhibited poor person separation and two exhibited poor item separation. Overall item and person fit statistics were acceptable. However, at an individual item fit level results indicated unpredictable item responses for 28 items, and item redundancy for 10 items. The item-person dimensionality map confirmed these findings. Results from the overall Rasch model fit and Principal Component Analysis were suggestive of a second dimension. For all the items combined, none of the item categories were 'category', 'threshold' or 'step' disordered; however, all subscales demonstrated category disordered functioning. Findings suggest an urgent need to further investigate the underlying structure of the SWAL-QOL and its psychometric characteristics using IRT. Show less
PurposeThe original 18-item, four-dimensional Trust in Oncologist Scale assesses cancer patients’ trust in their oncologist. The current aim was to develop and validate a short form version of the... Show morePurposeThe original 18-item, four-dimensional Trust in Oncologist Scale assesses cancer patients’ trust in their oncologist. The current aim was to develop and validate a short form version of the scale to enable more efficient assessment of cancer patients’ trust.MethodsExisting validation data of the full-length Trust in Oncologist Scale were used to create a short form of the Trust in Oncologist Scale. The resulting short form was validated in a new sample of cancer patients (n = 92). Socio-demographics, medical characteristics, trust in the oncologist, satisfaction with communication, trust in healthcare, willingness to recommend the oncologist to others and to contact the oncologist in case of questions were assessed. Internal consistency, reliability, convergent and structural validity were tested.ResultsThe five-item Trust in Oncologist Scale Short Form was created by selecting the statistically best performing item from each dimension of the original scale, to ensure content validity. Mean trust in the oncologist was high in the validation sample (response rate 86%, M = 4.30, SD = 0.98). Exploratory factor analyses supported one-dimensionality of the short form. Internal consistency was high, and temporal stability was moderate. Initial convergent validity was suggested by moderate correlations between trust scores with associated constructs.ConclusionsThe Trust in Oncologist Scale Short Form appears to efficiently, reliably and validly measures cancer patients’ trust in their oncologist. It may be used in research and as a quality indicator in clinical practice. More thorough validation of the scale is recommended to confirm this initial evidence of its validity. Show less
Doma, K.; Speyer, R.; Leicht, A.S.; Cordier, R. 2017
The aim was to critically appraise the methodological quality of studies and determine the psychometric qualities of Past-week and Usual-week Physical Activity Questionnaires (PAQs). Data sources... Show moreThe aim was to critically appraise the methodological quality of studies and determine the psychometric qualities of Past-week and Usual-week Physical Activity Questionnaires (PAQs). Data sources were obtained from Pubmed and Embase. The eligibility criteria for selecting studies included: 1) at least one psychometric property of PAQs was examined in adults; 2) the PAQs either had a recall period of usual 7-days (Usual-week PAQs) within the past 12 months or during the past 7-days (Past-week PAQs); and 3) PAQs were self-administered. Study quality was evaluated using the COSMIN taxonomy and the overall psychometric qualities evaluated using pre-established psychometric criteria. Overall, 45 studies were reviewed to assess the psychometric properties of 21 PAQs with the methodological quality of most studies showing good to excellent ratings. When the relationship between PAQs and other instruments (i.e., convergent validity) were compared between recall methods, Past-week PAQs appeared to have stronger correlations than Usual-week PAQs. For the overall psychometric quality, the Incidental and Planned Exercise Questionnaire for the Usual-week (IPEQ-WA) and for the Past-week (IPEQ-W) had the greatest number of positive ratings. For all included PAQs, very few psychometric properties were assessed with poor ratings for the majority of the overall qualities of psychometric properties indicating the limitation of current PAQs. More research that covers a greater spectrum of psychometric properties is required to gain a better understanding of the qualities of current PAQs. Show less
Vestibular schwannomas are benign tumours originating from the vestibulocochlear nerve. Patients with vestibular schwannoma experience diminished Quality of Life from the diagnosis. A disease... Show moreVestibular schwannomas are benign tumours originating from the vestibulocochlear nerve. Patients with vestibular schwannoma experience diminished Quality of Life from the diagnosis. A disease-specific questionnaire (PANQOL) was validated for the Dutch population. Quality of Life is for 23% determined by emotional intelligence. In addition by balance disorders, cranial nerve deficits and education. The treatment choice (wait-and-scan, radiation therapy, surgery) is under discussion. Patients with small tumors (<10mm) have a better Quality of Life in a wait-and-scan policy. For (medium)large tumors no significant differences (up to 10 years after treatment) were observed. Physicians should give patients tools for the treatment choice. Vestibularis schwannomen zijn goedaardige tumoren uitgaande van de nervus vestibulocochlearis. Patiënten met een vestibularis schwannoom hebben een verlaagde Kwaliteit van Leven vanaf de diagnose. Een ziekte-specifieke vragenlijst (PANQOL) werd gevalideerd voor de Nederlandse populatie. Kwaliteit van Leven wordt voor 23% bepaald door emotionele intelligentie. Daarnaast spelen evenwichtsstoornissen, hersenzenuwuitval en opleidingsniveau een rol. De behandelkeuze (wait-and-scan, radiotherapie, chirurgie) blijft onderwerp van discussie. Patiënten met een kleine tumor (< 10 mm) hebben een betere Kwaliteit van Leven in een wait-and-scan traject. Voor (middel)grote tumoren werden tot 10 jaar na behandeling geen significante verschillen gezien. Artsen moeten patiënten handvatten bieden voor de behandelkeuze. Show less
National large-scale assessments have demonstrated a decrease in Dutch primary school students' performance on multidigit multiplication and division problems (e.g., 56x23 and 544:34) in the... Show moreNational large-scale assessments have demonstrated a decrease in Dutch primary school students' performance on multidigit multiplication and division problems (e.g., 56x23 and 544:34) in the past two decades. This performance decrease appears to be related to changes in students' use of mathematical strategies: the use of relatively accurate strategies for which calculations are written down has decreased, while the use of inaccurate mental strategies has increased. To gain more insight into these developments and how to possibly turn them around, factors that affect students' mathematical strategy use and performance were investigated. New applications of latent variable models to national large-scale assessment data were used to relate teachers' reports of their mathematics teaching to students' problem solving. Follow-up experiments were conducted at primary schools for a more controlled investigation of students' strategy choices and of how to influence those choices (and thereby, performance) favorably. It was found that teachers mainly influence students' choices between strategies with written work, and that they have less influence on choices for the inaccurate mental strategies (made more frequently by boys and weaker students). Extra instruction targeted at the latter was found to increase weaker students' choices for writing down calculations, and this improved students' performance. Show less
Research into the relation between psychopathology and etiological factors has not yet resulted in clear findings. One of the probable causes is that most researchers use the categorical DSM-IV... Show moreResearch into the relation between psychopathology and etiological factors has not yet resulted in clear findings. One of the probable causes is that most researchers use the categorical DSM-IV Classification of mental disorders. A dimensional system has several advantages compared to categorical systems: comorbidity, lack of diagnostic agreement and arbitrary nature of used boundaries are no longer a problem. Our aim was to develop a model with dimensions that can adequately describe patients with mood- and anxiety disorders. This project used data collected through Routine Outcome Monitoring (ROM), a monitoring system for patient care. First, we validated a Dutch adaptation of an instrument based on the tripartite model. Next, we formulated an extension of this model with 5 dimensions. Consequently we presented a second model with 6 dimensions: feelings of worthlessness, fatigue, somatic arousal, anxious apprehension, phobic fear and tension. We used several analysis techniques to create a valid and reliable dimensional model. Each individual factor and the total of factors can be regarded as unidimensional measurement scales. This model can describe the clinical state of patients more specifically than the tripartite model, and can be used in subsequent research into etiological factors of psychopathology (e.g. endophenotype, genotype, trauma's, personality). Show less
