Background: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs... Show moreBackground: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs. Objective: This study explored clinicians' perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework. Methods: We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions. Results: Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity. Conclusions: The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. Show less
Background: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs... Show moreBackground: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs.Objective: This study explored clinicians’ perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework.Methods: We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions.Results: Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity.Conclusions: The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. Show less
Background: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs... Show moreBackground: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs.Objective: This study explored clinicians’ perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework.Methods: We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions.Results: Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity.Conclusions: The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. Show less
Background: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs... Show moreBackground: Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs.Objective: This study explored clinicians’ perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework.Methods: We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions.Results: Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity.Conclusions: The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. Show less
Jimenez, G.; Matchar, D.; Koh, G.C.H.; Tyagi, S.; Kleij, R.M.J.J. van der; Chavannes, N.H.; Car, J. 2021
Background: The four primary care (PC) core functions (the '4Cs', ie, first contact, comprehensiveness, coordination and continuity) are essential for good quality primary healthcare and their... Show moreBackground: The four primary care (PC) core functions (the '4Cs', ie, first contact, comprehensiveness, coordination and continuity) are essential for good quality primary healthcare and their achievement leads to lower costs, less inequality and better population health. However, their broad definitions have led to variations in their assessment, in the innovations implemented to improve these functions and ultimately in their performance. Objectives: To update and operationalise the 4Cs' definitions by using a literature review and analysis of enhancement strategies, and to identify innovations that may lead to their enhancement. Methods: Narrative, descriptive analysis of the 4Cs definitions, coming from PC international reports and organisations, to identify measurable features for each of these functions. Additionally, we performed an electronic search and analysis of enhancement strategies to improve these four Cs, to explore how the 4Cs inter-relate. Results: Specific operational elements for first contact include modality of contact, and conditions for which PC should be approached; for comprehensiveness, scope of services and spectrum of population needs; for coordination, links between PC and higher levels of care and social/community-based services, and workforce managing transitions and for continuity, type, level and context of continuity. Several innovations like enrolment, digital health technologies and new or enhanced PC provider's roles, simultaneously influenced two or more of the 4Cs. Conclusion: Providing clear, well-defined operational elements for these 4Cs to measure their achievement and improve the way they function, and identifying the complex network of interactions among them, should contribute to the field in a way that supports efforts at practice innovation to optimise the processes and outcomes in PC. Show less
Jimenez, G.; Matchar, D.; Koh, C.H.G.; Kleij, R. van der; Chavannes, N.H.; Car, J. 2021
Background: Several countries around the world have implemented multicomponent interventions to enhance primary care, as a way of strengthening their health systems to cope with an aging... Show moreBackground: Several countries around the world have implemented multicomponent interventions to enhance primary care, as a way of strengthening their health systems to cope with an aging chronically ill population and rising costs. Some of these efforts have included technology-based enhancements as one of the features to support the overall intervention, but their details and impacts have not been explored.Objective: This study aimed to identify the role of digital/health technologies within wider multifeature interventions that are aimed at enhancing primary care, and to describe their aims and stakeholders, types of technologies used, and potential impacts.Methods: A systematic review was performed following Cochrane guidelines. An electronic search, conducted on May 30, 2019, was supplemented with manual and grey literature searches in December 2019, to identify multicomponent interventions that included at least one technology-based enhancement. After title/abstract and full text screening, selected articles were assessed for quality based on their study design. A descriptive narrative synthesis was used for analysis and presentation of the results.Results: Of 37 articles, 14 (38%) described the inclusion of a technology-based innovation as part of their multicomponent interventions to enhance primary care. The most commonly identified technologies were the use of electronic health records, data monitoring technologies, and online portals with messaging platforms. The most common aim of these technologies was to improve continuity of care and comprehensiveness, which resulted in increased patient satisfaction, increased primary care visits compared to specialist visits, and the provision of more health prevention education and improved prescribing practices. Technologies seem also to increase costs and utilization for some parameters, such as increased consultation costs and increased number of drugs prescribed.Conclusions: Technologies and digital health have not played a major role within comprehensive innovation efforts aimed at enhancing primary care, reflecting that these technologies have not yet reached maturity or wider acceptance as a means for improving primary care. Stronger policy and financial support, and advocacy of key stakeholders are needed to encourage the introduction of efficient technological innovations, which are backed by evidence-based research, so that digital technologies can fulfill the promise of supporting strong sustainable primary care. Show less
Jimenez, G.; Matchar, D.; Koh, C.H.G.; Kleij, R. van der; Chavannes, N.H.; Car, J. 2021
Background: Despite digital health providing opportunities to enhance the quality, efficiency and safety of primary healthcare, the adoption of digital tools and technologies has been slow, partly... Show moreBackground: Despite digital health providing opportunities to enhance the quality, efficiency and safety of primary healthcare, the adoption of digital tools and technologies has been slow, partly because of poor digital health literacy. For primary healthcare systems to take full advantage of these technologies, a capable, digitally literate workforce is necessary. Still, the essential digital health competencies (DHCs) for primary healthcare have not been explored. This review aims to examine the broad literature on DHCs as it applies to Primary Care (PC) settings.Methods: We performed a scoping review on all types of research linking DHCs to PC. We searched all major databases including Medline, Embase, CINAHL, and Cochrane Library in November 2019. Concurrently, a thorough grey literature search was performed through OpenGrey, ResearchGate, Google Scholar, and key government and relevant professional associations' websites. Screening and selection of studies was performed in pairs, and data was analysed and presented using a narrative, descriptive approach. Thematic analysis was performed to identify key DHC domains.Results: A total of 28 articles were included, most of them (54 %) published before 2005. These articles were primarily aimed at PC physicians or general practitioners, and focused on improving knowledge about information technologies and medical informatics, basic computer and information literacy, and optimal use of electronic medical records. We identified 17 DHC domains, and important knowledge gaps related to digital health education and curriculum integration, the need for evidence of the impact of services, and the importance of wider support for digital health.Conclusions: Literature explicitly linking DHCs to PC was mostly published over a decade ago. There is a need for an updated and current set of DHCs for PC professionals to more consistently reap the benefits of digital technologies. This review identified key DHC domains and statements that may be used to guide on the development of a set of DHC for PC, and critical knowledge gaps and needs to be considered. Such a DHC set may be used for curricula development and for ensuring that the essential DHC for PC are met at a clinical or organizational level, and eventually improve health outcomes. Show less
Jimenez, G.; Tyagi, S.; Osman, T.; Spinazze, P.; Kleij, R. van der; Chavannes, N.H.; Car, J. 2020
Background: Digital medical interview assistant (DMIA) systems, also known as computer-assisted history taking (CAHT) systems, have the potential to improve the quality of care and the medical... Show moreBackground: Digital medical interview assistant (DMIA) systems, also known as computer-assisted history taking (CAHT) systems, have the potential to improve the quality of care and the medical consultation by exploring more patient-related aspects without time constraints and, therefore, acquiring more and better-quality information prior to the face-to-face consultation. The consultation in primary care is the broadest in terms of the amount of topics to be covered and, at the same time, the shortest in terms of time spent with the patient.Objective: Our aim is to explore how DMIA systems may be used specifically in the context of primary care, to improve the consultations for diabetes and depression, as exemplars of chronic conditions.Methods: A narrative review was conducted focusing on (1) the characteristics of the primary care consultation in general, and for diabetes and depression specifically, and (2) the impact of DMIA and CAHT systems on the medical consultation. Through thematic analysis, we identified the characteristics of the primary care consultation that a DMIA system would be able to improve. Based on the identified primary care consultation tasks and the potential benefits of DMIA systems, we developed a sample questionnaire for diabetes and depression to illustrate how such a system may work.Results: A DMIA system, prior to the first consultation, could aid in the essential primary care tasks of case finding and screening, diagnosing, and, if needed, timely referral to specialists or urgent care. Similarly, for follow-up consultations, this system could aid with the control and monitoring of these conditions, help check for additional health issues, and update the primary care provider about visits to other providers or further testing. Successfully implementing a DMIA system for these tasks would improve the quality of the data obtained, which means earlier diagnosis and treatment. Such a system would improve the use of face-to-face consultation time, thereby streamlining the interaction and allowing the focus to be the patient's needs, which ultimately would lead to better health outcomes and patient satisfaction. However, for such a system to be successfully incorporated, there are important considerations to be taken into account, such as the language to be used and the challenges for implementing eHealth innovations in primary care and health care in general.Conclusions: Given the benefits explored here, we foresee that DMIA systems could have an important impact in the primary care consultation for diabetes and depression and, potentially, for other chronic conditions. Earlier case finding and a more accurate diagnosis, due to more and better-quality data, paired with improved monitoring of disease progress should improve the quality of care and keep the management of chronic conditions at the primary care level. A somewhat simple, easily scalable technology could go a long way to improve the health of the millions of people affected with chronic conditions, especially if working in conjunction with already-established health technologies such as electronic medical records and clinical decision support systems. Show less
University student years are a particularly influential period, during which time students may adopt negative behaviours that set the precedent for health outcomes in later years. This study... Show moreUniversity student years are a particularly influential period, during which time students may adopt negative behaviours that set the precedent for health outcomes in later years. This study utilised a newly digitised health survey implemented during health screening at a university in Singapore to capture student health data. The aim of this study was to analyze the health status of this Asian university student population. A total of 535 students were included in the cohort, and a cross-sectional analysis of student health was completed. Areas of concern were highlighted in student's body weight, visual acuity, and binge drinking. A large proportion of students were underweight (body mass index (BMI) < 18.5)-18.9% of females and 10.6% of males-and 7% of males were obese (BMI > 30). Although the overall prevalence of alcohol use was low in this study population, 9% of females and 8% of males who consumed alcohol had hazardous drinking habits. Around 16% of these students (male and female combined) typically drank 3-4 alcoholic drinks each occasion. The prevalence of mental health conditions reported was very low (<1%). This study evaluated the results from a digitised health survey implemented into student health screening to capture a comprehensive health history. The results reveal potential student health concerns and offer the opportunity to provide more targeted student health campaigns to address these. Show less
Kleij, R.M.J.J. van der; Kasteleyn, M.J.; Meijer, E.; Bonten, T.N.; Houwink, E.J.F.; Teichert, M.; ... ; Chavannes, N.H. 2019
Primary care is challenged to provide high quality, accessible and affordable care for an increasingly ageing, complex, and multimorbid population. To counter these challenges, primary care... Show morePrimary care is challenged to provide high quality, accessible and affordable care for an increasingly ageing, complex, and multimorbid population. To counter these challenges, primary care professionals need to take up new and innovative practices, including eHealth. eHealth applications hold the promise to overcome some difficulties encountered in the care of people with complex medical and social needs in primary care. However, many unanswered questions regarding (cost) effectiveness, integration with healthcare, and acceptability to patients, caregivers, and professionals remain to be elucidated. What conditions need to be met? What challenges need to be overcome? What downsides must be dealt with? This first paper in a series on eHealth in primary care introduces basic concepts and examines opportunities for the uptake of eHealth in primary care. We illustrate that although the potential of eHealth in primary care is high, several conditions need to be met to ensure that safe and high-quality eHealth is developed for and implemented in primary care. eHealth research needs to be optimized; ensuring evidence-based eHealth is available. Blended care, i.e. combining face-to-face care with remote options, personalized to the individual patient should be considered. Stakeholders need to be involved in the development and implementation of eHealth via co-creation processes, and design should be mindful of vulnerable groups and eHealth illiteracy. Furthermore, a global perspective on eHealth should be adopted, and eHealth ethics, patients’ safety and privacy considered. Show less
Kleij, R.M.J.J. van der; Kasteleyn, M.J.; Meijer, E.; Bonten, T.N.; Houwink, I.J.F.; Teichert, M.; ... ; Chavannes, N.H. 2019
