IntroductionThe pressure on general practitioners (GPs) is rising due to the increasing demand for care and a decreasing availability of GPs. eHealth is seen as one of the solutions to enhance... Show moreIntroductionThe pressure on general practitioners (GPs) is rising due to the increasing demand for care and a decreasing availability of GPs. eHealth is seen as one of the solutions to enhance accessibility and reduce workload. A platform supporting the organization and communication in general practice has been developed offering services, such as econsultations. This study aims to evaluate healthcare usage and costs of patients using this platform by comparing these outcomes (1) before and after implementation and (2) an intervention with a matched control group.Material and methodsThis study is a retrospective observational cohort study. To evaluate the longitudinal impact of the implementation on healthcare usage, mixed model Poisson analyses were used with time as a factor term for the within-subject analysis and exposure to the platform as a factor term and an interaction term (i.e., exposure X 6-months) in the between-subject analysis. Cost analyses were done with mixed model analyses of variance over time.ResultsThe total number of GP consultations significantly increased after compared to before implementation (i.e., Rate = 1.52; p < 0.001). The number of GP consultations was higher in the intervention compared to the control group (respectively, Rate = 1.23; p = 0.035). Healthcare costs increased for GP consultations after compared to before implementation (€13,57; p < 0.001). The costs for GP consults were significantly higher in the intervention compared to the control group (€7,06; p 0.018).ConclusionThis study showed a rise in GP consultations and costs when implementing a digital platform. This increase was presumably and partly caused by circumstances in one of the two included practices. Moreover, creating new options for contacting and communicating with the GP can enhance care accessibility and thereby driving an increase in consultations. This digital platform is a promising working method in general practice to facilitate patients and provide GPs with more flexibility Show less
Deursen, L. van; Aardoom, J.J.; Alblas, E.E.; Struijs, J.N.; Chavannes, N.H.; Vaart, R. van der 2023
PurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC... Show morePurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC care delivery.MethodsThree semi-structured focus groups were held with sixteen CRC survivors. To initiate the discussion, an online registration form and two vignettes were used. The data was analyzed using the framework method.ResultsBased on survivors' experiences, five themes were identified as opportunities for improving CRC care delivery. These themes include better recognition of complaints and faster referrals, more information as part of the care delivery, more guidance and monitoring of health outcomes, more collaboration between practitioners, and more attention for partners and relatives. In addition, survivors expressed opportunities for using e-health to facilitate information provision, improve communication, and monitor survivors' health conditions.ConclusionSeveral suggestions for improvement of CRC care delivery were identified. These often translated into possibilities for e-health to support or improve CRC care delivery. The ideas of survivors align with the vast array of existing e-health resources that can be utilized to enhance CRC care delivery. Therefore, the next step involves addressing the implementation gap between the needs of stakeholders, such as CRC survivors and healthcare providers, and the e-health tools currently available in clinical practice. Show less
Deursen, L. van; Aardoom, J.J.; Alblas, E.E.; Struijs, J.N.; Chavannes, N.H.; Vaart, R. van der 2023
PurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC... Show morePurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC care delivery.MethodsThree semi-structured focus groups were held with sixteen CRC survivors. To initiate the discussion, an online registration form and two vignettes were used. The data was analyzed using the framework method.ResultsBased on survivors’ experiences, five themes were identified as opportunities for improving CRC care delivery. These themes include better recognition of complaints and faster referrals, more information as part of the care delivery, more guidance and monitoring of health outcomes, more collaboration between practitioners, and more attention for partners and relatives. In addition, survivors expressed opportunities for using e-health to facilitate information provision, improve communication, and monitor survivors’ health conditions.ConclusionSeveral suggestions for improvement of CRC care delivery were identified. These often translated into possibilities for e-health to support or improve CRC care delivery. The ideas of survivors align with the vast array of existing e-health resources that can be utilized to enhance CRC care delivery. Therefore, the next step involves addressing the implementation gap between the needs of stakeholders, such as CRC survivors and healthcare providers, and the e-health tools currently available in clinical practice. Show less
Deursen, L. van; Aardoom, J.J.; Alblas, E.E.; Struijs, J.N.; Chavannes, N.H.; Vaart, R. van der 2023
PurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC... Show morePurposeThe purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC care delivery.MethodsThree semi-structured focus groups were held with sixteen CRC survivors. To initiate the discussion, an online registration form and two vignettes were used. The data was analyzed using the framework method.ResultsBased on survivors’ experiences, five themes were identified as opportunities for improving CRC care delivery. These themes include better recognition of complaints and faster referrals, more information as part of the care delivery, more guidance and monitoring of health outcomes, more collaboration between practitioners, and more attention for partners and relatives. In addition, survivors expressed opportunities for using e-health to facilitate information provision, improve communication, and monitor survivors’ health conditions.ConclusionSeveral suggestions for improvement of CRC care delivery were identified. These often translated into possibilities for e-health to support or improve CRC care delivery. The ideas of survivors align with the vast array of existing e-health resources that can be utilized to enhance CRC care delivery. Therefore, the next step involves addressing the implementation gap between the needs of stakeholders, such as CRC survivors and healthcare providers, and the e-health tools currently available in clinical practice. Show less
Deursen, L. van; Vaart, R. van der; Alblas, E.E.; Struijs, J.N.; Chavannes, N.H.; Aardoom, J.J. 2023
Purpose: This study aims to identify improvement opportunities within the colorectal cancer (CRC) care pathway using e-health and to examine how these opportunities would contribute to the... Show morePurpose: This study aims to identify improvement opportunities within the colorectal cancer (CRC) care pathway using e-health and to examine how these opportunities would contribute to the Quadruple Aim. Methods: In total, 17 semi-structured interviews were held (i.e., nine healthcare providers and eight managers involved in Dutch CRC care). The Quadruple Aim was used as a conceptual framework to gather and systematically structure the data. A directed content analysis approach was employed to code and analyze the data. Results: Interviewees believe the available e-health technology could be better exploited in CRC care. Twelve different improvement opportunities were identified to enhance the CRC care pathway. Some opportunities could be applied in one specific phase of the pathway (e.g., digital applications to support patients in the prehabilitation program to enhance the program's effects). Others could be deployed in multiple phases or extended outside the hospital care setting (e.g., digital consultation hours to increase care accessibility). Some opportunities could be easily implemented (e.g., digital communication to facilitate treatment preparation), whereas others require structural, systemic changes (e.g., increasing efficiency in patient data exchanges among healthcare professionals). Conclusion: This study provides insights into how e-health could add value to CRC care and contribute to the Quadruple Aim. It shows that e-health has the potential to contribute to the challenges in cancer care. To take the next step forward, the perspectives of other stakeholders must be examined, the identified opportunities should be prioritized, and the requirements for successful implementation should be mapped out. Show less
Deursen, L. van; Vaart, R. van der; Alblas, E.E.; Struijs, J.N.; Chavannes, N.H.; Aardoom, J.J. 2023
PurposeThis study aims to identify improvement opportunities within the colorectal cancer (CRC) care pathway using e-health and to examine how these opportunities would contribute to the Quadruple... Show morePurposeThis study aims to identify improvement opportunities within the colorectal cancer (CRC) care pathway using e-health and to examine how these opportunities would contribute to the Quadruple Aim.MethodsIn total, 17 semi-structured interviews were held (i.e., nine healthcare providers and eight managers involved in Dutch CRC care). The Quadruple Aim was used as a conceptual framework to gather and systematically structure the data. A directed content analysis approach was employed to code and analyze the data.ResultsInterviewees believe the available e-health technology could be better exploited in CRC care. Twelve different improvement opportunities were identified to enhance the CRC care pathway. Some opportunities could be applied in one specific phase of the pathway (e.g., digital applications to support patients in the prehabilitation program to enhance the program’s effects). Others could be deployed in multiple phases or extended outside the hospital care setting (e.g., digital consultation hours to increase care accessibility). Some opportunities could be easily implemented (e.g., digital communication to facilitate treatment preparation), whereas others require structural, systemic changes (e.g., increasing efficiency in patient data exchanges among healthcare professionals).ConclusionThis study provides insights into how e-health could add value to CRC care and contribute to the Quadruple Aim. It shows that e-health has the potential to contribute to the challenges in cancer care. To take the next step forward, the perspectives of other stakeholders must be examined, the identified opportunities should be prioritized, and the requirements for successful implementation should be mapped out. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of €100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews. Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of €100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method. Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications. Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of €100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health.Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews.Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of €100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method.Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications.Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of euro100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health.Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews.Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of euro100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method.Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications.Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of €100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health.Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews.Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of €100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method.Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications.Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of euro100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health.Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews.Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of euro100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method.Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications.Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Willemsen, R.F.; Meijer, E.; Berg, L.N. van den; Burg, L. van der; Chavannes, N.H.; Aardoom, J.J. 2023
Background: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for... Show moreBackground: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of €100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health.Objective: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews.Methods: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of €100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method.Results: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications.Conclusions: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health. Show less
Background: The COVID Radar app was developed as a population-based surveillance instrument to identify at-risk populations and regions in response to the COVID-19 pandemic. The app boasts of >8... Show moreBackground: The COVID Radar app was developed as a population-based surveillance instrument to identify at-risk populations and regions in response to the COVID-19 pandemic. The app boasts of >8.5 million completed questionnaires, with >280,000 unique users. Although the COVID Radar app is a valid tool for population-level surveillance, high user engagement is critical to the success of the COVID Radar app in maintaining validity. Objective: This study aimed to identify optimization targets of the COVID Radar app to improve its acceptability, adherence, and inclusiveness. Methods: The main component of the COVID Radar app is a self-report questionnaire that assesses COVID-19 symptoms and social distancing behaviors. A total of 3 qualitative substudies were conducted. First, 3 semistructured focus group interviews with end users (N=14) of the app were conducted to gather information on user experiences. The output was transcribed and thematically coded using the framework method. Second, a similar qualitative thematic analysis was conducted on 1080 end-user emails. Third, usability testing was conducted in one-on-one sessions with 4 individuals with low literacy levels. Results: All 3 substudies identified optimization targets in terms of design and content. The results of substudy 1 showed that the participants generally evaluated the app positively. They reported the app to be user-friendly and were satisfied with its design and functionalities. Participants' main motivation to use the app was to contribute to science. Participants suggested adding motivational tools to stimulate user engagement. A larger national publicity campaign for the app was considered potentially helpful for increasing the user population. In-app updates informing users about the project and its outputs motivated users to continue using the app. Feedback on the self-report questionnaire, stemming from substudies 1 and 2, mostly concerned the content and phrasing of the questions. Furthermore, the section of the app allowing users to compare their symptoms and behaviors to those of their peers was found to be suboptimal because of difficulties in interpreting the figures presented in the app. Finally, the output of substudy 3 resulted in recommendations primarily related to simplification of the text to render it more accessible and comprehensible for individuals with low literacy levels Conclusions: The convenience of app use, enabling personal adjustments of the app experience, and considering motivational factors for continued app use (ie, altruism and collectivism) were found to be crucial to procuring and maintaining a population of active users of the COVID Radar app. Further, there seems to be a need to increase the accessibility of public health tools for individuals with low literacy levels. These results can be used to improve the this and future public health apps and improve the representativeness of their user populations and user engagement, ultimately increasing the validity of the tools. Show less
Background: The COVID Radar app was developed as a population-based surveillance instrument to identify at-risk populations and regions in response to the COVID-19 pandemic. The app boasts of >8... Show moreBackground: The COVID Radar app was developed as a population-based surveillance instrument to identify at-risk populations and regions in response to the COVID-19 pandemic. The app boasts of >8.5 million completed questionnaires, with >280,000 unique users. Although the COVID Radar app is a valid tool for population-level surveillance, high user engagement is critical to the success of the COVID Radar app in maintaining validity.Objective: This study aimed to identify optimization targets of the COVID Radar app to improve its acceptability, adherence, and inclusiveness.Methods: The main component of the COVID Radar app is a self-report questionnaire that assesses COVID-19 symptoms and social distancing behaviors. A total of 3 qualitative substudies were conducted. First, 3 semistructured focus group interviews with end users (N=14) of the app were conducted to gather information on user experiences. The output was transcribed and thematically coded using the framework method. Second, a similar qualitative thematic analysis was conducted on 1080 end-user emails. Third, usability testing was conducted in one-on-one sessions with 4 individuals with low literacy levels.Results: All 3 substudies identified optimization targets in terms of design and content. The results of substudy 1 showed that the participants generally evaluated the app positively. They reported the app to be user-friendly and were satisfied with its design and functionalities. Participants’ main motivation to use the app was to contribute to science. Participants suggested adding motivational tools to stimulate user engagement. A larger national publicity campaign for the app was considered potentially helpful for increasing the user population. In-app updates informing users about the project and its outputs motivated users to continue using the app. Feedback on the self-report questionnaire, stemming from substudies 1 and 2, mostly concerned the content and phrasing of the questions. Furthermore, the section of the app allowing users to compare their symptoms and behaviors to those of their peers was found to be suboptimal because of difficulties in interpreting the figures presented in the app. Finally, the output of substudy 3 resulted in recommendations primarily related to simplification of the text to render it more accessible and comprehensible for individuals with low literacy levels.Conclusions: The convenience of app use, enabling personal adjustments of the app experience, and considering motivational factors for continued app use (ie, altruism and collectivism) were found to be crucial to procuring and maintaining a population of active users of the COVID Radar app. Further, there seems to be a need to increase the accessibility of public health tools for individuals with low literacy levels. These results can be used to improve the this and future public health apps and improve the representativeness of their user populations and user engagement, ultimately increasing the validity of the tools. Show less
Willemsen, R.F.; Aardoom, J.J.; Chavannes, N.H.; Versluis, A. 2022
Due to the COVID-19 pandemic, a sudden shift was warranted from face-to-face to digital interviewing. This shift is in line with the existing trend of digitalization. However, limited literature is... Show moreDue to the COVID-19 pandemic, a sudden shift was warranted from face-to-face to digital interviewing. This shift is in line with the existing trend of digitalization. However, limited literature is available on how to conduct focus group interviews online successfully. This research note provides practical guidelines, tips, and considerations for setting up and conducting online synchronous focus groups for eight relevant factors: preparation, the number of participants, the duration, a break, the usability of the online platform, the interaction between participants and researchers, support and roles of the research team, and privacy considerations. These guidelines were formulated based on the available literature and our own positive hands-on experiences. We consider online focus groups to be an excellent option when taking into account the considerations related to the eight factors. Show less
Schnoor, K.; Versluis, A.; Bakema, R.; Luenen, S. van; Kooij, M.J.; Heuvel, J.M. van den; ... ; Aardoom, J.J. 2022
AbstractBackground:Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of... Show moreAbstractBackground:Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a common problem. The eHealth intervention SARA (Service Apothecary Respiratory Advice) aims to improve participants’ correct use of inhalation medication by providing information and as-needed tailored follow-up support by a pharmacist.Objective:The primary aim of this study was to investigate the effect of SARA on exacerbation rates in participants with asthma and COPD. Secondary aims were to investigate its effects in terms of adherence to maintenance medication and antimycotic treatment.Methods:In this nonrandomized pre-post study, medication dispensing data from 382 Dutch community pharmacies were included. Exacerbation rates were assessed with dispensed short-course oral corticosteroids. Medication adherence between new and chronic users was assessed by calculating the proportion of days covered from dispensed inhalation maintenance medication. Antimycotic treatment was investigated from dispensed oral antimycotics in participants who were also dispensed inhaled corticosteroids (ICS). Outcomes were assessed 1 year before and 1 year after implementation of SARA and were compared between SARA participants and control participants. More specifically, for exacerbation rates and medication adherence, a difference score was calculated (ie, 1 year after SARA minus 1 year before SARA) and was subsequently compared between the study groups with independent-samples t tests. For antimycotics, the relative number of participants who were dispensed antimycotics was calculated and subsequently analyzed with a mixed-effects logistic regression.Results:The study population comprised 9452 participants, of whom 2400 (25.39%) were SARA participants. The mean age of the population was 60.8 (15.0) years, and approximately two-thirds (n=5677, 60.06%) were female. The results showed an increase in mean exacerbation rates over time for both study groups (SARA: 0.05; control: 0.15). However, this increase in exacerbation rates was significantly lower for SARA participants (t9450=3.10, 95% CI 0.04-0.16; P=.002; Cohen d=0.06). Chronic users of inhalation medication in both study groups showed an increase in mean medication adherence over time (SARA: 6.73; control: 4.48); however, this increase was significantly higher for SARA participants (t5886=–2.74, 95% CI –3.86 to –0.84; P=.01; Cohen d=–0.07). Among new users of inhalation medication, results showed no significant difference in medication adherence between SARA and control participants in the year after implementation of SARA (t1434=–1.85, 95% CI –5.60 to 0.16; P=.06; Cohen d=–0.10). Among ICS users, no significant differences between the study groups were found over time in terms of the proportion of participants who were dispensed antimycotics (t5654=0.29, 95% CI –0.40 to 0.54; P=.76; Cohen d=0).Conclusions:This study provides preliminary evidence that the SARA eHealth intervention might have the potential to decrease exacerbation rates and improve medication adherence among patients with asthma and COPD. Show less
Schnoor, K.; Versluis, A.; Bakema, R.; Luenen, S. van; Kooij, M.J.; Heuvel, J.M. van den; ... ; Aardoom, J.J. 2022
Background: Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a... Show moreBackground: Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a common problem. The eHealth intervention SARA (Service Apothecary Respiratory Advice) aims to improve participants' correct use of inhalation medication by providing information and as-needed tailored follow-up support by a pharmacist. Objective: The primary aim of this study was to investigate the effect of SARA on exacerbation rates in participants with asthma and COPD. Secondary aims were to investigate its effects in terms of adherence to maintenance medication and antimycotic treatment. Methods: In this nonrandomized pre-post study, medication dispensing data from 382 Dutch community pharmacies were included. Exacerbation rates were assessed with dispensed short-course oral corticosteroids. Medication adherence between new and chronic users was assessed by calculating the proportion of days covered from dispensed inhalation maintenance medication. Antimycotic treatment was investigated from dispensed oral antimycotics in participants who were also dispensed inhaled corticosteroids (ICS). Outcomes were assessed 1 year before and 1 year after implementation of SARA and were compared between SARA participants and control participants. More specifically, for exacerbation rates and medication adherence, a difference score was calculated (ie, 1 year after SARA minus 1 year before SARA) and was subsequently compared between the study groups with independent-samples t tests. For antimycotics, the relative number of participants who were dispensed antimycotics was calculated and subsequently analyzed with a mixed-effects logistic regression. Results: The study population comprised 9452 participants, of whom 2400 (25.39%) were SARA participants. The mean age of the population was 60.8 (15.0) years, and approximately two-thirds (n=5677, 60.06%) were female. The results showed an increase in mean exacerbation rates over time for both study groups (SARA: 0.05; control: 0.15). However, this increase inexacerbation rates was significantly lower for SARA participants (t9450=3.10, 95% CI 0.04-0.16; P=.002; Cohen d=0.06). Chronic users of inhalation medication in both study groups showed an increase in mean medication adherence over time (SARA: 6.73; control: 4.48); however, this increase was significantly higher for SARA participants (t5886=-2.74, 95% CI -3.86 to -0.84; P=.01; Cohen d=-0.07). Among new users of inhalation medication, results showed no significant difference in medication adherence between SARA and control participants in the year after implementation of SARA (t1434=-1.85, 95% CI -5.60 to 0.16; P=.06; Cohen d=-0.10). Among ICS users, no significant differences between the study groups were found over time in terms of the proportion of participants who were dispensed antimycotics (t5654=0.29, 95% CI -0.40 to 0.54; P=.76; Cohen d=0). Conclusions: This study provides preliminary evidence that the SARA eHealth intervention might have the potential to decrease exacerbation rates and improve medication adherence among patients with asthma and COPD. Show less
Schnoor, K.; Versluis, A.; Bakema, R.; Luenen, S. van; Kooij, M.J.; Heuvel, J.M. van den; ... ; Aardoom, J.J. 2022
Background: Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a... Show moreBackground: Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a common problem. The eHealth intervention SARA (Service Apothecary Respiratory Advice) aims to improve participants’ correct use of inhalation medication by providing information and as-needed tailored follow-up support by a pharmacist.Objective: The primary aim of this study was to investigate the effect of SARA on exacerbation rates in participants with asthma and COPD. Secondary aims were to investigate its effects in terms of adherence to maintenance medication and antimycotic treatment.Methods: In this nonrandomized pre-post study, medication dispensing data from 382 Dutch community pharmacies were included. Exacerbation rates were assessed with dispensed short-course oral corticosteroids. Medication adherence between new and chronic users was assessed by calculating the proportion of days covered from dispensed inhalation maintenance medication. Antimycotic treatment was investigated from dispensed oral antimycotics in participants who were also dispensed inhaled corticosteroids (ICS). Outcomes were assessed 1 year before and 1 year after implementation of SARA and were compared between SARA participants and control participants. More specifically, for exacerbation rates and medication adherence, a difference score was calculated (ie, 1 year after SARA minus 1 year before SARA) and was subsequently compared between the study groups with independent-samples t tests. For antimycotics, the relative number of participants who were dispensed antimycotics was calculated and subsequently analyzed with a mixed-effects logistic regression.Results: The study population comprised 9452 participants, of whom 2400 (25.39%) were SARA participants. The mean age of the population was 60.8 (15.0) years, and approximately two-thirds (n=5677, 60.06%) were female. The results showed an increase in mean exacerbation rates over time for both study groups (SARA: 0.05; control: 0.15). However, this increase in exacerbation rates was significantly lower for SARA participants (t9450=3.10, 95% CI 0.04-0.16; P=.002; Cohen d=0.06). Chronic users of inhalation medication in both study groups showed an increase in mean medication adherence over time (SARA: 6.73; control: 4.48); however, this increase was significantly higher for SARA participants (t5886=–2.74, 95% CI –3.86 to –0.84; P=.01; Cohen d=–0.07). Among new users of inhalation medication, results showed no significant difference in medication adherence between SARA and control participants in the year after implementation of SARA (t1434=–1.85, 95% CI –5.60 to 0.16; P=.06; Cohen d=–0.10). Among ICS users, no significant differences between the study groups were found over time in terms of the proportion of participants who were dispensed antimycotics (t5654=0.29, 95% CI –0.40 to 0.54; P=.76; Cohen d=0).Conclusions: This study provides preliminary evidence that the SARA eHealth intervention might have the potential to decrease exacerbation rates and improve medication adherence among patients with asthma and COPD. Show less
While the opportunities of ML and AI in healthcare are promising, the growth of complex data-driven prediction models requires careful quality and applicability assessment before they are applied... Show moreWhile the opportunities of ML and AI in healthcare are promising, the growth of complex data-driven prediction models requires careful quality and applicability assessment before they are applied and disseminated in daily practice. This scoping review aimed to identify actionable guidance for those closely involved in AI-based prediction model (AIPM) development, evaluation and implementation including software engineers, data scientists, and healthcare professionals and to identify potential gaps in this guidance. We performed a scoping review of the relevant literature providing guidance or quality criteria regarding the development, evaluation, and implementation of AIPMs using a comprehensive multi-stage screening strategy. PubMed, Web of Science, and the ACM Digital Library were searched, and AI experts were consulted. Topics were extracted from the identified literature and summarized across the six phases at the core of this review: (1) data preparation, (2) AIPM development, (3) AIPM validation, (4) software development, (5) AIPM impact assessment, and (6) AIPM implementation into daily healthcare practice. From 2683 unique hits, 72 relevant guidance documents were identified. Substantial guidance was found for data preparation, AIPM development and AIPM validation (phases 1-3), while later phases clearly have received less attention (software development, impact assessment and implementation) in the scientific literature. The six phases of the AIPM development, evaluation and implementation cycle provide a framework for responsible introduction of AI-based prediction models in healthcare. Additional domain and technology specific research may be necessary and more practical experience with implementing AIPMs is needed to support further guidance. Show less
Dijk, W.J. van; Saadah, N.H.; Numans, M.E.; Aardoom, J.J.; Bonten, T.N.; Brandjes, M.; ... ; Kiefte-de Jong, J. 2021
