ATS 2021 will feature presentations of original research from accepted abstracts. Mini Symposia and Thematic Poster Sessions are abstract based sessions.
Please use the form below to browse scientific abstracts and case reports accepted for ATS 2021. Abstracts presented at the ATS 2021 will be published in the Online Abstract Issue of the American Journal of Respiratory and Critical Care Medicine, Volume 203, May 3, 2021.
Search Tips:
- Use the keyword search to search by keyword or author's name.
- Filter your search results by selecting the checkboxes that apply.
- Click on "Clear" to clear the form and start a new search. .
Search results will display below the form.
An Implementation and Longitudinal Evaluation Framework of Remote Quality Improvement Initiatives
Session Title
TP55 - TP055 MECHANICAL VENTILATION, ICU MANAGEMENT, AND CV
Abstract
A2851 - An Implementation and Longitudinal Evaluation Framework of Remote Quality Improvement Initiatives
Author Block: H. Li1, Y. Sun2, Y. Dong2, A. Tekin2, R. Kashyap3, W. Cui4, A. Leppin5, O. Gajic2, A. S. Niven6; 1Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 2Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 3Anesthesia and Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 4Critical Care Medicine, Shengli Oilfield Central Hospital, Dongying, China, 5College of Medicine, Mayo Clinic, Rochester, MN, United States, 6Division of Pulmonary, Critical Care, and Sleep Medicine, Mayo Clinic, Rochester, MN, United States.
Objective: Virtual learning experiences have become widely used during the ongoing COVID-19 global crisis. Given its cost-effectiveness, accessibility, and flexibility, remote training experiences are likely to assume a permanent and expanded role in medical education and quality improvement initiatives. However, little is known about how best to measure the effectiveness of remote training interventions. The Checklist for Early Recognition and Treatment of Acute Illness and Injury (CERTAIN) is an established critical care quality improvement program with evidence of improved care processes and patient outcomes in an international quality improvement trial. Our aim was to develop a structured implementation and longitudinal evaluation framework that measures the complex contributors to the impact of this remote training program, including incorporation into processes of care and sustainment over time. Methods: We convened an international topic review group that included individuals with diversity in clinical expertise, nationality, and experience in medical education, quality improvement, implementation science, and research methodology. We recruited individuals with experience designing and participating in various medical remote training programs, including teleconferences, tele-consults, online video/chat platforms, and virtual simulation classrooms. Through a series of facilitated discussions, we directed the group to develop a conceptual framework to guide the development of remote learning programs and accompanying evaluation tools to measure their impact. Results: The review group members included education experts and continuing medical education participants from China and the United States with practice backgrounds in Critical Care, Internal Medicine, Anesthesiology and Emergency Medicine. The group developed a conceptual framework based on the CIPP (context-input-process-product) quality evaluation model. The framework includes three phases: before, during, and after the remote training. The proposed quantitative and qualitative evaluation tools blend the Proctor taxonomy, an expansion of the popular RE-AIM framework used to categorize implementation outcomes, to include early (i.e. acceptability, appropriateness, feasibility), mid (i.e. adoptions, fidelity), and late (i.e. sustainability) stage outcomes to provide a more complete understanding of the implementation process and facilitate generalization of our findings. Elements of the Logic Model were also used to guide the program development process. Conclusions: We propose a dynamic, longitudinal implementation evaluation framework that has sufficient rigor and flexibility to meet the needs of the existing and emerging remote medical training programs in global practice settings. The outcomes from these mixed-methods analyses will provide a robust toolbox to guide the design, delivery, implementation, and sustainment of remote medical educational programs.
Author Block: H. Li1, Y. Sun2, Y. Dong2, A. Tekin2, R. Kashyap3, W. Cui4, A. Leppin5, O. Gajic2, A. S. Niven6; 1Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 2Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 3Anesthesia and Critical Care Medicine, Mayo Clinic, Rochester, MN, United States, 4Critical Care Medicine, Shengli Oilfield Central Hospital, Dongying, China, 5College of Medicine, Mayo Clinic, Rochester, MN, United States, 6Division of Pulmonary, Critical Care, and Sleep Medicine, Mayo Clinic, Rochester, MN, United States.
Objective: Virtual learning experiences have become widely used during the ongoing COVID-19 global crisis. Given its cost-effectiveness, accessibility, and flexibility, remote training experiences are likely to assume a permanent and expanded role in medical education and quality improvement initiatives. However, little is known about how best to measure the effectiveness of remote training interventions. The Checklist for Early Recognition and Treatment of Acute Illness and Injury (CERTAIN) is an established critical care quality improvement program with evidence of improved care processes and patient outcomes in an international quality improvement trial. Our aim was to develop a structured implementation and longitudinal evaluation framework that measures the complex contributors to the impact of this remote training program, including incorporation into processes of care and sustainment over time. Methods: We convened an international topic review group that included individuals with diversity in clinical expertise, nationality, and experience in medical education, quality improvement, implementation science, and research methodology. We recruited individuals with experience designing and participating in various medical remote training programs, including teleconferences, tele-consults, online video/chat platforms, and virtual simulation classrooms. Through a series of facilitated discussions, we directed the group to develop a conceptual framework to guide the development of remote learning programs and accompanying evaluation tools to measure their impact. Results: The review group members included education experts and continuing medical education participants from China and the United States with practice backgrounds in Critical Care, Internal Medicine, Anesthesiology and Emergency Medicine. The group developed a conceptual framework based on the CIPP (context-input-process-product) quality evaluation model. The framework includes three phases: before, during, and after the remote training. The proposed quantitative and qualitative evaluation tools blend the Proctor taxonomy, an expansion of the popular RE-AIM framework used to categorize implementation outcomes, to include early (i.e. acceptability, appropriateness, feasibility), mid (i.e. adoptions, fidelity), and late (i.e. sustainability) stage outcomes to provide a more complete understanding of the implementation process and facilitate generalization of our findings. Elements of the Logic Model were also used to guide the program development process. Conclusions: We propose a dynamic, longitudinal implementation evaluation framework that has sufficient rigor and flexibility to meet the needs of the existing and emerging remote medical training programs in global practice settings. The outcomes from these mixed-methods analyses will provide a robust toolbox to guide the design, delivery, implementation, and sustainment of remote medical educational programs.
