Evaluation of Patient Safety and Quality Projects

Despite many attempts to improve quality and patient safety, projects often are not rigorously evaluated, making it difficult to determine whether improvements were actually made. Among the quality improvement/patient safety (QI/PS) evaluations that are conducted, a fair portion are done post-hoc, without a guiding conceptual framework or theory, and are underfunded. Further, contextual data that can help explain why some sites achieve greater success than others is often not collected or analyzed, constraining the further application of interventions to other settings.
This course prepares participants to evaluate QI/PS projects by developing their competencies in three areas: designing a robust evaluation of a project; conducting a small-scale qualitative study; and critiquing evaluations of projects in the academic literature and elsewhere. The lessons will present examples from both large-scale, multi-site improvement programs, as well as projects at the unit or clinic level.
Registration
- New dates to be added shortly.
Virtual participants: $995 per participant
Johns Hopkins Medicine employees: No cost but seats limited.
Please see our Cancellation/No Show & Refund Policy.
Agenda
The Evaluation of Patient Safety and Quality (EPSQ) course is delivered in a hybrid format that includes two full days of live virtual instruction (8:30 a.m. to 4:30 p.m. each day) with integrated lectures and structured application activities.
Day 1 focuses on foundational concepts in patient safety and quality evaluation, including the importance of evaluation, logic models and logframes, evaluation design, clinician surveys, and feasibility planning, with dedicated group work time to begin developing an evaluation plan.
Day 2 builds on these foundations with applied methods, including literature reviews, use of electronic medical record data, qualitative and observation methods, quantitative approaches including statistical process control, and implementation science, culminating in integrated evaluation plan development and group report-outs. Optional asynchronous lectures are available to supplement learning, and participants may complete brief between-session preparation to support project development.
Learning Objectives
Upon successfully completing this course, students will be able to:
- Enumerate and communicate the importance of understanding environmental, organizational, group, provider, task, work system, implementation and patient influences on outcomes
- Describe and evaluate strengths and weaknesses of designs for testing success of QI/PS interventions
- Describe operational steps to conducting robust data collection and analysis (quantitative and qualitative)
- Define and describe remedies for common problems in QI/PS studies
Topics Covered
- Introduction to QI/PS initiatives and changes
- Identifying framework and stakeholders
- Evaluation design
- Data collection and quality control
- Quantitative data analysis
- Using a logical framework in evaluation
- Qualitative methods
The Participant Experience
In addition to lectures that can be accessed online at your convenience, during live online sessions, participants will frequently break into work groups in which they will apply course concepts to challenges in QI/PS project evaluation. Participants are encouraged, but not required, to come to the course with a project that they are working on or a project idea for group discussion.
The course provides a mix of practical how-to information and research-based evaluation concepts.
Faculty
Jill Marsteller, Ph.D., M.P.P
Professor of Health Policy and Management
Johns Hopkins Bloomberg School of Public Health
Heather Watson, PhD, RN, NPD-BC
JHHS Nurse Scientist
Questions?
Email [email protected].