Our last review of our CBME work shared towards the end of 2019 showed One45’s focus on Competency-Based Medical Education (CBME), specifically on the assessment and reporting of Entrustable Professional Activities and Workplace-based Assessments.
Our CBME goals focus on improvements continued through much of 2020, working closely with Medical Schools and Programs transitioning to CBME-based models. Those goals are:
- Increasing speed of completion for learners and faculty
- Bolstering reporting and promotions
1. Increase speed of completion for learners and faculty
In addition to the updated look and feel of the One45 interface as a whole, throughout 2020 there has been considerable work done updating the mobile functionality of much of the eDossier tasks. One of our big areas of focus in 2020 has been to make it easier than ever for learners and faculty to initiate log entries, EPA assessments and evaluations in the moment for timely feedback. By investing in mobile first workflows that don’t involve downloading an app, evaluators can now easily dictate their comments and provide enhanced qualitative feedback on the go without wrestling with a tiny keyboard.
2. Bolster reporting and promotions
Our ongoing engagement in consultative product discovery with program directors, competence committee chairs and MedIT teams enabled our team further improve the depth of One45’s reporting capabilities required for CBME and specifically for entrustment decisions.
Assessment Plans
We heard from programs that they need to see how many observations of a specific score or higher are required at a minimum for an EPA to be considered for entrustment by a Competence Committee. Assessment plans can also include secondary rules based on contextual or milestone questions that need to be satisfied.
For example, For an EPA like gathering a history and performing a physical exam, an assessment plan may have relatively simple requirements:
For a further example, a complex EPA such as Internal Medicine’s EPA 2 for Transition to Discipline, identifying and assessing unstable patients, providing initial management and obtaining help, the assessment plan may include many more secondary requirements:
The ability for Programs to customize an assessment plan and show in the EPA Achievement Report (more below) and meet the layered requirements for achievement were developed in direct connection with the forms used to assess each EPA. An assessment plan can be set up for any form in One45 that is associated with a CBME mapping list (such as the Program’s list of EPAs) and a question tagged on a form that is tagged as the “overall” assessment question.
More details on how an Assessment plan is established and set up in One45 is available here.
To further bolster reporting and promotion, the following learner level reports were either added or upgraded:
EPA Achievement Report
The EPA Achievement report allows learners, Competence Committee members as well as Program Directors and Administrators to to see at a glance a learner’s progress in obtaining EPA observations in the context of each EPA’s unique assessment plan.
An EPA’s status is included in the Achievement Report to show both factors in one report and allow a learner, and their program, to monitor any issues around requests and completion of EPA assessment forms. This will show if a learner is sending enough forms requesting an assessment, and if assessors are indeed completing the forms received according to each EPA.
The EPA Achievement Report truly puts learners in the drivers seat, and gives them a critical view of their progress. Learners can also use the report to identify any gaps in EPA assessment to help them understand which EPAs and which specific conditions they need to focus on.
“The report looks fantastic! Thank you and great work to you and the team … Customers do not normally understand the scope of work that is involved in putting features together and release planning. Coming from that side of the business, I truly appreciate the hard work One45 has done prioritizing and delivering McGill’s critical requirements.”
-Peter Imperioli | Associate Director, Systems, Medical Education | Faculty of Medicine | McGill University
In addition, EPAs can easily be marked achieved from this report once they have been reviewed by a Competence Committee.
Other EPA reports are easily accessed from the EPA Achievement Report view directly in new tabs allowing a learner or reviewer to easily toggle between reports and review data concurrently.
EPA Detail Report
The EPA Detail Report shows a summary of each individual EPA, and enables a learner or reviewer to filter results by the overall score on a form showing:
- a summary of all EPAs, or
- just the EPAs that have met the criteria for entrustment review, or
- EPAs that require a closer review for improvement planning.
Competence Committee Review & Promotion
Canadian PGME programs now have the ability to enter current status and promote their residents through each stage of training, as well as log Competence Committee outcomes and decisions through the new Competency Review feature.
Current status in the Program can be selected along with any associated actions. Available actions will adjust depending on the status selected by the Competence Committee.
Learners can ultimately be promoted from one stage of training to the next and set the start date for the new state (current or previous date).
Data Collection options
Finally One45 offers programs the option to import their CBME assessment data from alternative sources, for example the RCPSC ePortfolio, to show the complete picture of a learner’s progression even in cases where a program may have begun to capture CBME assessment data previously.
At One45 we value the process of collaborating directly with MedEd institutions and engaging in product discovery. Our discovery process is a multifaceted cycle that results in concurrent discovery and delivery ongoing. As new features are prioritized, trialed and confirmed in consultation with users, work then moves to delivery and deployment. These cycles work in tandem and help ensure our work is delivering high-value to the schools and programs we serve.
As the adoption and evolution of CBME continues, it’s important to us here at One45 that we continue our close work with customers to ensure their successful transition to CBME and that we keep our focus on the critical objectives at hand for success.
Interested in trialing our CBME offerings for your program or institution? Book a demo here.
The post 2020 Update on CBME at One45 appeared first on One45.