One45’s primary product focus for 2019 was Competency-Based Medical Education (CBME), with a focus on the assessment and reporting of Entrustable Professional Activities and Workplace-based Assessments.
Our primary goals were around:
- Increasing speed of completion for learners and faculty
- Bolstering reporting and promotions
- Easing system configuration and reducing workarounds
1. Increase speed of completion for learners and faculty
In order to make the process of allowing learners and faculty to initiate EPA Assessments on demand for timely feedback easier, there is a new feature in one45 to make it easier to send the forms that are linked to EPAs easy and distinct from Self Send workflows.
With the EPA Forms to Send feature, EPA forms are available to learners and attendings in programs with the correct settings and scenarios and does not involve the Evaluation Workflow or the rotation schedule.
With this feature, all forms are available to all internal learners, and are easily searchable. To further simplify the process, One45 picks the rotation based on the learner’s schedule.
Faculty/attendings have access to search for and initiate EPA forms in this simplified way as well.
2. Bolster reporting and promotions
We engaged in regular product discovery calls with program directors, competence committee chairs, and MedIT systems teams to improve one45’s reporting capabilities around entrustment decisions.
- The EPA Achievement Report summarizes, per learner, the number of EPAs a learner has pending, had completed, and how many have been achieved based on your school or program’s minimum achievement score.
Programs will be able to see at a glance a learner’s progress in obtaining observations of Entrustable Professional Activities. With this report, Programs can also determine potential problem spots such as learners not sending assessments, Attendings not completing sent assessments, and be able to conduct training where appropriate.
- The overall score is now available on narrative reports. This update helps frame the context of qualitative feedback on EPA assessments.
- We expanded the information available when you hover over data points on both the standalone Trajectory Report and the trajectory report within the EPA/Competency Summary Report. You can now see the narrative marker associated with the score, click to see the evaluator and feedback, as well as click through to view the full evaluation.
- We froze the left-hand column on Competency Assessment Count reports to make it easier to review data.
- We changed the scale on trajectory summary and assessment count reports from decimals to integers.
- We created additional resources on how to use your current mapping lists, reports, and permissions to access the information you need to make entrustment decisions.
- To improve reporting, we have created EPA Question Tags to identify and report on specific question types, such as contextual questions.
- In order to have more complete learner-level reporting, we are building an Assessment Plan Setup page where the Royal College requirements can be entered. This will allow us to flesh out the EPA Achievement Report to include the varied requirements for each EPA.
 |  |
- The EPA Detail Report will allow users to produce a summary of an EPA, filtered for the overall score, so that they can complete their review without having to exit the learner’s Report Center.
3. Ease system configuration and reduce workarounds
For administrators, we have configured one45 so it groups forms by stage of training based on how they are named, and categorizes them neatly in the new EPA Forms to Send.
The new workflow for CBME is automatic, so EPAs do not have to be added to rotations manually. This has the added impact of making the eDossier for learners and faculty less cluttered so they can more easily find the tasks they need to complete, including initiating EPA assessments.
EPA Forms to Send are available to all internal learners, as well as any faculty on the rolodex. Surgical Foundations has a special option to allow for external learners to access those EPAs, without compromising security around who has access to data for those learners.
Additionally, to save administrators’ time, we tagged all of overall entrustment questions with the Overall Score question tag in advance of our upcoming report releases.
Next steps
Product discovery and delivery is an ongoing process. Once a feature has been prioritized, prototyped and validated with users, it goes into product delivery. Then, product discovery commences on a new feature. In this way, discovery and delivery work together to ensure a constant stream of the highest-value work is delivered to you.
Roadmap
Q1 priorities:
- Completing learner-level reports
- Learners pre-filling questions on forms
- Programs marking EPAs as achieved
- Programs promoting learners through stages of training
Early to mid-2020:
- Program-level reporting
- Improvements to desktop and mobile user experience
Thank you
Successfully transitioning to CBME is critical to the long-term success of One45’s current and future clients, and we aim to keep our focus on your critical objectives without sacrificing our ability to adapt to the changing facets of CBME.
The post 2019 Update on CBME at One45 appeared first on One45.