Smarter preparation for exams
Improving the consistency of practicing with questions in preparation for medical residency exams.
The challenge
Regular reviews
This product prepares students and physicians for public examinations to enter medical residency programs. Frequent training with questions helps their success, but this was a rare behavior among users. We wanted to encourage it through the product.
​
A research helped us understand what was causing users not to maintain regular training with questions.
Top learnings
What to answer
Finding which questions to answer used to demand much effort.
Lack of confidence
Frequent mistakes in answers were affecting motivation and discouraging studies.
Knowledge retention
They were forgetting things they had already learned due to low regularity in reviews.
Research methods
Surveys
Capturing 78 respondents' goals, behaviors, barriers and facilitators.
Desk research
From previous research and opportunity maps, prioritizing reuse.
User behavior analytics
Exploring patterns of engagement and intensity of use.
Interviews and observation of use
With 19 users. Assessing goals, routines, beliefs, the habit of training, barriers and facilitators.
A benchmark with 3 competitors revealed they didn't offer reviews based on lessons users studied. Demotivation with mistakes (often caused by answering questions from unstudied topics) was a barrier to regular practice, so a market opportunity emerged.
Solution
Smart reviews
I started with a sketch of an ideal journey map and identified the most critical moments. User tasks with the biggest difference between current and ideal journeys were highlighted in red post its.
In a workshop we came up with ideas and hypotheses. As the product triad, we delimited the scope of the solution, resumed ideas and updated the journey map. Based on drafts, we discussed risks, necessary tests, an experiment and the MVP. Later, I gained feedback in a design critique.
Hypothesis
If
We automatically organize the practice sessions with two reviews spaced apart, based on the day the student attended the class on the topic.
So
It will increase the number of users who answer 145 or more questions per week and the consistency of product usage.
Because users will​
1. Need less effort to find which questions need to be answered.
​
2. Strengthen motivation from clear and achievable goals of questions to be answered in the week.
3. Improve knowledge retention by reviewing each topic multiple times.
4. Have better performance and self-confidence when answering questions only about classes they have already seen.
At this time, due to a company reorganization, deadlines had to be reduced. It was necessary to further narrow the scope and it was not possible to validate the design with users through usability tests.
​
I created high-fidelity prototypes, which were refined, based on team feedback and design reviews, and prepared for handoff. During the implementation, I supported the developers and reviewed the design implementation to ensure quality.
Impact
First results
Two months after launch, we observed the first results coming from the new feature.
21.8%
of users adopted the new tool
57.7%
of users retained the trainings weekly for at least 7 weeks. Before, it was 51.6%
regularity
in trainings increased. More users continued to practice week after week
My role
Product Designer
I led the Product Design process of this project, from discovery to delivery. Worked in a product triad with a Product Manager and an Engineer Manager, balancing business, user and technology needs in decisions.
Main tasks
​
Planning
Research planning
Surveys, interviews and observations
Workshops facilitation
User Interface and Experience
Tools
