Introducing "Practice Sets" to improve practice materials for Airtribe's learners. - UI/UX Case Study

Introducing "Practice Sets" to improve practice materials for Airtribe's learners. - UI/UX Case Study

Project overview

Project overview

Timeline
Timeline

May 2024 - Jun 2024

May 2024 - Jun 2024

App type
App type

Web app

Web app

Project type
Project type

Internship

Internship

Tool(s)
Tool(s)

Figma

Figma

Key skills
Key skills

Product Design, and User Research

Product Design, and User Research

Stakeholders
Stakeholders

Lead Product Designer, Product Engineers and Co-founder

Lead Product Designer, Product Engineers and Co-founder

Team member(s)
Team member(s)

Grace Lal

Grace Lal

My role
My role

User researcher, Product Designer

User researcher, Product Designer

Project summary

Project summary

I introduced this project aimed at improving practice materials for the Airtribe’s learners. Before this project, there were just notes that were provided to the learners. However, the learning experience team interacted with the learners regarding their job process and found out that most of the learners didn’t have their fundamentals clear. Since no feature existed to solve the problem, I with the lead product designer and other stakeholders thought of introducing practice sets.

Practice sets include different topics that contain various quizzes of different difficulty levels so that the learner can practice their skills and get their fundamentals right. The final design helped 35% of the learners to practice their skills.

I introduced this project aimed at improving practice materials for the Airtribe’s learners. Before this project, there were just notes that were provided to the learners. However, the learning experience team interacted with the learners regarding their job process and found out that most of the learners didn’t have their fundamentals clear. Since no feature existed to solve the problem, I with the lead product designer and other stakeholders thought of introducing practice sets.

Practice sets include different topics that contain various quizzes of different difficulty levels so that the learner can practice their skills and get their fundamentals right. The final design helped 35% of the learners to practice their skills.

About the company

About the company

Airtribe is an ed-tech startup offering courses in Product Building space - includes engineering and product management. Airtribe has a new-age upskilling platform focused on the intersection of expert-led education and community-based learning. The courses encourage active learning instead of passive lecture-watching. They are live programs with workshop-style sessions, direct access to expert instructors, access to the community with peers, and regular feedback. The instructors and mentors hail from top tech unicorns and decacorns like Gojek, Razorpay, Uber, Coinbase, Microsoft, Meta, Google, and more. Airtribe’s target audience consists of professionals with a couple of years of experience looking to upskill in their or make a career transition. Airtribe has helped 1000+ learners in their upskilling journey through their courses.

Airtribe is an ed-tech startup offering courses in Product Building space - includes engineering and product management. Airtribe has a new-age upskilling platform focused on the intersection of expert-led education and community-based learning. The courses encourage active learning instead of passive lecture-watching. They are live programs with workshop-style sessions, direct access to expert instructors, access to the community with peers, and regular feedback. The instructors and mentors hail from top tech unicorns and decacorns like Gojek, Razorpay, Uber, Coinbase, Microsoft, Meta, Google, and more. Airtribe’s target audience consists of professionals with a couple of years of experience looking to upskill in their or make a career transition. Airtribe has helped 1000+ learners in their upskilling journey through their courses.

Business opportunity

Business opportunity

The practice sets will help learners to practice their skills and get their fundamentals right. While interviewing for a job, they would have a clear understanding of the subject, which will lead them to secure a job. If a learner secures a job, his testimonial and word-of-mouth will help us to attract more people to join our program.

The practice sets will help learners to practice their skills and get their fundamentals right. While interviewing for a job, they would have a clear understanding of the subject, which will lead them to secure a job. If a learner secures a job, his testimonial and word-of-mouth will help us to attract more people to join our program.

Problem

Problem

The learners don’t have a clear understanding of the fundamentals of a topic which leads them to perform poorly during their job interviews. We noticed that there is a need to include a way to ensure learners practice well and are confident during the interviews.

The learners don’t have a clear understanding of the fundamentals of a topic which leads them to perform poorly during their job interviews. We noticed that there is a need to include a way to ensure learners practice well and are confident during the interviews.

Goals

Goals

Design practice sets for the learner so that they can practice their skills and be well-equipped with the knowledge. Design the practice materials easy to comprehend so that learners can confidently answer during their job interviews.

Design practice sets for the learner so that they can practice their skills and be well-equipped with the knowledge. Design the practice materials easy to comprehend so that learners can confidently answer during their job interviews.

Impact

Impact

I designed the practice sets by introducing timed quizzes for each topic. The designed solution helped 35% of the learners to practice their skills and increased their confidence.

I designed the practice sets by introducing timed quizzes for each topic. The designed solution helped 35% of the learners to practice their skills and increased their confidence.

Research

Research

Problem discovery

After interacting with the learning and experience team, I found out that learners were not able to clear their job interviews due to the fundamentals of a topic being unclear. Even though learners are provided with the notes and topics covered in the lectures, learners find it difficult to practice their skills. After talking about this issue with stakeholders, we concluded to provide the learners with the practice sets on the topics specific to the domain knowledge.

Competitive analysis

To see how can we incorporate the practice sets into our platform, I started the competitive analysis of the platforms that offer similar features to the practice sets. I explored other platforms like Brilliant, Khan Academy, Quizizz, Codecademy, Pluralsight, EdApp, Uxcel, and Duolingo. Following were the insights:

  1. These platforms have gamified the user experience.

  2. They follow a pattern of giving the practice sets as levels. This ensures that the user is engaged and learning at the same time.

  3. They have included explanations for each question when they reveal the answers.

Problem discovery

After interacting with the learning and experience team, I found out that learners were not able to clear their job interviews due to the fundamentals of a topic being unclear. Even though learners are provided with the notes and topics covered in the lectures, learners find it difficult to practice their skills. After talking about this issue with stakeholders, we concluded to provide the learners with the practice sets on the topics specific to the domain knowledge.

Competitive analysis

To see how can we incorporate the practice sets into our platform, I started the competitive analysis of the platforms that offer similar features to the practice sets. I explored other platforms like Brilliant, Khan Academy, Quizizz, Codecademy, Pluralsight, EdApp, Uxcel, and Duolingo. Following were the insights:

  1. These platforms have gamified the user experience.

  2. They follow a pattern of giving the practice sets as levels. This ensures that the user is engaged and learning at the same time.

  3. They have included explanations for each question when they reveal the answers.

Ideation & Brainstorm

Ideation & Brainstorm

After completing the problem discovery and competitive research/analysis, I started with ideation. I came up with a bunch of ideas. After coming up with the ideas, I had a meeting with the stakeholders.

Constraints

The project had a smaller workforce to come up with the quiz and upload it on the platform. To overcome this, we decided to outsource the quizzes through the mentors and have a limited number of quizzes for each topic initially.

Features/Improvements:

After having a discussion, we came to the following conclusion:

  1. Introduction of Difficult levels: The learners might have basic and intermediate knowledge, but might want to practice expert-level questions. Such a scenario can occur, hence, we have ensured that all levels are included.

  2. Introduction of XP: To gamify the experience, the learners will be awarded an XP with a correct attempt.

  3. Answer explanation: To ensure that learners fully understand the question and why an answer is correct, provide the explanation there itself so that they can understand better.

  4. Allowing learners to attempt at any time: Since some learners might want to practice their skills right after the topic is covered during the sessions, the availability of the topics and quizzes is necessary.

  5. Allowing reattempts: To practice the skill, learners might want to reattempt the quiz. However, there might be a case where the learner wants to appear just to gain XPs. For such cases, we don’t award XP for a correct answer during a reattempt.

  6. Timed questions: To ensure that learners don’t cheat, the questions are timed. After the timer ends for the question, it counts as a missed attempt.

  7. Performance summary: To ensure that learners view their performance, show a summary of their performance.

  8. Attempt incorrect answers in the same attempt: To ensure that learners have understood why their answer was wrong, allow them to attempt incorrect answers in the same attempt until they get it right. XPs won’t be awarded for the correct attempt of the incorrect question.

The user flow:

After finalizing the features and improvements, I made the user flow.

After completing the problem discovery and competitive research/analysis, I started with ideation. I came up with a bunch of ideas. After coming up with the ideas, I had a meeting with the stakeholders.

Constraints

The project had a smaller workforce to come up with the quiz and upload it on the platform. To overcome this, we decided to outsource the quizzes through the mentors and have a limited number of quizzes for each topic initially.

Features/Improvements:

After having a discussion, we came to the following conclusion:

  1. Introduction of Difficult levels: The learners might have basic and intermediate knowledge, but might want to practice expert-level questions. Such a scenario can occur, hence, we have ensured that all levels are included.

  2. Introduction of XP: To gamify the experience, the learners will be awarded an XP with a correct attempt.

  3. Answer explanation: To ensure that learners fully understand the question and why an answer is correct, provide the explanation there itself so that they can understand better.

  4. Allowing learners to attempt at any time: Since some learners might want to practice their skills right after the topic is covered during the sessions, the availability of the topics and quizzes is necessary.

  5. Allowing reattempts: To practice the skill, learners might want to reattempt the quiz. However, there might be a case where the learner wants to appear just to gain XPs. For such cases, we don’t award XP for a correct answer during a reattempt.

  6. Timed questions: To ensure that learners don’t cheat, the questions are timed. After the timer ends for the question, it counts as a missed attempt.

  7. Performance summary: To ensure that learners view their performance, show a summary of their performance.

  8. Attempt incorrect answers in the same attempt: To ensure that learners have understood why their answer was wrong, allow them to attempt incorrect answers in the same attempt until they get it right. XPs won’t be awarded for the correct attempt of the incorrect question.

The user flow:

After finalizing the features and improvements, I made the user flow.

Design

Design

To begin with the design, I started thinking about the edge cases that might occur for the quizzes.

Navigation

Let’s start with the navigation of the practice sets, practice sets page, and the quiz listing page.

Navigation: The learners can navigate to the practice sets after selecting Practice from the navigation bar.

  • Practice sets page: The practice sets page of different topic cards. Each card consists of topic name, topic description, and a random topic icon. It highlights the number of quizzes completed within the topic and while hovering over the card you can see an arrow. Clicking the arrow will take you to the quiz listing page.

  • Quiz listing page: This page consists of a list of quizzes and the list of instructions common for all the quizzes with the indicator of the number of quizzes completed from the total number of quizzes. Each quiz card has a name, an icon to indicate if the quiz is complete/incomplete, and difficulty level. While hovering over the card, learners can see buttons which can allow them to take, reattempt, and resume the quiz. Note: All three states of the button won’t be visible simultaneously. The screen in the design is shown for explanation purposes.

Question states

For each question, the states are shown below. For each question, there will be a timer, and answer status (incorrect, correct, and time out). The quiz page has a progress bar to indicate the progress of the quiz and a close button to close the quiz.

Answer unselected: When the learner has not selected the answer.

  • Answer selected: When the learner has selected the answer.

  • Wrong answer selection: When the learner has submitted an incorrect answer, the correct answer with the explanation is shown.

  • Right answer selection: When the learner has submitted a correct answer, the correct answer with the explanation is shown and the learner is awarded an XP.

  • Time out: The learner did not select the answer within the time limit.

Quiz states

For the quizzes, the states are shown below.

The first attempt at the quiz: The screen is presented when it’s the first attempt with the instructions

  • Resuming the quiz: The screen is presented when the learner wants to resume the quiz with the instructions and the progress till now. The learner cannot change the previously answered questions.

  • Reattempting the quiz: The prompt will be presented asking the learner if he wants to retry the quiz followed by the screen presented when the learner wants to reattempt the quiz with the instructions and the progress of the first attempt. Learners won’t be awarded for this attempt.

  • Leaving the quiz: The prompt informs the learner if he is quitting the quiz.

Quiz completion

For the completion of the quiz, the states are shown below.

Performance summary for the first attempt: Learners can view their performance summary like correct answers and XPs earned. This screen will be visible after the learner has either practiced the incorrect answers or directly after all the answers are correct.

  • Practicing the incorrect answers: Learners can view this screen if the learner has answered some questions incorrectly. After this screen, learners will be questions incorrect questions to practice but won’t be awarded the XP if answered correctly in the practice attempt.

  • Performance summary for the reattempt: This screen will be visible after the completion of the reattempt. Since its a reattempt, learners won’t be awarded the XPs.

To begin with the design, I started thinking about the edge cases that might occur for the quizzes.

Navigation

Let’s start with the navigation of the practice sets, practice sets page, and the quiz listing page.

Navigation: The learners can navigate to the practice sets after selecting Practice from the navigation bar.

  • Practice sets page: The practice sets page of different topic cards. Each card consists of topic name, topic description, and a random topic icon. It highlights the number of quizzes completed within the topic and while hovering over the card you can see an arrow. Clicking the arrow will take you to the quiz listing page.

  • Quiz listing page: This page consists of a list of quizzes and the list of instructions common for all the quizzes with the indicator of the number of quizzes completed from the total number of quizzes. Each quiz card has a name, an icon to indicate if the quiz is complete/incomplete, and difficulty level. While hovering over the card, learners can see buttons which can allow them to take, reattempt, and resume the quiz. Note: All three states of the button won’t be visible simultaneously. The screen in the design is shown for explanation purposes.

Question states

For each question, the states are shown below. For each question, there will be a timer, and answer status (incorrect, correct, and time out). The quiz page has a progress bar to indicate the progress of the quiz and a close button to close the quiz.

Answer unselected: When the learner has not selected the answer.

  • Answer selected: When the learner has selected the answer.

  • Wrong answer selection: When the learner has submitted an incorrect answer, the correct answer with the explanation is shown.

  • Right answer selection: When the learner has submitted a correct answer, the correct answer with the explanation is shown and the learner is awarded an XP.

  • Time out: The learner did not select the answer within the time limit.

Quiz states

For the quizzes, the states are shown below.

The first attempt at the quiz: The screen is presented when it’s the first attempt with the instructions

  • Resuming the quiz: The screen is presented when the learner wants to resume the quiz with the instructions and the progress till now. The learner cannot change the previously answered questions.

  • Reattempting the quiz: The prompt will be presented asking the learner if he wants to retry the quiz followed by the screen presented when the learner wants to reattempt the quiz with the instructions and the progress of the first attempt. Learners won’t be awarded for this attempt.

  • Leaving the quiz: The prompt informs the learner if he is quitting the quiz.

Quiz completion

For the completion of the quiz, the states are shown below.

Performance summary for the first attempt: Learners can view their performance summary like correct answers and XPs earned. This screen will be visible after the learner has either practiced the incorrect answers or directly after all the answers are correct.

  • Practicing the incorrect answers: Learners can view this screen if the learner has answered some questions incorrectly. After this screen, learners will be questions incorrect questions to practice but won’t be awarded the XP if answered correctly in the practice attempt.

  • Performance summary for the reattempt: This screen will be visible after the completion of the reattempt. Since its a reattempt, learners won’t be awarded the XPs.

Results

Results

After the shipment of this project, learners were able to practice their skills for domain-specific topics. They were also able to clear the interview rounds successfully. It helped 35% of the learners and also increased their confidence.

After the shipment of this project, learners were able to practice their skills for domain-specific topics. They were also able to clear the interview rounds successfully. It helped 35% of the learners and also increased their confidence.

Key takeaways

Key takeaways

This project was the new feature introduced on the platform. I learned how to create a project from scratch taking into account the different scenarios and edge cases that might occur and to solve for them.

This project was the new feature introduced on the platform. I learned how to create a project from scratch taking into account the different scenarios and edge cases that might occur and to solve for them.