#UsabilityStudy

#MobileApp

#Research

#UserTesting

Duolingo Usability Study

Duolingo Usability Study

Duolingo Usability Study

Duolingo Usability Study

Duolingo Usability Study

Duolingo Usability Study

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

This is Usability Case Study conducted on Duolingo mobile application version 6.181.0 & iOS 15.7

12 Weeks

Duration

UX Research

Role

Figma, Zoom, Sheets

Tools

12 Weeks

Duration

UX Research

Role

Figma, Zoom, Sheets

Tools

Overview

Overview

Duolingo stands as the world’s most popular language learning tool, seamlessly blending gamification, technology, and scientific learning. It aligns with a mission to provide top-tier education universally. This study encompasses Heuristic Evaluation, Competitive Analysis, followed by Usability Test.

Duolingo stands as the world’s most popular language learning tool, seamlessly blending gamification, technology, and scientific learning. It aligns with a mission to provide top-tier education universally. This study encompasses Heuristic Evaluation, Competitive Analysis, followed by Usability Test.

Research Objectives & Goals

Research Objectives & Goals

1

Evaluate the user experience for language learning within Duolingo’s mobile application.

2

Assess the accessibility and ease of use of the app’s features.

3

Identify design opportunities through an in-depth analysis of user interactions.

4

Provide actionable recommendations to enhance the overall usability of the Duolingo app.

Heuristic Evaluation

Heuristic Evaluation

We applied Jakob Nielsen’s 10 heuristics for interaction design to evaluate the app’s interface and interaction design. We rated each heuristic violation on a severity scale of 0 to 4, where 0 = no usability problem and 4 = usability catastrophe.

🔗 Click here to see complete Heuristic Evaluation.

Heuristic 03: User Control & Freedom

Severity - 3

Actual Issue:

The user is forced to take a language quiz immediately after signing up. They face unfamiliar characters and lose 1 out of 5 lives for each incorrect answer. Each life takes up to 5 hours to refill.

Impact:

This might result in the user panicking to get the answer right and feeling disoriented or unmotivated to continue learning the language.

Heuristic 07: Flexibility & Efficiency of Use

Heuristic 07: Flexibility & Efficiency of Use

Severity - 3

Actual Issue:

Users can skip specific learning components (for example, speaking) for 15 min without further operation and complete multiple units without having to retake the skipped parts.This leads to an imbalance in learning the language holistically.

Impact:

The users might miss out on learning some components because they do not have an option to revisit the skipped lessons. Learning could be imbalanced in case the course is prescribed as a lesson in school.

Heuristic 08: Aesthetic & Minimalist Design

Severity - 4

Actual Issue:

The unorganized setting page makes it hard for users to locate any function. It consists of profile info, uncategorized buttons, unfoldable sections containing buttons, toggle switches, and a time picker. The outcome is a long page for the user to scroll through rather than a well-defined classification that can help a user narrow down choices.

Impact:

For both inexperienced and experienced user, it takes more time and effort to set anything or find help in the page.

Heuristic 04: Consistency & Standards

Severity - 4

Actual Issue:

The placement of icons is inconsistent from language to language. Only some tap bars have meatball menus. When Duolingo does split testing, the use of icons in the same language could be different for two users. The PROFILE/USER icon resembles a woman and may not seem inclusive to all populations.

Impact:

Users cannot remember the positions of icons, thus having to recall or possibly try and fail every time instead of choosing the correct icon intuitively after several uses.

Competitive Analysis

Competitive Analysis

We then identified competitors in the industry by researching their strategies, strengths, and weakness to get clear overview of their place in the competitive environment.

Competitors

Competitors

Comparison Matrix

Comparison Matrix

Market Analysis

Market Analysis

Current Trends

Current Trends

Pre-lesson Reviews

Pre-lesson Reviews

Effective pre-lesson resources or review pages help users learn better and promote memory retention.

Effective pre-lesson resources or review pages help users learn better and promote memory retention.

Taught by Natives

Taught by Natives

Native speakers teaching the speaking components encourage users to use the language in everyday life.

Native speakers teaching the speaking components encourage users to use the language in everyday life.

Freemium Plans

Freemium Plans

Users can learn the basics of languages at no charge. Additional Subscription plans provide flexibility and specialized content beyond the basics.

Users can learn the basics of languages at no charge. Additional Subscription plans provide flexibility and specialized content beyond the basics.

Holistic Learning

Holistic Learning

E-learning tools include grammar components and develop more speaking, listening, and writing practices to facilitate holistic learning.

E-learning tools include grammar components and develop more speaking, listening, and writing practices to facilitate holistic learning.

Through this competitive analysis we got an opportunity to analyze the learning strategies and features offered by competitors, which widened our views on language learning as a whole. It also helped us understand what makes Duolingo one of the most competitive players in the language learning field.

Usability Test

Usability Test

Before conducting our user interviews, we prepared 🔗 recruitment screener, 🔗 moderator script and test packet, and other additional required documents. The purpose of this study was to gather reactions and feedback to the Duolingo mobile application, particularly from users who are using English as a base language to learn other languages. Each session, facilitated by a moderator and notetaker, was screen recorded for meticulous review, and participants were encouraged to voice their thoughts aloud during tasks, contributing to a comprehensive evaluation of the app’s usability.

Task by Task Analysis

Task by Task Analysis

8

User

1 Wk - 4 Yrs

App Experience

8

Tasks

30-45

Minutes Test

3

Post-Test Questions

10

SUS Questions

TASK 1 | Change Daily Goals

TASK 1 | Change Daily Goals

Findings
Findings
  • Lengthy and uncategorized Settings page > options hard to recognize when skimming

  • Gear icon not obvious > Profile page confused with Settings

  • Icons on home page overwhelming for new users

  • Lengthy and uncategorized Settings page > options hard to recognize when skimming

  • Gear icon not obvious > Profile page confused with Settings

  • Icons on home page overwhelming for new users

Recommendations
Recommendations
  • Categorize the Settings page by functions

  • Label icons for users to identify and navigate easily

  • Categorize the Settings page by functions

  • Label icons for users to identify and navigate easily

TASK 2 | Add a new course

TASK 2 | Add a new course

Findings
Findings
  • Instructions in the Help page do not match the app’s interface and confuse new users.

  • Users take long to read and choose from the list of languages

  • Instructions in the Help page do not match the app’s interface and confuse new users.

  • Users take long to read and choose from the list of languages

Recommendations
Recommendations
  • Update the Help pages to match the latest version of the app.

  • Introduce a search function or organize languages alphabetically.

  • Update the Help pages to match the latest version of the app.

  • Introduce a search function or organize languages alphabetically.

TASK 3 | Take Lessons in 2 Languages

TASK 3 | Take Lessons in 2 Languages

Findings
Findings
  • Some participants mistook the beginner lessons for intermediate level and quit the lesson immediately.

  • Users quickly lose motivation after losing all (5) lives.

  • Users are unaware that tapping on underlined words can show meanings.

  • Audio not authentic enough.

  • Some participants mistook the beginner lessons for intermediate level and quit the lesson immediately.

  • Users quickly lose motivation after losing all (5) lives.

  • Users are unaware that tapping on underlined words can show meanings.

  • Audio not authentic enough.

Recommendations
Recommendations
  • After 3 consecutive errors, prompt the user to review the guidebook.

  • Highlight the underlined text in blue color.

  • Change the audio from computer generated voice to native speakers’ recordings.

  • After 3 consecutive errors, prompt the user to review the guidebook.

  • Highlight the underlined text in blue color.

  • Change the audio from computer generated voice to native speakers’ recordings.

TASK 4 | Change Notification Time

TASK 4 | Change Notification Time

Findings
Findings
  • Participants repeatedly tapped on the greyed-out ‘Reminder Time’ option, not realizing that they needed to turn off the ‘Smart Scheduling’ toggle first.

  • Participants repeatedly tapped on the greyed-out ‘Reminder Time’ option, not realizing that they needed to turn off the ‘Smart Scheduling’ toggle first.

Recommendations
Recommendations
  • Use similar terminology, so users can understand that smart scheduling & reminder time are complimentary options.

  • Use similar terminology, so users can understand that smart scheduling & reminder time are complimentary options.

TASK 5 | Delete A Language Course

TASK 5 | Delete A Language Course

Findings
Findings
  • List of courses appear in 2 places > users expected to see a delete option in both but cannot find it.

  • ‘Manage Courses’ in Settings is exclusively designed to delete a language, but it is not obvious when users skim through the page.

  • List of courses appear in 2 places > users expected to see a delete option in both but cannot find it.

  • ‘Manage Courses’ in Settings is exclusively designed to delete a language, but it is not obvious when users skim through the page.

Recommendations
Recommendations
  • Change ‘Manage Courses’ to ‘Delete Courses.

  • Add manage/delete course options in the course list throughout the app

  • Change ‘Manage Courses’ to ‘Delete Courses.

  • Add manage/delete course options in the course list throughout the app

TASK 6 | Turn Off Speaking Component

TASK 6 | Turn Off Speaking Component

Findings
Findings
  • Participants expected different options in different language interfaces because of change in icon placements.

  • Some expected the option to be mentioned in their list of courses.

  • Participants expected different options in different language interfaces because of change in icon placements.

  • Some expected the option to be mentioned in their list of courses.

Recommendations
Recommendations
  • Add manage components options of each course in the course lists throughout the app.

  • Maintain consistency in icon placements across languages.

  • Add manage components options of each course in the course lists throughout the app.

  • Maintain consistency in icon placements across languages.

TASK 7 | Navigate Icons in Tab Bar

TASK 7 | Navigate Icons in Tab Bar

Findings
Findings
  • Some participants recalled icons from previous tasks.

  • Meaning of icons are unclear.

  • Inconsistent terminology on the Leaderboard page (“League”) and in the help documentation (“Leaderboard”).

  • Some participants recalled icons from previous tasks.

  • Meaning of icons are unclear.

  • Inconsistent terminology on the Leaderboard page (“League”) and in the help documentation (“Leaderboard”).

Recommendations
Recommendations
  • Icons should be labelled.

  • Use standard terminology across the app.

  • Icons should be labelled.

  • Use standard terminology across the app.

TASK 8 | Locate How to Refill Hearts

TASK 8 | Locate How to Refill Hearts

Findings
Findings
  • Most participants discontinue lesson because the pop-up message only provides 2 options (buy premium and purchase hearts) while a free 3rd option is not available until user specifically looks for it.

  • Most participants discontinue lesson because the pop-up message only provides 2 options (buy premium and purchase hearts) while a free 3rd option is not available until user specifically looks for it.

Recommendations
Recommendations
  • Show the 3rd option in the popup screen once a user runs out of lives.

  • Show the 3rd option in the popup screen once a user runs out of lives.

System Usability Scale

System Usability Scale

At the end of each usability testing session, users was given a 10 standard questionnaire to quantify the user experience of the website.

Key Insights and Recommendations

Key Insights and Recommendations

Information Architecture

Insights

1

The information in the app is currently uncategorized making it difficult for the user to locate the options that they are looking for.

2

The app also contains pages that have redundant information. And similar categories scattered across pages.

Recommendation

1

The information needs to be categorised better so users can search for things more intuitively and thereby optimizing the app’s real estate.

2

Introducing a search option in pages that contain a range of information is useful.

Consistency

Insights

1

The icon placement across different language courses are not consistent which leads the users to assume that different languages may have different options.

2

In some cases, the icons and their functions are not intuitive to users.

Recommendation

1

Using more universal icons or labelling the icons will be helpful to users.

2

Maintaining consistent placement for icons across languages will improve user trust.

Changes

Conclusion

While the System Usability Scale (SUS) scores for Duolingo’s mobile app highlighted good usability, our detailed Usability Test uncovered specific areas for improvement. Issues with information architecture, and icon consistency, suggesting opportunities for refinement. This nuanced analysis emphasizes the ongoing journey to optimize user experience, showcasing the commitment to delivering an even more seamless language-learning platform.

Built in Framer · Made by Krish Pabani · ©2024

Built in Framer · Made by Krish Pabani · ©2024

Built in Framer · Made by Krish Pabani · ©2024

Built in Framer · Made by Krish Pabani · ©2024