Using Assessment Questions to Improve the Effectiveness of the 10 Usability Heuristics

Optimize your usability evaluations and design more user-friendly products with this resource on essential assessment questions for the 10 usability heuristics.

March 8, 2023

Introduction

Our intention in writing this post was two-fold. 

Instead of merely explaining the 10 heuristics over and over again, we first sought to provide contextual clarity and applicable insights to those readers familiar with the 10 heuristics guide, while also ensuring those unfamiliar with Norman Nielsen received a concise yet informative breakdown of each heuristic. By exploring a series of questions that were overlooked in the original document (and elsewhere), we believed that we could help UI practitioners get the most out of this foundational guide by facilitating its real-life application.

The second, and perhaps more important, reason we created this post was to showcase our Usability Heuristics Scorecard. We built this tool as a practical checklist to measure if a design system clears the basics steps to be considered highly usable or not. We felt that this question warranted particular attention given that the current status quo makes such a check quite complex and often time-consuming.

So, that’s why we created this post, now let’s see how it can help you.

#1: Visibility of system status

For optimized visibility, your system should give users only the info that will help them progress on their journey.

The better your users know your system, the more engaged and comfortable they will be using it. Reward them with insightful information and immediate communication points following the completion of an action or task—this can be playful like Asana’s unicorn or as pragmatic as a simple progress bar. 

Finally, keep user engagement high with compelling and clear messages that don’t confuse your user.

Questions to consider

  1. Do users have enough information to make changes confidently within your system?
  2. Are users getting an appropriate amount of feedback for every action they take?
  3. Are users being compelled into action with the information they are seeing?

#2: Match between the system and the real world

Detailed user research, an iterative-first mindset, and a design system based on real-world conventions are all core components of a user-centred tool.

For your content system, avoid any jargon (unnecessarily complex terms), industry-oriented terminology (confusing acronyms or naming conventions), or internal-focused language that may confuse users.

Don’t try and reinvent the wheel with your UI interactions. Instead, mirror and mimic real-life norms (like how we swipe right to match on dating apps) that your user will be most familiar with.

Questions to consider

  1. Is the language free of jargon?
  2. Is the language familiar to its intended audience?
  3. Does the design feel like it has real-world interactions at its core?
  4. Is the design reflective of the real-world process?

#3: User control and freedom

A clear pathway for users to return to a page that they perceive as the previous logical location is vital when designing a system with strong user freedom. Denying or obstructing a safe exit via a back or undo button is a surefire way of reducing or denying user control and losing an existing user.

One point to note is that there’s often a difference between what is technically a new page and what users perceive to be a new page. Design a highly usable system that understands your users’ prior site experience and shapes their journey accordingly. To do this, make sure that the cancel button is easily found and can be quickly executed. 

Finally, effective UI design bakes in discoverability, it doesn’t make it a prerequisite for basic functions like undoing an action or process. After all, if your undo button is hard to find does it even really exist?

Questions to consider

  1. Are users always allowed to go back a step?
  2. Does the back interaction take users where they expect to go?
  3. Can users easily find their way back?
  4. Can users cancel any process they initiated? (e.g. cancel a purchase process of an item after starting the checkout flow)
  5. Can users undo any action they just took? (e.g. remove an item they just added by mistake to the shopping cart)
  6. Is undo discoverable and clearly labelled as an undo action?
Pragmatics resource: Try our Usability Heuristics Scorecard to measure how effective your design system is for your users.

#4 Consistency and standards

If you want to ensure that your users spend as much time as possible exploring and interacting with your product, you need to make sure they spend as little time as possible trying to understand how your design system works. This means you need to use terms and visual descriptions that they are familiar with. Check out Figma’s slash naming system for a simple yet effective example. 

Empower your users to create their own mental model of how your product works by designing a consistent internal conceptual model system that is logical and learnable. Never take users down unnecessary cul-de-sacs to merely highlight a feature that you find interesting. 

Lastly, ensure any components (CTAs, menu items, mandatory fields) that have similar inputs and outputs are displayed consistently across your website or app. Failing to do so will confuse your users and reduce their comfort level while using your product.

Questions to consider

  1. Do the interactions meet your users' established conventions?
  2. Is there a consistent interaction model across your product?
  3. Are components that carry the same type of information consistent? 

#5: Preventing user errors

From using abbreviated words to unintentional mis-clicks, our users can sometimes frustrate us. However, we must suppress the urge to punish our users! An intuitive design system that contains helpful constraints, contextual and forgiving auto-suggestions, and a default settings system that is relevant to users’ real-world goals will all help prevent user errors.

Both slips and mistakes can be reduced when detailed constraints are part of your design system. Undo buttons, pop-up message alerts, and mandatory confirmation messages are all valuable constraints that prevent users from making an error while using your product.

To ensure your product’s auto-suggestion features add real value, use spelling auto-corrections, recognition of root words, and predictive text.

Crucially, create a default setting rule that matches what the vast majority of users (around 95 percent) would choose if explicit choices were required. 

Questions to consider

  1. Are there helpful constraints in place to negate clearly unacceptable options?
  2. Are there contextual suggestions in search bars and input fields?
  3. Do the default settings fit the real-world goals of the user?
  4. Are the formats for input fields forgiving and human-readable?

#6: Recognition rather than recall

Providing your user with as much necessary context as possible will help them make informed decisions in a timely manner and empower them to use your product more effectively and ambitiously.

The more informational cues a user has using your product, the less cognitive load they will have to expend—resulting in a more favourable user experience. Interfaces that provide ample visual or text-based cues enable users to recognise the exact features that matter the most to them—see Notion’s Notes.

A usable system will also always make it easier for its users to return to previously visited pages without having to remember key details such as its name or even why they visited it—providing in-built recognition.

Questions to consider

  1. Does the user have all the necessary context to make an informed decision?
  2. Does the user have to remember any information to complete their task?
  3. Can the user easily decode the concepts you introduced?
  4. Can the user access recently visited pages in your product?

#7: Flexibility and efficiency of use

What do Photoshop, Figma, and Sketch all have in common? They all offer their expert users the option to deploy accelerators to use their tools more efficiently while not impairing less experienced users who may be operating at a slower pace. A system that incorporates accelerators ensures easier execution which improves accessibility as well as efficiency for expert professionals and recreational users alike.

It is vital to use the frameworks of focus, navigation, forgiveness, and simplicity to maintain usability when incorporating accelerators into your applications.

Questions to consider

  1. Does your system take into account the different needs of novices and experts alike?
  2. Are there multiple methods to accomplish the same task according to the user’s preferences and skill-level?
  3. Do your accelerators help expert users use your tool more efficiently while ensuring novices aren’t overloaded with too much information too soon?

#8: Aesthetic and minimalist design

When selecting each specific element of your visual design, ask yourself if it is contributing directly to your user achieving one of their primary goals. Adding any unnecessary elements that don’t directly contribute to serving the user’s primary goals should ideally be avoided in order to keep the signal-to-noise ratio as high as possible.

The aesthetics that you use as part of your visual design system need to result in user empowerment. Applying a healthy mix of skeuomorphism and realism to your design system should provide users with references that feel relatable and appropriate.

The 5 core design principles that you need to consider closely when creating an inclusive visual design are scale, visual hierarchy, balance, contrast, and gestalt.

Questions to consider

  1. Are there any unnecessary elements that do not help the user complete their task efficiently?
  2. Are you communicating visually using known design principles?
  3. Do the aesthetics feel appropriate for the users given their needs?
Pragmatics resource: Try our Usability Heuristics Scorecard to measure how effective your design system is for your users.

#9: Help users recognize, diagnose, and recover from errors

A highly usable design system will inform users of an error as soon as it has occurred. This content should be objective, compassionate, and solution-oriented with a clear CTA that will re-route users to their intended destination.

When designing user-centered error messaging, avoid jargon, error codes, and uppercase text as these elements could confuse users further. Make sure to remain humble and never blame the user for the error that has occurred.

Error messages should also educate the user on what went wrong and, where applicable, impart a small amount of knowledge to the user via a hyperlink without being overly condescending or verbose.

Questions to consider

  1. Does your system inform users when an error has occurred?
  2. Does the system use plain language to explain what the error is?
  3. Does the system offer users a solution that is easy to access?

#10: Help and documentation

The easier users can find answers to problems they have using your product, the more confident and empowered they will feel using it. Chatbots, auto-suggest search defaults without character limits, and tailored suggested questions all help users search for help. Failing to do so will increase the interaction cost for the user—likely leading to user fatigue and possible page abandonment. 

The approach you take to supporting users when assisting existing users or onboarding new ones may be persona-based (Trello), involve a dedicated checklist angle (Zendesk), or include the dissemination of core tool tips (Slack). Regardless of which approach you choose, don’t forget that onboarding doesn’t stop with new users. You can borrow certain methods and UX/UI principles to onboard existing users to new features.

Questions to consider

  1. Are users supported when learning a new or updated interaction for the first time?
  2. Can the user troubleshoot a problem they encounter with the product?
  3. Can users easily find answers to questions they have about the product?
  4. Can users easily identify the information most relevant to them?
  5. Can users easily search and find relevant results?
  6. Is the information presented in the most appropriate format(s) for the intended outcome?

Conclusion

Much like Apple or Adidas, Norman Nielsen has been at the forefront of UX design for over two decades. And to continue this weak analogy, some might even argue that their eponymous 10 Usability Heuristics for User Interface Design is the cornerstone of their UI empire, much like the iPhone was for Steve Jobs and co. However, that doesn’t mean that it is a flawless piece of work.

Issues of impartiality, challenges maintaining a fresh mindset, and certain impediments when adequate before-the-fact research and after-the-fact analysis are absent are all valid concerns. That said, as of now, the 10 heuristics guide remains an important foundational asset for UI practitioners looking to be on the right side of the usability line and with our easy-to-use 10 Heuristics Tool, we believe that the process is now even easier to apply. We hope you do too.

Pragmatics resource

Try our Usability Heuristics Scorecard to measure how effective your design system is for your users.

A screenshot of the Usability Heuristics Scorecard made by Pragmatics Studio.