Usability testing conclusions
When making conclusions, you want to pay specific attention to common errors and difficulties. Identify problems experienced by multiple participants first. If a problem is experienced by one user, take a close look and try to determine if it is a problem likely to occur with other users.
You may also want to determine the scope and severity of any problems. A possible rating scale to use for each error is:
- Unusable: the user cannot or will not perform the task
- Severe: the user’s attempt to perform the task is severely hampered
- Moderate: the user can perform the task with moderate effort to overcome the problem
- Irritant: the problem is cosmetic, or does not present significant difficulty in the user’s effort to perform the task.
Further, determine what part of the product the error affects. It may affect only one part of the product (local problems), several parts, but not all, of the product (semi-local or semi-global problems), or the entire product (global problem).
For comparison testing, list both positive and negative aspects of the products and compare. Do not adopt products that include “unusable” type problems.