User Testing Essentials: Planning Your User Testing

User Research   •   February 3rd, 2024   •  by Dan Olsavsky

Introduction

Welcome to Lesson 2 of “User Testing Essentials: From Planning to Analysis.” In this lesson, we’ll dive into the crucial stage of planning your user testing initiatives. Effective planning lays the groundwork for successful testing sessions and ensures that you gather valuable insights to inform your design decisions. We’ll explore key considerations and steps involved in the planning process to help you conduct meaningful user tests.

Defining Clear Objectives and Goals

The first step in planning your user testing is to define clear objectives and goals for the testing initiative. What specific questions do you want to answer? What are the primary objectives you aim to achieve through user testing? By establishing clear goals, you’ll ensure that your testing efforts are focused and aligned with your design objectives.

Identifying Target Users and Recruiting Participants

Next, identify the target users who represent your product’s intended audience. Consider demographic factors such as age, gender, occupation, and level of experience with similar products or services. Once you’ve defined your target users, develop a recruitment strategy to find participants who match your criteria. Whether through internal resources, user testing platforms, or professional recruitment agencies, recruiting the right participants is essential for obtaining relevant insights.

Example User Testing Recruiting Strategy

Objective

Recruit a diverse group of participants who represent the target audience of the health and wellness app, including individuals with varying fitness levels, lifestyles, and preferences.

1. Define Participant Criteria

  • Age: 25-45 years old
  • Gender: All genders
  • Fitness Level: Beginner to Intermediate
  • Lifestyle: Busy professionals with an interest in health and wellness
  • Smartphone Ownership: Participants must own a smartphone (iOS or Android) and be comfortable using mobile apps.

2. Recruitment Channels

  • Internal Recruitment: Reach out to colleagues, friends, and family members who fit the participant criteria and may be interested in participating in user testing sessions.
  • Online Communities: Post recruitment messages in relevant online communities and forums related to health, fitness, and wellness, such as fitness subreddits, Facebook groups, or health and wellness forums.
  • Social Media: Share recruitment posts on social media platforms like Twitter, LinkedIn, and Instagram, using relevant hashtags and tagging individuals or organizations in the health and fitness space.
  • User Testing Platforms: Utilize user testing platforms such as UserTesting, UserZoom, or TryMyUI to recruit participants from their existing panels of users.

3. Recruitment Message

  • Craft a clear and concise recruitment message that outlines the purpose of the user testing sessions, participant criteria, and incentives for participation (if applicable).
  • Include a link or contact information for interested individuals to express their interest in participating and provide their availability for scheduling sessions.

Sample Recruitment Message:

“Do you want to help shape the future of health and wellness apps? We’re looking for busy professionals who are passionate about fitness to participate in user testing sessions for our new health and wellness app. If you’re interested in sharing your feedback and insights, click the link below to sign up and schedule a session. Participants will receive a $20 gift card as a token of appreciation for their time and feedback. [Link to sign up form]”

4. Screening and Scheduling:

  • Review responses from interested participants to ensure they meet the defined criteria.
  • Schedule user testing sessions with selected participants, taking into account their availability and preferences.
  • Send confirmation emails with session details, including date, time, and instructions for accessing the testing platform or location.

By following this recruitment strategy, you can effectively recruit a diverse group of participants who represent the target audience of the health and wellness app and gather valuable insights to inform design decisions and improvements.

Developing Test Scenarios and Tasks

Crafting test scenarios and tasks is a critical aspect of user testing planning. Test scenarios should simulate real-life situations or use cases that users may encounter when interacting with your product. Define specific tasks that participants will be asked to perform during the testing session, focusing on key interactions or functionalities you want to evaluate. Clear and concise task instructions will guide participants through the testing process and ensure consistent results.

Example Test Scenario: Tracking Daily Exercise

Background

You are a busy professional who values maintaining a healthy lifestyle despite your hectic schedule. You recently downloaded a new health and wellness app to help you track your daily exercise and monitor your overall fitness goals. You’re excited to explore the app’s features and see how it can support your fitness journey.

Scenario Details

  • You recently went for a morning run in your neighborhood park to kickstart your day.
  • You completed a 30-minute jog at a moderate intensity level, tracking your route and distance using a fitness tracking app on your smartphone.
  • You typically engage in a variety of exercise activities, including running, yoga, and occasional gym workouts, to maintain your fitness and overall well-being.
  • You’re interested in finding an easy-to-use app that allows you to log and track your exercise activities seamlessly, helping you stay motivated and accountable to your fitness goals.

Task

  1. Open the health and wellness app on your smartphone.
  2. Navigate to the “Exercise Tracker” feature within the app.
  3. Log your recent exercise activity, including the type of exercise (e.g., running, yoga, cycling), duration, and intensity level.
  4. Explore the app’s functionality for setting exercise goals and tracking your progress over time.
  5. Take note of any features or functionalities that you find particularly useful or challenging to use.
  6. Share any feedback or suggestions for improving the app’s user experience, particularly regarding the exercise tracking feature.

Note to Participant

As you complete the task, please think aloud and share your thoughts, observations, and any challenges you encounter during the process. Your feedback is valuable in helping us improve the app’s functionality and user experience. Thank you for your participation!

Choosing the Appropriate User Testing Methods and Tools

Selecting the right user testing methods and tools depends on your research objectives, budget, timeline, and resources available. Consider factors such as the level of fidelity of your prototype or product, the degree of interaction required, and the accessibility of your target audience. Common user testing methods include moderated and unmoderated usability testing, remote testing, guerrilla testing, and more. Choose the method(s) that best align with your goals and constraints.

Conclusion

In this lesson, we’ve explored the critical aspects of planning your user testing initiatives, from defining clear objectives and identifying target users to developing test scenarios and selecting appropriate methods and tools. Effective planning sets the stage for successful user testing sessions and ensures that you gather relevant insights to inform your design decisions. In the next lesson, we’ll delve into the execution phase and discuss strategies for conducting user testing sessions effectively.