Chapter 6. Logistics

As someone who flew two space capsules and twice landed in the ocean, I can attest from personal experience how much logistics work is needed to get you home.

Buzz Aldrin

So far we’ve talked about how to plan for research, including which methods you’ll use and why you should use them. But how do you prepare for the actual days and weeks of research ahead? The logistics of conducting any form of research can appear daunting, but once you have experience, you develop a process for preparation. The content of this chapter is intended to give you a head start by laying out the different things you need to consider, and to provide templates that will help you get going.

Qualitative research requires more preparation than quantitative research. Much of the content presented here pertains to field research and meeting directly with people. Some of the lessons are applied to quantitative methods, and we will call those out so you can be better prepared.

Planning Session Logistics

Before a single research session is conducted, it’s important to determine the amount of preparation you’ll need for each session, what supplies you’ll need, and any travel considerations to be aware of. If conducting research remotely, you’ll need to evaluate additional technical constraints. Typical issues could include limitations around phone and web conferencing, prototype bugs, or participants’ computer literacy.

Session Prep

Every session needs to follow a similar protocol as the other sessions in that study. While information gathered will vary, each session needs to start the same way, have a consistent flow, and generally mitigate risks that could disrupt your session and distract the participant.

Typically, this involves a checklist review before each day of research, before and after each session, and at the end of the day. This checklist includes logistics around setting up sessions, reviewing paperwork, familiarizing yourself with participants, addressing technology hurdles, preparing observers, and gathering supplies.

Session setup

Regardless of whether you’re conducting research in a conference room or in a person’s house, you’ll want to set up your tools and materials before the session begins. This ensures you aren’t distracted getting things ready and helps put the participant at ease since you’ll convey professionalism and confidence.

Paperwork review

Do you have all the printouts you need for the day? Are they in order? If your paperwork is disorganized, your confidence will get rattled and you can damage the quality of the session. Some forms are required, such as consent or nondisclosure agreements (NDAs), in order for a session to start. Simply put, have all paperwork sorted before meeting with the first participant.

Participant familiarization

Depending on how participants are recruited, which we will detail in Chapter 7, you may have a participant breakdown or cheat sheet. This includes summary information from the recruitment screener. Reviewing this information before participants show up lets you refer to them by name, ask tailored questions to ease them into the session, and gives you clues into areas you want to probe during the actual session.

Tech check

Perform tech checks before and between sessions to ensure potential points of failures don’t pop up during your sessions. This is vital when you’re conducting research remotely, if you have remote observers, or if you are testing a prototype. Be aware of all existing issues so you can address them during your sessions and help participants navigate past them. If you know where the prototype will cause issues, you are better prepared to address them when they happen during the sessions.

Observer orientation

For many stakeholders, observing UX research in any form is a new experience. Prior to starting sessions, you may need to review key rules observers should follow while sessions are taking place. If observers are in the room with the participant, these rules need to spell out what kind of behavior you expect. This will ensure observer bias is limited. See Chapter 8 for some basic ground rules for observers.

Supplies list

There are common supplies you’ll need when conducting qualitative research. Some supplies differ based on the research method you’re using, but we’ve attempted to create a sample list in Table 6-1.

Table 6-1. UX research supplies list

Supply

Description

Notebook

You can use this to keep track of additional questions you might want to ask. Observers can also use one to write down their own thoughts and notes, which might be handy later on during the analysis phase.

Sticky notes

An indispensable tool to every designer and researcher when random thoughts need to be collected during research sessions.

Batteries and charging cables

If you are using handheld recorders, your batteries will die at some point.

Voice recorder

Notes sometimes are misleading or don’t have all the detail you need, so being able to consult a voice recording is invaluable.

Video recorder

Video is a powerful tool when it comes to reporting out your research results.

Pens

Pens are always handy for signing forms and jotting down notes.

Forms and discussion guide

This comprises all the forms and copies of your discussion guide for yourself, note takers, and observers.

Sharpies

These come in handy when you, the participant, or the note takers want to sketch out an idea.

Memory sticks

It’s always a good idea to keep one or more backups of your notes and recordings as the research is being conducted.

Snacks

Provide small snack packs for you and your team to keep your energy reserves up.

Session Cleanup

Sessions require setup and, between participants, cleanup and preparation for the next person. During this time, save any recordings and prepare the recording devices for the next session. Reset prototypes or products you might use and work with your note takers to save notes in the same space as the recordings. The goal is for the next participant to see no evidence of past participants.

Resetting yourself

Take the time between sessions to realign your mind and body. Research is draining, and every participant deserves the same level of attention and energy. Take time to give yourself a mental and physical recharge. This might mean having a coffee, spending five minutes on social media, or reading a page or two of your current book (we are both fans of James S. A. Corey’s Expanse book series if you happen to be a science fiction fan). This mental break is different for every person. You need to make it part of your process so you avoid burnout and don’t miss key details. In addition to the mental break, you might want to have a quick debrief discussion with your team. We cover these conversations in detail in Chapter 12.

Travel Considerations

Not all research is conducted from your office. The best qualitative research is in the field, meeting people where they are. When traveling away from home, map out plans ahead of time and how long it might take to get between sessions. Err on the side of caution and plan for more time than needed, even if that means an extra night in the hotel and catching a morning flight home.

Lunch

With the focus on research and maximizing feedback, it’s easy to forget about something as simple as lunch. There have been many times we’ve skipped lunch because a session went over time or we simply lost track of the day. Learn from our mistakes and give yourself time each day to eat and take care of yourself.

Traffic

Traffic comes in two forms. The first, and standard, form of traffic includes planes, trains, and automobiles. This is easy to research and plan for. The second form of traffic involves micro interactions with other people—in hallways, elevators, parking lots, and security lines. Again, err on the side of safety and always plan for the worst-case scenario. Fortunately, in today’s age of immediate Internet access, tools like Google Maps can help you plan trip times, and even set your planned departure time (see Figure 6-1).

Google Maps with custom trip time
Figure 6-1. Google Maps with custom trip time

Remote Challenges

With remote research, the risk of something going wrong before or during a session increases. Why? Because technology is a fickle beast and Murphy’s law suggests it’s best to be extra prepared. Some things to consider having in place include:

  • Telephone conference bridge

  • Copies of questions ready to email to participants

  • Secondary access product or prototype

  • Alternative discussion guide or questions

  • Printouts and analog versions of anything that isn’t entirely dependent on technology

Training participants

One of the first lessons you’ll learn after conducting remote research for the first time is that most people don’t use online messaging tools on a daily basis. Shocking, right? This is easy to forget; as designers immersed in technology, we are used to having these tools at hand.

You should plan to spend the first 5–10 minutes of a remote session ensuring the participant has the necessary connections for an online conferencing tool. Explain how to mute and unmute their audio, how to show and hide their video, and how to either share their screen or request control of yours if you’re doing any sort of usability testing. If conducting unmoderated usability testing, be sure introductions and instructions are clear and the content is appropriate for the audience. This helps put the participant at ease and addresses technical issues they might experience so it doesn’t distract from the conversation later.

Supporting Documentation

The next few sections will introduce some common artifacts you’ll be creating while you plan out your research. The first of these is a welcome kit that can be sent to participants prior to their session. This is a set of documents explaining in detail what they got recruited to be part of, who you are, and how they can validate that the research activity is legitimate.

Welcome Kit

Welcome kits are great to introduce participants to the research team, and are most appropriate for qualitative in-person methods. Welcome kits are effective if the topic of research is sensitive in nature, as it helps put participants at ease. Common research topics may include financial information, personal health records and history, or topics that might involve their children or loved ones.

Kits should arrive at least three to four days before your scheduled session to give participants plenty of time to digest the information and to prepare for your visit. This may include locating files if you are researching a medical or financial product, or photo albums for a social tool. The content of a welcome kit is illustrated in Figure 6-2.

A common foundation for building a welcome kit
Figure 6-2. A common foundation for building a welcome kit

What and why

Include basic information on the project, a history of the product, and your reasons for conducting research. Participants now understand how their information is going to be used and why.

Team members

Write up short biographies of the team members conducting the research, along with their contact information. It’s also helpful to include photos for in-person sessions so that participants know and recognize you before meeting. If the plan or team changes, it’s importnat to update participants, as they will be expecting to see specific people the day of the session.

Points of contact

Research scammers exist, and sadly it’s one way people have their identity stolen. Include a customer service number or point of contact the participant can call to validate that the research is legitimate.

Logistics

Provide a timetable of your arrival and when the session will end. This allows participants to schedule their day around the session, including securing child care or shuffling any other personal appointments.

Research Goals

As part of the overall research planning, your team will have defined why they are doing research. For both posterity as well as transparency, it’s good to write down your goals for performing research. These can be outlined in a research summary document, in the statement of work, or on a large poster board in a project room. The point is to make your goals visible and documented so everyone is on the same page, both literally and figuratively. This is true regardless of the method, quantitative or qualitative, as having documented goals focuses the team when it comes to analyzing the data collected.

An added benefit of documenting research goals is to include stakeholders. Stakeholders can comment and refine research goals while offering the filters to observe sessions. These filters are handy when you’re reporting findings because stakeholders are reminded what the research focused on and, more importantly, what it didn’t focus on. While the ways to define goals are endless, we’ve outlined some common ones.

What will be learned?

Quite simply, state what you want to learn by doing the research. For example: How do people prepare for retirement at different stages of their life?

Why do you need to learn it?

The why of research is sometimes difficult to state as succinctly as the what. Some guiding questions to define the why are: How is the target of the research tied to the product’s overall business strategy or the company’s culture? What risks will you be taking on by not learning about specific topics?

What’s your hypothesis?

Here is your chance to include a little bit of the scientific method. Write down assumptions on the outcomes you expect to see. This doesn’t need to be long; simply stating, “We expect customers to find the authentication process cumbersome and expect the payment process to be straightforward” is sufficient. Now with this hypothesis documented, aim to prove it wrong. The purpose of research isn’t to prove your assumptions right, but to uncover truth in order to solve the real problem.

Discussion Guide

In Chapter 2, we went over how you come up with good questions for research and what pitfalls to avoid. The discussion guide is the repository for all questions you want to cover during a research session and presents an ideal order in which to ask them. While discussion guides change from project to project, we’ve outlined common sections for your convenience.

Opening script

This is a script that you’ll read at the beginning of each session to give yourself some form of consistency. The information covered includes:

  • Who you are

  • Project background

  • Reason for the research

  • Explanation of participant’s value to the goals

  • Disclaimer that the participant can end the session at any time

  • Expectations for how long the session will last and how participants will be compensated for their time

Screener recap

It’s good practice to revisit some of the questions that were presented in the recruitment screener (the specifics of which we’ll cover in Chapter 7). It will remind participants why they were recruited and give you hints on areas to ask probing questions. These are also easy questions to answer, so it gets the participants used to you asking them for information.

Research questions

This is the bulk of your discussion guide and the home for the questions defined earlier in your preparations. You’ll want to break the questions up based on topic and flag those that are meant as follow-up. It’s good practice to assign time blocks to help remember when is a good time to move to the next topic.

One of the more awkward moments of research sessions involves signing consent forms. These forms are often required before research takes place and can bring legal ramifications if participants don’t understand what they are signing. Not every research effort involves all of the following types of consent forms, but it’s good to understand them in the event you need to explain them to participants. We encourage participants to read these documents in detail and plan for extra time so they can be as thorough as they wish.

Nondisclosure agreements

No product team wants news about their product to be leaked to the press or their competitors. If you are working on a product, or an enhancement to an existing product, you’ll want to have an official nondisclosure agreement (NDA) for the participant to sign (see Figure 6-3). This document legally prevents participants from talking about what they see or do during the session.

Sample NDA
Figure 6-3. Sample NDA

Permission to record

When you wish to record a session, it is best to capture a participant’s agreement by asking them to sign a waiver allowing you to do so (Figure 6-4). In some states, law might require this waiver. This document includes a description of how your team will use the recording. It’s important to stress that recordings are a backup to written notes and will never be shared outside the immediate product team. Some people don’t like to be recorded, and that’s OK. If this happens, show the participant all recording devices are put away and then proceed with the session.

Sample “permission to record” form
Figure 6-4. Sample “permission to record” form

Permission to quote

Another form to include asks permission of the participant to use any of their quotes when you report the research findings. Participants should understand that you’ll do your best to ensure that any quotes you use will not be identifiable. While not required, this form is a courtesy so people understand how your team may use their words and information.

Honorarium

The majority of qualitative and some quantitative research methods include an honorarium for participating in your research. This reward can incentivize potential participants when you’re recruiting and helps reduce “no shows” during sessions. There are a number of ways to handle honorariums, and it’s important that the value and type of honorarium is communicated to participants prior to their session. Setting expectations avoids negative feelings, especially when delivery of an honorarium is delayed in the instance of email delivery.

Cash

Cash is by far the easiest form of reward and often the most appreciated. Before your sessions begin, have the cash split in envelopes, one for each participant. This is more secure, as participants won’t see a large stack of cash.

Gift cards

Gift cards are often used in place of cash for accounting purposes and are handed out at the end of a session. It is best to provide generic, prepaid cards (e.g., Visa), though if the reward amount is small (typically under $20) there is nothing wrong with providing gift cards to a coffee shop. If vouchers are distributed through email instead of in person, it’s important that participants understand when they will receive an email, where it will come from, and how they can use it.

Free product

For product teams that have one or more existing products, a common reward is the product itself. If the product is new, you can advertise something else your team offers in its place. For example, a team creating a new wearable fitness product may offer an earlier version of their product as a thank-you.

Receipts

Regardless of the form, participants should be asked to sign a receipt stating they received their honorarium. This best practice prevents anyone coming back and saying they were not compensated.

Parting Thoughts

Getting logistics right is a challenge for just about every type of research you’ll conduct. This topic could be a book all by itself, but the one thing we can promise is that it does get easier in time. The more research activities you plan, the more you learn what will work for your team and what won’t. You just have to do what every good designer does naturally: take in feedback on the process and iterate for next time.

As a last piece of advice regarding logistics, remember to be flexible with your plan. The universe likes to mess with everyone, so don’t let little issues get you down, as you’re probably the only one that will notice. Roll with the punches as they come and keep working your plan to get the information your team needs to make your product better for its users. Speaking of which, our next chapter will discuss recruiting participants who use, or could use, your product and provide valuable insights.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset