{"id":395,"date":"2011-05-13T08:04:43","date_gmt":"2011-05-13T15:04:43","guid":{"rendered":"http:\/\/www.nadynerichmond.com\/blog\/?p=395"},"modified":"2011-05-12T10:00:55","modified_gmt":"2011-05-12T17:00:55","slug":"qa-how-do-you-prep-for-a-usability-study","status":"publish","type":"post","link":"https:\/\/www.nadynerichmond.com\/blog\/2011\/05\/13\/qa-how-do-you-prep-for-a-usability-study\/","title":{"rendered":"Q&A: how do you prep for a usability study?"},"content":{"rendered":"

When I mentioned that I was going into the lab to do a usability study<\/a>, I got a mail asking:<\/p>\n

How do you prepare for a usability study? \u00a0What materials do you produce?<\/p><\/blockquote>\n

In this case, I got a request from the Zimbra team to help them understand the behavior of their users. \u00a0I met with the team a few times to understand their needs, and then prepared a research plan. \u00a0For this study, the research plan was a single page. \u00a0It contained the research questions and how I planned to answer them, as well as a discussion of the type of users that I will recruit to help us answer these questions. \u00a0Once the team bought off on the research plan, I got down to the real work.<\/p>\n

First, I produced a draft of the task list. \u00a0The task list is the list of stuff that I’m going to ask my participants to do in the study. \u00a0Creating a task list is at least as much art as it is science. \u00a0You have to create tasks that feel natural and appropriate for the environment that you’re studying, and you have to avoid leading language. \u00a0In the case of Zimbra, this isn’t exactly easy. \u00a0I was interested in several scenarios in the calendar, but here are some words that I can’t use in a task list: meeting, appointment, event, recurring, repeating. \u00a0How do I tell a participant to create a meeting without actually telling them a word that they’ll see on the screen as they do the task?<\/p>\n

The task list had several iterations. \u00a0I iterated on it a couple of times by myself. \u00a0Once I felt like I had a good draft, I sent it to the Zimbra team to ensure that I wasn’t missing something that we wanted to study. \u00a0I met with my fellow researchers to ask them for feedback on it. \u00a0I did a pilot study to check for time and flow (more on that in a minute). \u00a0All of this got incorporated into the final task list. \u00a0For this study, I ended up doing three major revisions of the task list from my first draft through to the final document that I used in the study.<\/p>\n

The task list turned into the moderator script. \u00a0The moderator script is a superset of the task list, and it covers everything that I say during the study. \u00a0It also notes the different ways that a participant could complete the given task. \u00a0Having this information immediately at hand helps me to follow what the participant is doing during the study. \u00a0It also makes it easy as I’m taking notes, since I can just jot down that the participant took Path A through the interface.<\/p>\n

Then there’s a bunch of ephemera associated with simply running the test. \u00a0I use a checklist between participants to make sure that I get the testing environment set up correctly for each person. \u00a0I’ve got an end-of-day checklist too, which reminds me to do things like print off any needed materials for the next day’s participants, ping those participants to remind them what time they’re scheduled to come visit my lab, and send any schedule updates to the team. \u00a0For my own note-taking purposes, I create a Word document for each participant, which contains all of the notes that I take during that participant’s session.<\/p>\n

I also have an observer survey. \u00a0I ask any member of the team who comes in to observe a participant to note their top three observations during the study. \u00a0This helps me if I miss something. \u00a0It also allows me to see the study through the eyes of someone who isn’t necessarily well-versed in a usability study. \u00a0Their comments often help me to craft the report of research results afterwards because I have some additional insight into how they see both their application and their users.<\/p>\n

I always do a pilot study before I actually begin the study. \u00a0If I’m running the study on live code that isn’t going to change during the study, then I do this the day before the study is to begin. \u00a0If I’m using a prototype (paper, Flash, Flex, whatever), then I do it a few days before the study is set to begin. \u00a0This pilot allows me to make sure that the testing environment is working properly, the study flows properly, and everything fits into the allotted time. \u00a0I always uncover one problem during the pilot study. \u00a0It never fails. \u00a0If it’s live code, then the issue is usually just with my task list, which I can update quickly. \u00a0If it’s a prototype, then an issue in the prototype usually takes a little bit more time to fix, which is why I do the pilot earlier to accommodate for that.<\/p>\n

Then I conduct the study, which is the easiest part of this. \u00a0During the study, I don’t do much other than collect data. \u00a0I save that all for what happens after the study, which is probably a blog post on its own (if there’s any interest, that is).<\/p>\n","protected":false},"excerpt":{"rendered":"

When I mentioned that I was going into the lab to do a usability study, I got a mail asking: How do you prepare for a usability study? \u00a0What materials do you produce? In this case, I got a request from the Zimbra team to help them understand the behavior of their users. \u00a0I met … Continue reading Q&A: how do you prep for a usability study?<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"class_list":["post-395","post","type-post","status-publish","format-standard","hentry","category-ux"],"_links":{"self":[{"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/posts\/395","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/comments?post=395"}],"version-history":[{"count":2,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/posts\/395\/revisions"}],"predecessor-version":[{"id":397,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/posts\/395\/revisions\/397"}],"wp:attachment":[{"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/media?parent=395"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/categories?post=395"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nadynerichmond.com\/blog\/wp-json\/wp\/v2\/tags?post=395"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}