Enter to win a copy “Managing Chaos” by Lisa Welchman.
It actually begins the moment we learn about a project, whether we acknowledge it or not. We ask questions. We take notes. We learn everything we can about our client and their audience—and that’s before we even begin! Let’s explore the (purported) method to this (seeming) madness, known as design research.
Design research is an integral part of the oft–misunderstood user–centered design process. This process, employed by user experience designers, is both iterative and cyclical. Its outputs serve as its inputs. Initially, solutions are proposed based on embodied, observable phenomena related to the problem space. Next, a design solution is agreed upon and then prototyped. Eventually, it’s tested against its target audience. Finally, the process repeats itself.
Design research, as described in this article, assumes the reader follows a user–centered design process.
Back to topWhat is design research?
Design research describes any number of investigative techniques used to add context and insight to the design process. Although this article discusses research in the context of contemporary UX/Interaction Design for websites, Design Research has been practiced for decades (since the 1960s) in the architectural, industrial, and academic communities. For a deeper look into this industry, check out publications like Design Research Quarterly, or consider attending the Design Research Conference.
Design Research techniques can be incorporated before, during, or after the design solution is established. If done before or during the design phase, these techniques are collectively known as user research; if after, they’re known as user testing. User research attempts to answer questions like “who will use this design?” and “how does this concept work in the context of our users’ workflow,” whereas user testing seeks to answer: “how effective is this design?”
The diagram below provides an overview of user–centered design techniques, highlighting research activities in red.
Young, Indi. 2008. Mental Models: Aligning Design Strategy with Human Behavior. New York: Rosenfeld Media.
As previously mentioned, Design Research is conducted to add context to the design process.
It’s also used to combat the natural tendency to design for ourselves (or our stakeholders) rather than designing for our target audience. Don Norman, cognitive psychologist and author of The Design of Everyday Things, explains: “We tend to project our own rationalisations and beliefs onto the actions and beliefs of others.”
Without design research we tend towards a self–serving, uninformed design process.
The design team is ultimately responsible for analysis of user research. Analysis turns the data collected during research into actionable information. Prominent analysis techniques include (the creation of): personas, mental models, storyboards, nomenclature etc. Although the techniques described here will guide you in conducting research, the presentation and discussion of that data is more important.
Design Research is littered with unanswered questions: How many users should we interview (before we can decisively conclude what’s wrong)? What kind of research should I conduct? Should I conduct qualitative or quantitative research? etc. No one technique or approach is correct. It all depends on the fidelity of the technique and the context in which it is applied.
Back to topHow is user research done?
User Research has the potential to be a sizable undertaking, depending on whether or not the client is iterating on an existing website or commissioning a new one. Regardless, it’s the researcher’s job to explain to their clients what the project’s goals and budget imply for the forthcoming research initiative.
Fortunately, all signs point toward a more casual, habitual approach to user research. Many of today’s practitioners eschew expensive laboratory or field research for rapid behavioral observation.
The following tools and their “plain–English” descriptions are based heavily on the article Can You Say That in English? Explaining UX Research to Clients first run on A List Apart in November, 2009. Although this list is far from comprehensive, it’s enough to get your team started conducting user research.
Non–directed interviews are the best way to develop a design strategy without asking users or stakeholders to spell it out. Simply set up some rough guidelines and converse with your audience—but be sure to focus more on listening.
Contextual inquiry involves observing what people do as they go about their day—not what they say they do. It’s useful for creating a website that supports users’ actual (and not supposed) activities.
Card sorting asks people to explore relationships between content and/or hierarchies in an effort to find commonalities. Card sorting is a super simple way to help people find information more quickly and easily on your website.
More information: Card Sorting: a definitive guide.
On a final note, if you need more comprehensive user research, I highly recommend following Indi Young’s Mental Models.
Back to topHow is user testing done?
As previously mentioned, user testing involves asking potential users of your product or service to complete a (set of) task(s) using a version—ideally a prototype—of your product or service in order to determine its utility and its usability.
Thanks to the Internet, the practice of user testing has seen a dramatic shift over the past few years; despite the fact that it’s less than 50 years old. Nate Bolt and Tony Tulathimutte describe the prevalence of user testing in large organizations in their book Remote Research:
In-person lab research procedures were developed, refined, and standardized, and then became entrenched in the corporate R&D product development cycle. Practically everything gets tested in a lab nowadays: commercial Web sites, professional and consumer software, even video games.
Fortunately, user testing is becoming increasingly prevalent in smaller organizations.
Regardless of where it’s conducted, user testing always follows a similar testing protocol:
- Identify potential users (ideally done during user research, see above)
- Recruit potential users
- Create test guidelines
- Schedule test sessions with potential users
- Administer the test
- Analyze the results
A super–simple method for doing just this is explained in Steve Krug’s new book Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems.
The names of the various methods in which user testing is done depend largely on the relationship of the proctor to the participant:
Lab research describes usability tests conducted in a highly–produced, simulated environment. Researchers typically observe the test behind a one–way mirror and employ screen–capturing software, video cameras, etc. to document the test.
Guerrilla research is a modern, lightweight take on lab research. Instead of renting a lab, guerrilla research is typically done on the spot; users are simply asked to complete basic tasks with a website or service, and the entire operation is recorded for later use.
More information: Watch Steve Krug administer a simple test.
On Bolt|Peters‘ website Remote Usability, they define remote research as
“any kind of research where the user and research moderator aren’t interacting face–to–face.”Remote research is the answer to the increasing cost and hassle of earlier research endeavors juxtaposed with iterative, agile development. Ideally, users are both recruited online and tested online, so that the entire feedback loop is handled at both parties’ convenience.
More information: remoteusability.com.
Back to topDesign research luminaries
The following people have contributed greatly to the field of experience design research. Follow the related links to see what they’re currently up to.
After pioneering and directing the User Experience department at Clear Ink in 1999, which included the construction of Natural Environment and Remote Observation laboratories, Nate co-founded Bolt | Peters. He now serves as el presidente, where he has overseen hundreds of user research studies for Sony, Oracle, HP, Greenpeace, Electronic Arts, and others. Beginning in 2003, he led the creation of the first moderated remote user research software, Ethnio.
Mike Kuniavsky is a user experience design, process, and strategy consultant. He’s created successful and innovative user-centered digital technology for more than twenty years and for dozens of the world’s biggest companies. His typical work involves partnerships with senior level executives who want to create more successful products and a more compelling user experience.
Steve is fascinated by the stuff of a culture—its products, companies, consumers, media, and advertising. All these artifacts and the relationships between them are the rules that define a culture—the stuff makes the culture, but it is the culture that makes the stuff.
Jared founded User Interface Engineering in 1988. He has more than 15 years of experience conducting usability evaluations on a variety of products, and is an expert in low-fidelity prototyping techniques. Jared is on the faculty of the Tufts University Gordon Institute and teaches seminars on product usability. He is a recognized authority on user interface design and human factors in computing.
Indi is an applications and navigation guru who began her work in Web applications in 1995. Her clients range from technology start-ups to large financial institutions. Projects include global corporate intranets, consumer finance and investment tools, enterprise software lead generation sites, knowledge management tools, workflow applications, and business-to-business e-commerce.
Back to topTools of the trade
Much of design research is actually done in a question-and-answer sense; researchers ask questions, record responses, and analyze the results. As a consequence, the tools they use are mostly communicative or illustrative:
While you’re researching users, illustrating ideas, or performing a card sort, consider separating and physically playing with your ideas using sticky notes.
When you don’t want your notes to be sticky, but still want to allow people the flexibility to move them around and play with them, use these. They’re a cheap, worthwhile addition to any research meeting.
Like the other “analog” tools listed here, Moleskines are great for jotting down and exploring ideas with users and stakeholders alike. Invest in a few of these notebooks and then bring them along to any collaborative session.
Flip Video Camera
Although any video camera will do, the Flip is great because its small, lightweight, and convenient. Researchers conducting interviews or contextual observations will quickly put them through their paces. Consider buying a couple (and some tripods) for your team.
Need to get in touch with potential users? If you’ve already tried Twitter or bugged enough of your Facebook friends, consider sourcing users from your existing website using Ethnio. Ethnio works well because it gets users actually in the act of doing something with your website before you ask them questions about their experience.
Spontaneous, unobtrusive usability testing software for designers and developers. Nothing like bringing users to your laptop and asking them for feedback on the spot. Learn more about Silverback.
Back to topRelated Resources
This letter helps prepare research participants for the questions that you might ask of them.
Use this Microsoft Word template to print anything on 3×4 Post-It Notes. For example, copy quotes to the template and print them out for sorting on the wall. Or, during analysis of one transcript, assign one team member the job of typing up the verb+noun phrases you shout out, to print every 10 minutes or so.
EightShapes Unify is a collection of templates, libraries, and other assets that enable user experience designers to create more consistent, effective deliverables faster. Useful for generating documentation after you’ve conducted your research.
A six–page script that walks proctors through administering a hypothetical user test. This is a direct excerpt from Steve Krug’s Rocket Surgery Made Easy.
Another excerpt from Steve Krug’s book, this guide explains what to do in the weeks, days, and hours leading up to guerilla usability tests.
Back to topDesign research books
- Observing the User Experience
- Mental Models
- Remote Research
- Rocket Surgery Made Easy
- Understanding Your Users: A Practical Guide to … User Requirements Methods, Tools, and Techniques
Back to topAdditional resources
- Task–based Audience Segmentation
- Crafting a User Research Plan
- Remote Usability
- Our freely–published website reviews
- Mental Models, book website
- User Research Beyond Usability, a Webinar by Rosenfeld Media
- When to Test and When to Hold Off
- Can You Say That in English? Explaining UX Research to Clients
- Design Research For Everyday Projects — a presentation by Leisa Reichelt
- Information Gathering: A Roundup of UX Applications