Creating Gesture Guidelines for Tablets, Part 1

Apple's iPad

Apple’s multi-touch iPad.

Apple.com

The tablet device market is growing rapidly, with the likes of Samsung, HP and RIM attempting to topple the iPad’s dominance. Yet, with sales expected to top 140 million in 2014, there are no guidelines for gestural tablet interaction that span both applications and platforms.

Why do we need gesture guidelines, anyway?

Well, tablet makers (and now, even desktop makers) are creating different gestures to complete similar actions, to act as an unique selling point for their tablet devices. Yet this hinders the user’s experience of the product. Users should be able to go from platform to platform and utilize their habitual knowledge. They shouldn’t be required to learn different gestures just because they are using a different device.

Moreover, if we look back at the personal computer market 30 years ago, we will notice that the original Macintosh of 1984 doesn’t look all that unfamiliar to the latest generation iMac of this decade. While the graphics have improved and the processors have gotten faster, the fundamentals of personal computing haven’t changed; we are still using the keyboard and mouse in the exact same fashion as we did 30 years ago.

Early Mac

Despite the obvious design evolution, the functionality remains basically the same.

Raneko via Flickr

The standards and guidelines we create today for tablet devices will define the landscape for decades to come. It is therefore pivotal that we get it right.

Interesting findings

During my recent study, I discovered many interesting findings that are apparently being ignored by the current tablet makers. I asked 18 participants to suggest a gesture for 18 commonly used actions. These are some of my findings:

The use of letters and symbols

For many actions, letters and symbols were very popular choices. For example, when asked what gesture they would use when printing a document, many participants drew the letter “P” on the screen. Meanwhile, the Help action was activated by many participants with the “?” symbol.

Example of the P gesture

Example of the “P” gesture

Also of note, many participants relied on letters and symbols as the default gesture for actions that they deemed difficult to represent via a gesture.

Even though the use of letters and symbols can have cultural issues, we can’t dismiss these findings and the overwhelming support for symbolic gestures.

Desktop metaphors

Related to the use of letters and symbols, many of the letters used were based on the desktop metaphors that have been implanted into our memories. The letter ‘C’ was more commonly used for the Copy action rather than the Cut action, mirroring keyboard shortcuts.

Even though I reiterated to participants the multi-touch capability of these modern tablet devices, many relied on a single touch, akin to a single click on a desktop mouse or trackpad.

Users don’t want to relearn basic interaction techniques when they make the move from desktops to tablet devices. They want to make use of their pre-existing knowledge.

Interaction with other objects

Many usability studies are run in a controlled environment, but I decided to allow the participants to choose their testing location. Consumer electronics companies are advertising their tablets with relaxing imagery; people situated in lounges and living rooms while resting their feet on the coffee table. This is the environment I wanted to mimic—testing in an environment where the device would actually be used.

This key tactic revealed some interesting findings that wouldn’t have been discovered in a controlled environment. For example, when I asked one participant what gesture they felt would be suitable for executing the print function, they decided to swipe their finger across the screen towards the physical printer in his bedroom.

This sort of interaction with physical objects has been explored in the field of pervasive computing for over a decade and will play a huge role in the future of technology.

People still struggle

We shouldn’t take the YouTube videos of 2-year-olds and pensioners using iPads too seriously. Although my study didn’t focus on these two extremes, I have noticed a concern amongst the older generation that highlights the intimidating and inaccessible nature of desktop systems still remain for tablet devices – even after use.

If your app or game is going to be used by either the young or the old then make sure you test it with them. If you don’t have the resources to do a proper test then just getting your grandparents or your friends’ children to use your app will reveal some basic findings.

...or cats.

Cats also have trouble adapting.

Credit: Stevelyons

Onwards…

Some might look at this article and say that I want to hinder innovation and creativity. I assure you, that’s not the case. Innovation and creativity underpin our industry, but as Don Norman and Jakob Nielsen recently said, keep the experimentation in the lab.

The second part of this series will discuss how you can conduct a gesture creation study to ensure you correctly select the right gesture/action pairings, so check back Thursday for part two!

Lead image for this article (on UX Booth homepage) courtesy of quinn.anya

About the Author

Thomas Davies

Thomas Davies is currently undertaking the Human-Centred Systems Masters course at City University London. He discover too many products that are simply too difficult to use and hopes that he can help reduce the complexity in this world. You can follow Thomas on Twitter.

Write for UX Booth

Contribute to UX Booth
Contribute

Contribute a guest post to UX Booth and let the community know what's important to you!



Comments

  1. Looking forward to part 2 of your article :-)

    A quick note on gestures and culture: In 2010 the International Usability Partners cunducted a international study with 340 participants in nine countries. Interestingly enough they found no significant differences in the use of gestures to interact with multitouch-devices. Exception: In China people seem to use symbolic gestures (symbols and letters) more often than people in other countries (probably due to their unique writing system).

    • I looked into the IUP report extensively while researching. It was very interesting to note the differences between the Western participating nations and China.

  2. I think the cultural concerns for gesture based controls are probably one of the most interesting areas of research for UXers and sociologists. It’ll probably prove to be a breeding ground of new info concerning the way humans interact with both machines and each other. Hmm…I smell research this evening :)

    • I agree that this is a really interesting field and there’s still many unanswered questions. I would be especially interested in seeing research among people who have no knowledge about computers whatsoever. How do they use tablets? What gestures do they use? How intuitive is an “intuitive” UI to someone who knows nothing about checkboxes and buttons?

  3. I think that the important thing is that tablets present a more natural means to interact. This is an opportunity to think outside the box. What baffles me is (like you said in your post) that tablet makers seem to be too focused in following established keyplayers such as Apple instead of using research from HCI and other fields so as to innovate. Such implementation can give them a leading competitive edge. Well, looking forward for the continuation of this interesting post. Well done Thomas and all the best for your studies.

  4. Rob van Duinen July 20, 2011

    What an interesting read this is. Loved the person in it’s ‘own’ testing area swiping towards the printer. 

    I think there’s really a lot to gain in this area by conducting research on how to achieve the most natural interface with the most sensible gestures in any given context.

    I’m starting my interaction design study next year, and so I hope there will be many more articles like this one in the future, as they really get you thinking.

    Looking forward to part 2!

  5. I’d be curious to see how this industry evolves as the tablet evolves from this generation to the next and so on. What we’ve found in our studies is that users are quick to employ the gestures learned from one tablet maker to the next and are disappointed when they do not get the same results. Although experimenting [should] be kept in “the lab” I applaud your use of real world environments. People feel more at ease in their own environment and therefore we would gain a lot from observing them at their most relaxed with the technology.

  6. Michael Shea July 20, 2011

    Good article. I’m excited to see part II.

Related Posts