Heuristic Evaluation for Mobile Applications: Extending a Map of the Literature

Ensuring that mobile applications are as usable as possible is an important area of Human-Computer Interaction research. Part of that research effort is to consider how traditional, tried-and-tested usability evaluation approaches might be applied to newer technologies, including mobile applications. The contribution of this work is to further the work of other researchers by discovering if heuristic evaluation is commonly applied to mobile applications by Human-Computer Interaction practitioners. Additionally, the authors empirically test the suggestion that Nielsen’s heuristics may be generic enough for the usability evaluation of mobile applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic €32.70 /Month

Buy Now

Price includes VAT (France)

eBook EUR 287.83 Price includes VAT (France)

Softcover Book EUR 369.24 Price includes VAT (France)

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

Mobile Application Usability: Heuristic Evaluation and Evaluation of Heuristics

Chapter © 2016

Heuristic Evaluation of Mobile Usability: A Mapping Study

Chapter © 2014

Smartphone Application Usability Evaluation: The Applicability of Traditional Heuristics

Chapter © 2015

References

  1. Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1990), Seattle, WA, USA, 1–5 April (1990) Google Scholar
  2. Maguire, M.: Methods to support human-centred design. Int. J. Hum.-Comput. Stud. 55(4), 587–634 (2001) ArticleGoogle Scholar
  3. Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1992), Monterey, California, 3–7 June (1992) Google Scholar
  4. Dicks, S.: Mis-usability: on the uses and misuses of usability testing. In: Proceedings of the 20th International Conference on Systems Documentations (SIGDOC 2002), Toronto, ON, Canada, 20–23 October (2002) Google Scholar
  5. Jeffries, R., Miller, J., Wharton, C., Uyeda, K.: User interface evaluation in the real world: a comparison of four techniques. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 91), New Orleans, LA, USA, April 27–May 2 (1991) Google Scholar
  6. Bernhaupt, R., Mihalic, K., Obrist, M.: Usability evaluation methods for mobile applications. In: Handbook of Research on User Interface Design and Evaluation for Mobile Technology, vol. 44, pp. 745–758 (2008) Google Scholar
  7. Baharuddin, R., Singh, D., Razali, R.: Usability dimensions for mobile applications—a review. Res. J. Appl. Sci. Eng. Technol. 5(6), 2225–2231 (2013) Google Scholar
  8. Weiss, S.: Handheld Usability. Wiley, Hoboken (2003) Google Scholar
  9. Ji, Y.G., Park, J.H., Lee, C., Yun, M.H.: A usability checklist for the usability evaluation of mobile phone user interface. Int. J. Hum.-Comput. Interact. 20(3), 207–231 (2006) ArticleGoogle Scholar
  10. Bertini, E., Gabrielli, S., Kimani, S.: Appropriating and assessing heuristics for mobile computing. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2006), Venezia, Italy, 23–26 May (2006) Google Scholar
  11. Joyce, G., Lilley, M.: Towards the development of usability heuristics for native smartphone mobile applications. In: Proceedings of the 16th International Conference on Human-Computer Interaction (HCII2014), Heraklion, Crete, Greece, 22–27 June (2014) Google Scholar
  12. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.A.: Developing SMASH: a set of SMArtphone’s uSability Heuristics. Comput. Stand. Interfaces 43, 40–52 (2016) ArticleGoogle Scholar
  13. Salgado, A., Freire, A.: Heuristic evaluation of mobile usability: a mapping study. In: Proceedings of the International Conference on Human-Computer Interaction, pp. 178–188, June 22 (2014) Google Scholar
  14. Salgado, A., Rodrigues, S., Fortes, R.: Evolving heuristic evaluation for multiple contexts and audiences: perspectives from a mapping study. In: Proceedings of the 34th ACM International Conference on the Design of Communications, p. 19. ACM (2016) Google Scholar
  15. Scriven, M.: The logic and methodology of checklists (2005). http://preval.org/documentos/2075.pdf. Accessed 20 Feb 2016
  16. Gould, J., Lewis, C.: Designing for usability: key principles and what designers think. Commun. ACM 28(3), 300–311 (1985) ArticleGoogle Scholar
  17. Quinn, C.N.: Pragmatic evaluation: lessons from usability. In: Proceedings of the 13th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE 1996), Adelaide, Australia, 2–4 December (1996) Google Scholar
  18. Smith, S.: Standards versus guidelines for designing user interface software. Behav. Inf. Technol. 5(1), 47–61 (1986) ArticleGoogle Scholar
  19. Gerhardt-Powals, J.: Cognitive engineering principles for enhancing human-computer performance. Int. J. Hum.-Comput. Interact. 8(2), 189–211 (1996) ArticleGoogle Scholar
  20. Hollingsed, T., Novick, D.G.: Usability inspection methods after 15 years of research and practice. In: Proceedings of the 25th annual ACM international conference on Design of communication, (SIGDOC 2007), El Paso, Texas, USA, 22–24 October (2007) Google Scholar
  21. Jeffries, R., Desurvire, H.: Usability testing vs. heuristic evaluation: was there a contest? ACM SIGCHI Bull. 24(4), 39–41 (1992) ArticleGoogle Scholar
  22. Kirmani, S., Rajasekaran, S.: Heuristic evaluation quality score (HEQS): a measure of heuristic evaluation skills. J. Usability Stud. 2(2), 61–75 (2007) Google Scholar
  23. Wilson, C.: User Interface Inspection Methods: A User-Centered Design Method. Morgan Kaufmann, Burlington (2013) Google Scholar
  24. Law, E.L.C., Hvannberg, E.T.: Analysis of strategies for improving and estimating the effectiveness of heuristic evaluation. In: Proceedings of the 3rd Nordic conference on Human-Computer Interaction (NordiCHI 2004), Tampere, Finland, 23–27 October (2004) Google Scholar
  25. Nielsen, J.: 10 Usability Heuristics for User Interface Design (1995). http://www.nngroup.com/articles/ten-usability-heuristics/. Accessed 25 Sept 2015
  26. Beck, E., Christiansen, M., Kjeldskov, J., Kolbe, N., Stage, J.: Experimental evaluation of techniques for usability testing of mobile systems in a laboratory setting. In: Proceedings of the New Directions in Interaction: Information Environments, Media and Technology Conference (Ozchi 2003), Brisbane, Australia (2003) Google Scholar
  27. Ketola, P., Röykkee, M.: The three facets of usability in mobile handsets. In: Workshop at Mobile Communications: Understanding Users, Adoption & Design (CHI 2001), Seattle, Washington, USA, 31 March–5 April (2001) Google Scholar
  28. Po, S., Howard, S., Vetere, F., Skov, M.B.: Heuristic evaluation and mobile usability: bridging the realism gap. In: Proceedings of the 6th International Symposium of Mobile Human-Computer Interaction (MobileHCI 2004), Glasgow, UK, 13–16 September (2004) Google Scholar
  29. Kuzel, A.: Sampling in qualitative inquiry. In: Benjamin F. Crabtree, William L. Miller (eds.) Doing Qualitative Research (2nd edn.), pp. 33–45. Sage Publications (1992) Google Scholar
  30. Creswell, J.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Sage Publications, Thousand Oaks (2013) Google Scholar
  31. UXPA.: User Experience Professionals Association Conference, Boston, Massachusetts, 15 May 2015 (2015) Google Scholar
  32. Ritchie, J., Lewis, J.: Qualitative Research Practice: A Guide for Social Science Students and Researchers. Sage Publications, Thousand Oaks (2013) Google Scholar
  33. Gale, N., Heath, G., Cameron, E., Rashid, S., Redwood, S.: Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med. Res. Methodol. 13(1), 117 (2013) ArticleGoogle Scholar
  34. Blaxter, L.: How to Research. McGraw-Hill Education, Maidenhead (2010) Google Scholar
  35. Wharton, C., Lewis, C.: The role of psychological theory in usability inspection methods. In: Usability Inspection Methods, pp. 341–350 (1994) Google Scholar
  36. Joyce, G., Lilley, M., Barker, T., Jefferies, A.: Mobile application usability: heuristic evaluation and evaluation of heuristics. In: Advances in Human Factors, Software, and Systems Engineering, pp. 77–86 (2016) Google Scholar
  37. Field, A.: Discovering Statistics using IBM SPSS Statistics, 4th edn. SAGE Publications, Thousand Oaks (2013) Google Scholar
  38. Faul, F., Erdfelder, E., Buchner, A., Lang, A.G.: Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160 (2009) ArticleGoogle Scholar
  39. Vacha-Haase, T., Thompson, B.: How to estimate and interpret various effect sizes. J. Couns. Psychol. 51(4), 473 (2004) ArticleGoogle Scholar
  40. Durlak, J.A.: How to select, calculate, and interpret effect sizes. J. Pediatr. Psychol. 34(9), 917–928 (2009) ArticleGoogle Scholar
  41. Joyce, G., Lilley, M., Barker, T., Jefferies, A.: Mobile application tutorials: perception of usefulness from an HCI expert perspective. In: Proceedings of the International Conference on Human-Computer Interaction (HCII2016), pp. 302–308. Springer International Publishing (2016) Google Scholar
  42. Martin, K., Shilton, K.: Putting mobile application privacy in context: an empirical study of user privacy expectations for mobile devices. Inf. Soc. 32(3), 200–216 (2016) ArticleGoogle Scholar

Author information

Authors and Affiliations

  1. School of Computer Science, University of Hertfordshire, College Lane, Hatfield, Hertfordshire, AL10 9AB, UK Ger Joyce, Mariana Lilley, Trevor Barker & Amanda Jefferies
  1. Ger Joyce