Item

Usability Heuristics for Networked Multiplayer Games

Thumbnail Image

Fulltext URI

Document type

Additional Information

Date

2009

Authors

Journal Title

Journal ISSN

Volume Title

Source

Proceedings of the 2009 ACM International Conference on Supporting Group Work

Publisher

Association for Computing Machinery

Abstract

Networked multiplayer games must support a much wider variety of interactions than single-player games because networked games involve communication and coordination between players. This means that designers must consider additional usability issues that relate to group play - but there are currently no usability engineering methods that are specifically oriented towards the needs of multiplayer games. To address this problem, we developed a new set of usability heuristics, called Networked Game Heuristics (NGH), which can be used in the design and evaluation of networked multiplayer games. The new heuristics were identified by analyzing problem reports from 382 reviews of networked PC games, covering six main genres. We aggregated problem reports into ten problem categories (covering issues from session management to cheating to training for novice players) and developed heuristics that describe how these usability problems can be avoided. We tested the new heuristics by having evaluators use them and an existing set to assess the usability of two networked games. Evaluators found more usability problems with NGH, and stated that the new heuristics were better for evaluating multiplayer game usability. Our research is the first to present networked game heuristics that are derived from real problem reports, and the first to evaluate the heuristics' effectiveness in a realistic usability test.

Description

Pinelle, David; Wong, Nelson; Stach, Tadeusz; Gutwin, Carl (2009): Usability Heuristics for Networked Multiplayer Games. Proceedings of the 2009 ACM International Conference on Supporting Group Work. DOI: 10.1145/1531674.1531700. New York, NY, USA: Association for Computing Machinery. pp. 169–178. Sanibel Island, Florida, USA

Keywords

multiplayer games, networked game heuristics, usability, game usability, heuristic evaluation, NGH, networked games

Citation

DOI

10.1145/1531674.1531700

URI

URI

https://dl.eusset.eu/handle/20.500.12015/4868

Collections

GROUP 2009

Endorsement

Review

Supplemented By

Referenced By

Number of citations to item: 49

  • Rosa Yáñez-Gómez, Daniel Cascado-Caballero, José-Luis Sevillano (2016): Academic methods for usability evaluation of serious games: a systematic review, In: Multimedia Tools and Applications 4(76), doi:10.1007/s11042-016-3845-9
  • Ruan Rocha Américo de Souza, Camille N. Santiago Caminha, Marcelo C. Ferreira (2024): A Multidisciplinary Heuristic Evaluation of AI-Enhanced Web Tools: Insights and Implications for Legal Contract Management Systems, In: Lecture Notes in Computer Science, doi:10.1007/978-3-031-60606-9_7
  • Daniela Quiñones, Cristian Rusu (2017): How to develop usability heuristics: A systematic literature review, In: Computer Standards & Interfaces, doi:10.1016/j.csi.2017.03.009
  • Gustavo F. Tondello, Dennis L. Kappen, Marim Ganaba, Lennart E. Nacke (2019): Gameful Design Heuristics: A Gamification Inspection Tool, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-22646-6_16
  • Ian J. Livingston, Regan L. Mandryk, Kevin G. Stanley (2010): Critic-proofing, In: Proceedings of the International Academic Conference on the Future of Game Design and Technology, doi:10.1145/1920778.1920786
  • Janne Paavilainen, Kati Alha, Hannu Korhonen (2012): Exploring Playability of Social Network Games, In: Lecture Notes in Computer Science, doi:10.1007/978-3-642-34292-9_24
  • Tianyi Li, Mihaela Vorvoreanu, Derek Debellis, Saleema Amershi (2023): Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction, In: ACM Transactions on Computer-Human Interaction 5(30), doi:10.1145/3511605
  • Guanyang Liu, Keke Lu (2012): Networked multiplayer cooperative interaction using decoupled motion control method in a shared virtual environment with haptic, visual and movement feedback, In: Computer Animation and Virtual Worlds 2(24), doi:10.1002/cav.1475
  • Magy Seif El-Nasr, Bardia Aghabeigi, David Milam, Mona Erfani, Beth Lameman, Hamid Maygoli, Sang Mah (2010): Understanding and evaluating cooperative games, In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, doi:10.1145/1753326.1753363
  • Janne Paavilainen, Hannu Korhonen, Hannamari Saarenpää (2000): Comparing Two Playability Heuristic Sets with Expert Review Method, In: Advances in Multimedia and Interactive Technologies, doi:10.4018/978-1-60960-774-6.ch002
  • Nilufar Baghaei, David Nandigam, John Casey, Artur Direito, Ralph Maddison (2016): Diabetic Mario: Designing and Evaluating Mobile Games for Diabetes Education, In: Games for Health Journal 4(5), doi:10.1089/g4h.2015.0038
  • Simone Kriglstein, Günter Wallner (2013): A Study on the Use of Adaptive Avatars for Player Lists in Games for Children, In: Proceedings of International Conference on Making Sense of Converging Media, doi:10.1145/2523429.2523440
  • Alex Leavitt, Brian C. Keegan, Joshua Clark (2016): Ping to Win?, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858132
  • Hasiah Mohamed-Omar, R. Yusoff, A. Jaafar (2012): Quantitive analysis in a heuristic evaluation for usability of Educational Computer Game (UsaECG), In: 2012 International Conference on Information Retrieval & Knowledge Management, doi:10.1109/infrkm.2012.6205033
  • Miaoqi Zhu, Xiaowen Fang (2015): A Lexical Approach to Study Computer Games and Game Play Experience via Online Reviews, In: International Journal of Human-Computer Interaction 6(31), doi:10.1080/10447318.2015.1036228
  • Bimal Aklesh Kumar, Munil Shiva Goundar (2019): Usability heuristics for mobile learning applications, In: Education and Information Technologies 2(24), doi:10.1007/s10639-019-09860-z
  • Reham Alhaidary, Shatha Altammami (2017): Can the Success of Mobile Games Be Attributed to Following Mobile Game Heuristics?, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-58559-8_2
  • Minna Hara, Saila Ovaska (2014): Heuristics for motion-based control in games, In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, doi:10.1145/2639189.2639246
  • Carlos Sousa, Carlos J. Costa (2011): Market Game, In: Proceedings of the 2011 Workshop on Open Source and Design of Communication, doi:10.1145/2016716.2016737
  • Miaoqi Zhu, Xiaowen Fang (2014): Introducing a Revised Lexical Approach to Study User Experience in Game Play by Analyzing Online Reviews, In: Proceedings of the 2014 Conference on Interactive Entertainment, doi:10.1145/2677758.2677760
  • Gustavo F. Tondello, Dennis L. Kappen, Elisa D. Mekler, Marim Ganaba, Lennart E. Nacke (2016): Heuristic Evaluation for Gameful Design, In: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts, doi:10.1145/2968120.2987729
  • José Cezar de Souza Filho, Ingrid Teixeira Monteiro, Paulyne Matthews Jucá (2019): Game for aNy heuristic evaluation (G4NHE): a generalization of the G4H gamification considering different sets of usability heuristics, In: Universal Access in the Information Society 3(18), doi:10.1007/s10209-019-00674-x
  • Sarmad Soomro, Wan Fatimah Wan Ahmad, Suziah Sulaiman (2013): Evaluation of Mobile Games Using Playability Heuristics, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-02958-0_25
  • Natalia Jerzak, Francisco Rebelo (2014): Serious Games and Heuristic Evaluation – The Cross-Comparison of Existing Heuristic Evaluation Methods for Games, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-07668-3_44
  • Janne Paavilainen (2010): Critical review on video game evaluation heuristics, In: Proceedings of the International Academic Conference on the Future of Game Design and Technology, doi:10.1145/1920778.1920787
  • Gavin Sim, Brendan Cassidy, Janet C. Read (2013): Understanding the fidelity effect when evaluating games with children, In: Proceedings of the 12th International Conference on Interaction Design and Children, doi:10.1145/2485760.2485769
  • Max Birk, Regan L. Mandryk (2013): Control your game-self, In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, doi:10.1145/2470654.2470752
  • Toshihiko Yamakami (2012): From Gamenics to Servicenics: Lessons Learned in Mobile Social Games in Japan toward Service Engineering, In: 2012 26th International Conference on Advanced Information Networking and Applications Workshops, doi:10.1109/waina.2012.214
  • Charley Gielkens, Richard Wetzel (2012): A Framework for Usability Evaluation of Mobile Mixed Reality Games, In: Lecture Notes in Computer Science, doi:10.1007/978-3-642-33542-6_38
  • Ana Carla Amaro, Ana Isabel Veloso, Lidia Oliveira (2016): Social games and different generations: A heuristic evaluation of Candy Crush Saga, In: 2016 1st International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW), doi:10.1109/tishw.2016.7847791
  • Cheryl Savery, Nicholas Graham (2014): Reducing the negative effects of inconsistencies in networked games, In: Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play, doi:10.1145/2658537.2658539
  • Toshihiko Yamakami (2011): Analysis of Mobile Social Games from the Viewpoint of Gamenics Theory, In: 2011 10th International Conference on Mobile Business, doi:10.1109/icmb.2011.35
  • Natalia Sales Santos, Lidia Silva Ferreira, Raquel Oliveira Prates (2012): An Overview of Evaluation Methods for Collaborative Systems, In: 2012 Brazilian Symposium on Collaborative Systems, doi:10.1109/sbsc.2012.29
  • Zihan Feng (2023): Heuristics for Board Game Usability Testing, In: 2023 IEEE Conference on Games (CoG), doi:10.1109/cog57401.2023.10333187
  • Claudio Cavalcante, Vasco Furtado, Elizabeth Sucupira Furtado (2015): An environment to support the design, implementation and evaluation of gamification in social systems, In: Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, doi:10.1145/3148456.3148480
  • Henry H. Emurian, Gerald C. Canfield, Peter G. Roma, Zabecca S. Brinson, Eric D. Gasior, Robert D. Hienz, Steven R. Hursh, Joseph V. Brady (2000): A Multiplayer Team Performance Task, In: Business, Technological, and Social Dimensions of Computer Games, doi:10.4018/978-1-60960-567-4.ch013
  • Xiaozhou Li, Zheying Zhang, Kostas Stefanidis (2021): A Data-Driven Approach for Video Game Playability Analysis Based on Players’ Reviews, In: Information 3(12), doi:10.3390/info12030129
  • Youngju Sim, Tae-Sun Chung, Inyoung Park (2024): Exploring Cross-Platform Gaming Experiences Through Topic Modeling Analysis, doi:10.2139/ssrn.4772914
  • Simone Borsci, Stefano Federici, Alessio Malizia, Maria Laura De Filippis (2018): Shaking the usability tree: why usability is not a dead end, and a constructive way forward, In: Behaviour & Information Technology 5(38), doi:10.1080/0144929x.2018.1541255
  • Rula Al-azawi, Aladdin Ayesh, Mohaned Al. Obaidy (2013): Generic evaluation framework for games development methodology, In: 2013 Third International Conference on Communications and Information Technology (ICCIT), doi:10.1109/iccitechnology.2013.6579522
  • Mikki H. Phan, Joseph R. Keebler, Barbara S. Chaparro (2016): The Development and Validation of the Game User Experience Satisfaction Scale (GUESS), In: Human Factors: The Journal of the Human Factors and Ergonomics Society 8(58), doi:10.1177/0018720816669646
  • Nor Shahida Mohamad Yusop, John Grundy, Rajesh Vasa (2017): Reporting Usability Defects: A Systematic Literature Review, In: IEEE Transactions on Software Engineering 9(43), doi:10.1109/tse.2016.2638427
  • Josh Aaron Miller, Seth Cooper (2022): Barriers to Expertise in Citizen Science Games, In: CHI Conference on Human Factors in Computing Systems, doi:10.1145/3491102.3517541
  • Rosa Yanez-Gomez, Juan Luis Font, Daniel Cascado-Caballero, José-Luis Sevillano (2018): Heuristic usability evaluation on games: a modular approach, In: Multimedia Tools and Applications 4(78), doi:10.1007/s11042-018-6593-1
  • Grassyara Pinho Tolentino, Claudio Battaglini, Alam Carlos Ventura Pereira, Ricardo Jacó de Oliveria, Marilene Gesiane Mendes de Paula (2011): Usability of Serious Games for Health, In: 2011 Third International Conference on Games and Virtual Worlds for Serious Applications, doi:10.1109/vs-games.2011.33
  • Nathan Partlan, Erica Kleinman, Jim Howe, Sabbir Ahmad, Stacy Marsella, Magy Seif El-Nasr (2021): Design-Driven Requirements for Computationally Co-Creative Game AI Design Tools, In: The 16th International Conference on the Foundations of Digital Games (FDG) 2021, doi:10.1145/3472538.3472573
  • Noah Glaser, Mohan Yang, Shangman Eunice Li, K. Rende Mendoza (2024): The Museum of Instructional Design: an Examination of Learner Experiences & Usability in a Collaborative 3D Virtual Learning Environment, In: TechTrends 2(68), doi:10.1007/s11528-024-00933-6
  • Umair Rehman, Amir Zaib Abbasi, Muhammad Umair Shah, Amna Idrees, Hassan Ilahi, Helmut Hlavacs (2021): Analyzing and Prioritizing Usability Issues in Games, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-77277-2_9
  • Ebba Thora Hvannberg, Gyda Halldórsdóttir, Jan Rudinsky (2012): Exploitation of heuristics for virtual environments, In: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design, doi:10.1145/2399016.2399065
Please note: Providing information about citations is only possible thanks to to the open metadata APIs provided by crossref.org and opencitations.net. These lists may be incomplete due to unavailable citation data.source: opencitations.net, crossref.org