Evaluating the Impact of Usability Components on User Satisfaction in Educational Board Games using the MEEGA+ Framework
Abstract
Conventional instructional methods often fail to achieve significant learning outcomes and user satisfaction, making educational board games (EBGs) a dynamic and engaging alternative. This study aims to analyze the impact of usability components (aesthetics, learnability, and operability) on user satisfaction in EBGs using the MEEGA+ framework. A purposive sampling technique was used to select bachelor’s degree students enrolled in the Personal Financial Planning (PFP) subject. A quantitative study was conducted using self-administered questionnaires, and the data were analyzed using SPSS version 29.0. The findings indicated that usability components (aesthetics, learnability, and operability) significantly influenced user satisfaction in EBGs for PFP students. The study suggests incorporating game-based learning into curricula to enhance understanding and satisfaction. It also highlights the importance of usability components in EBGs, providing a theoretical framework for future research in game theory, cognitive, and pedagogical approaches.
Downloads
References
Ab Rahman, A., Ibrahim, I. H., Abidin, T. M. T. Z., & Fauzi, A. A. M. (2017). Gamification in Islamic education based on global zakat game: bijak zakat version 1.0 (GZG). Al-Qanatir: International Journal of Islamic Studies, 6(1), 1-9.
Anggraeni, L., Affandi, I., Wahyudin, D., Paramitha, S. T., & Ramadhan, M. G. (2022). Optimization of the board game as a platform for the concept of peace education: a survey method study. International Journal of Education in Mathematics, Science and Technology, 10(2), 494–511. DOI: https://doi.org/10.46328/ijemst.2292
Azizan, M. T., Mellon, N., Ramli, R. M., & Yusup, S. (2018). Improving teamwork skills and enhancing deep learning via the development of board games using cooperative learning methods in the Reaction Engineering course. Education for Chemical Engineers, 22, 1-13. DOI: https://doi.org/10.1016/j.ece.2017.10.002
Bangalee, V., Oosthuizen, F., Perumal-Pillay, V. A., Suleman, F., & Walters, F. (2021). Pharmacy student's experience with Pharmacy Phlash-a pilot educational board game. Currents in Pharmacy Teaching and Learning, 13(3), 292-301. DOI: https://doi.org/10.1016/j.cptl.2020.10.016
Barbara, J. 2019. Measuring user experience in multiplayer board games. Games and Culture 2017, 12(7- 8): 623-649. https://doi.org/10.1177/1555412015593419 DOI: https://doi.org/10.1177/1555412015593419
Begy, J. (2017). Board games and the construction of cultural memory. Games and culture, 12(7-8), 718-738. DOI: https://doi.org/10.1177/1555412015600066
Bayeck, R. Y. (2020). Examining board gameplay and learning: a multidisciplinary review of recent research. Simulation and Gaming, 51(4), 411-431. DOI: https://doi.org/10.1177/1046878119901286
Ben Itzhak, N., Franki, I., Jansen, B., Kostkova, K., Wagemans, J. & Ortibus, E. 2023. Usability and user experience of an individualized and adaptive game-based therapy for children with cerebral visual impairment. International Journal of Child-Computer Interaction 35: 100551. https://doi.org/10.1016/j.ijcci.2022.100551 DOI: https://doi.org/10.1016/j.ijcci.2022.100551
Borges, J. B., Juy, C. L., De Andrade Matos, I. S., Angelo Silveira, P. V., Darin, T. de G. R. (2020). Player Experience Evaluation: A Brief Panorama of Instruments and Research Opportunities. Journal on Interactive Systems, 11(1), 74–91, DOI: 10.5753/jis.2020.765. Disponível em: https://sol.sbc.org.br/journals/index.php/jis/article/view/765. DOI: https://doi.org/10.5753/jis.2020.765
Brant, J. M., Haas-Haseman, M. L., Wei, S. H., Wickham, R., & Ponto, J. (2015). Understanding and evaluating survey research. Journal of the Advanced Practitioner in Oncology, 6(2), 168. https://doi.org/10.6004/jadpro.2015.6.2.9 DOI: https://doi.org/10.6004/jadpro.2015.6.2.9
Byusa, E., Kampire, E. & Mwesigye, A.R. 2022. Game-based learning approach on students’ motivation and understanding of chemistry concepts: A systematic review of the literature. Heliyon 8: 09541. https://doi.org/10.1016/j.heliyon.2022.e09541 DOI: https://doi.org/10.1016/j.heliyon.2022.e09541
Calderón, A., & Ruiz, M. (2015). A systematic literature review on serious games evaluation: An application to software project management. Computers & Education, 87, 396-422. DOI: https://doi.org/10.1016/j.compedu.2015.07.011
Cardinot, A., & Fairfield, J. (2022). Game-based learning to engage students with physics and astronomy using a board game. In Research anthology on developments in gamification and game-based learning (pp. 785–801). IGI Global. DOI: https://doi.org/10.4018/978-1-6684-3710-0.ch035
Carter, M., Gibbs, M., & Harrop, M. (2014). Drafting an army: the playful pastime of Warhammer 40,000. Games and Culture, 9(2), 122-147. DOI: https://doi.org/10.1177/1555412013513349
Chang, Y. S., Hu, S. H., Kuo, S. W., Chang, K. M., Kuo, C. L., Nguyen, T. V., & Chuang, Y. H. (2022). Effects of board game play on nursing students’ medication knowledge: a randomized controlled trial. Nurse Education in Practice, 63, 103412. DOI: https://doi.org/10.1016/j.nepr.2022.103412
Chen, K. Z., & Chi, H. H. (2022). Novice young board game players’ experience with computational thinking. Interactive Learning Environments, 30(8), 1375-1387. DOI: https://doi.org/10.1080/10494820.2020.1722712
Christopoulos, A., & Mystakidis, S. (2023). Gamification in education. Encyclopedia, 3(4), 1223–1243. DOI: https://doi.org/10.3390/encyclopedia3040089
Cooke, L. (2016). Metatuning Game Construction Learning: Underrepresented Youths' Designing for Cultural and Social Transformations. Rensselaer Polytechnic Institute.
Crabb, M., & Heron, M. (2023). Communication challenges in social board games. Simulation & Gaming, 10468781231183908. DOI: https://doi.org/10.1177/10468781231183908
Cutumisu, M., Patel, S.D., Brown, M. R. G., Fray, C., von Hauff, P., Jeffery, T., & Schm?lzer, G. M. (2019). RETAIN A board game that improves neonatal resuscitation knowledge retention. Frontiers in Pediatrics, 7(1), 1-7. DOI: https://doi.org/10.3389/fped.2019.00013
Daud, S., Osman, I., Abu Yazid, Z., Md Taib, N., & Mohd Nor, A. (2021). Immersive learner’s usability and experience through VMMBG during COVID-19 pandemic: evidence of a higher educational institution.
Eltahir, M. E., Alsalhi, N. R., Al-Qatawneh, S., AlQudah, H. A., Jaradat, M. (2021). The impact of game-based learning (GBL) on students’ motivation, engagement, and academic performance in an Arabic language grammar course in higher education. Educ. Inf. Technol. 1–28. DOI: https://doi.org/10.1007/s10639-020-10396-w
Ezezika, O., Fusaro, M., Rebello, J., & Aslemand, A. (2023). The pedagogical impact of board games in public health biology education: the Bioracer Board Game. Journal of Biological Education, 57(2), 331–342. DOI: https://doi.org/10.1080/00219266.2021.1909638
Fjaellingsdal, K.S. & Klockner. C.A. (2020). Green across the board: board games as tools for dialogue and simplified environmental communication. Simulation & Gaming 1–21. DOI: https://doi.org/10.1177/1046878120925133
Frost, J. (2017). How to interpret R-squared in regression analysis. Statistics By Jim, 16.
Gilliam, M., Hill B.J., Jaworski, E., Sparrow, A., Jones, I.B., Jagoda, P. (2019). Increasing anti-tobacco industry attitudes among youth: a pilot study of a multiplayer educational board game. Games Health J 8(1), 49-54. https://doi.org/10.1089/g4h.2017.0186. DOI: https://doi.org/10.1089/g4h.2017.0186
Gkogkidis, V., & Dacre, N. (2020, September). Co-creating educational project management board games to enhance student engagement. In European Conference on Games Based Learning (pp. 210-219). Academic Conferences International Limited. DOI: https://doi.org/10.2139/ssrn.3812772
Haoran, G., Bazakidi, E., Zary, N. (2019). Serious games in health professions education: review of trends and learning efficacy. Yearb Med Inform, 28(1):240-248. doi: 10.1055/s-0039-1677904. Epub 2019 Apr 25. PMID: 31022747; PMCID: PMC6697512. DOI: https://doi.org/10.1055/s-0039-1677904
Hendrix, N. M., Hojnoski, R. L., & Missall, K. N. (2020). Promoting numeracy skills through board game play. Young Exceptional Children, 23(2): 100-111. DOI: https://doi.org/10.1177/1096250618814239
Hou, H. T., Wu, C. S., & Wu, C. H. (2023). Evaluation of a mobile-based scaffolding board game developed by the scaffolding-based game editor: analysis of learners’ performance, anxiety, and behavior patterns. Journal of Computers in Education, 10(2), 273-291. DOI: https://doi.org/10.1007/s40692-022-00231-1
Hsieh, H. C. L. (2020). Integration of environmental sustainability issues into the “game design theory and practice” design course. Sustainability, 12(16), 6334. DOI: https://doi.org/10.3390/su12166334
Jansuk, R., & Choochumpang, S. (2022). A development of biology learning activities by using the inquiry method (5E) with using board games to enhance systems thinking of mathayomsuksa 4 students (Doctoral dissertation, Mahasarakham University).
Juan, Y.-K., & Chao, T.-W. (2015). Game-based learning for green building education. Sustainability, 7(5), 5592–5608. DOI: https://doi.org/10.3390/su7055592
Katsaounidou, A., Vrysis, L., Kotsakis, R., Dimoulas, C., & Veglis, A. (2019). MAthE the game: A serious game for education and training in news verification. Education Sciences, 9(2), 155. DOI: https://doi.org/10.3390/educsci9020155
Kontiza, K., Liapis, A., & Jones, C. E. (2020). Reliving the experience of visiting a gallery: Methods for evaluating informal learning in games for cultural heritage. In Proceedings of the 15th International Conference on the Foundations of Digital Games (pp. 1–11). DOI: https://doi.org/10.1145/3402942.3403009
Kurisu, K., Okabe, H., Nakatani, J., & Moriguchi, Y. (2021). Development of board game to encourage life cycle thinking, and trial with university students in Japan. Cleaner and Responsible Consumption, 3, 100033. DOI: https://doi.org/10.1016/j.clrc.2021.100033
Laski, E. V., & Siegler, R. S. (2014). Learning from number board games: you learn what you encode. Developmental Psychology, 50(3), 853-864. DOI: https://doi.org/10.1037/a0034321
Lin, C. L., & Lai, W. W. (2016). A study of educators’ imaginations for board game design. In EDULEARN16 Proceedings (pp. 7432–7441). IATED. DOI: https://doi.org/10.21125/edulearn.2016.0620
Lin, H. C. K., Lin, Y. H., Wang, T. H., Su, L. K., & Huang, Y. M. (2021). Effects of incorporating augmented reality into a board game for high school students Learning motivation and Acceptance in health education. Sustainability, 13(6), 3333. DOI: https://doi.org/10.3390/su13063333
Lo, I.-F., & Chen, C.-H. (2023). Timing of instructional materials and types of gameplay for interdisciplinary learning: A comparative experimental study. Research in Science & Technological Education, 1–18. DOI: https://doi.org/10.1080/02635143.2023.2209842
Machado Leitao, T., Lima Navarro, L. L., Florido Cameira, R., & Silva, E. R. (2021). Serious games in business process management: a systematic literature review. Business Process Management Journal, 27(3), 685-721. DOI: https://doi.org/10.1108/BPMJ-07-2020-0346
Mao W., Cui Y., Chiu M. M. & Lei, H. (2022). Effects of game-based learning on students' critical thinking: a meta-analysis. J. Educ. Comput. Res. 59(8):1682–1708. DOI: https://doi.org/10.1177/07356331211007098
Marques Netto, C. G. C. (2022). Board-game-based online methodology improves student learning and sense of well-being during the COVID-19 Pandemic. Journal of Chemical Education, 99(6), 2310–2316. DOI: https://doi.org/10.1021/acs.jchemed.2c00007
Martindale, R. C., & Weiss, A. M. (2020). Taphonomy: dead and fossilized: A new board game designed to teach college undergraduate students about the process of fossilization. Journal of Geoscience Education, 68(3), 265–285. DOI: https://doi.org/10.1080/10899995.2019.1693217
Martínez-Jiménez, R., Pedrosa-Ortega, C., Licerán-Gutiérrez, A., Ruiz-Jiménez, M. C., & García-Martí, E. (2021). Kahoot! as a tool to improve student academic performance in business management subjects. Sustainability, 13(5), 2969. DOI: https://doi.org/10.3390/su13052969
Martins, J., & Mota, L. (2022). Innovative board game design in an academic environment during the Covid-19 pandemic. In DS 117: Proceedings of the 24th International Conference on Engineering and Product Design Education (E&PDE 2022), London South Bank University in London, UK. 8th-9th September 2022. DOI: https://doi.org/10.35199/EPDE.2022.57
Morais, P., & Silva, A. (2023). The challenge of applying ancient board games to teach accounting in higher education: a case study. In Advances in Tourism, Technology and Systems: Selected Papers from ICOTTS 2022, 2, 303–311). Springer. DOI: https://doi.org/10.1007/978-981-19-9960-4_26
Nunnally, J. C. & Bernstein, I. H. (1994). The assessment of reliability. Psychometric Theory, 3, 248-292
Onofrei, G. & Ferry, P. (2020). Reusable learning objects: a blended learning tool in teaching computer-aided design to engineering undergraduates. International Journal of Educational Management, 0951-354. DOI 10.1108/IJEM-12-2019-0418 DOI: https://doi.org/10.1108/IJEM-12-2019-0418
Petri, G., von Wangenheim, C. G., & Borgatto, A. F. (2016). MEEGA+: an evolution of a model for the evaluation of educational games. INCoD/GQS, 3, 1-40.
Petri, G., von Wangenheim, C.G. & Borgatto, A.F. 2017. MEEGA+, systematic model to evaluate educational games. Encyclopedia of Computer Graphics and Games https://doi.org/10.1007/978-3-319-08234-9_214-1 DOI: https://doi.org/10.1007/978-3-319-08234-9_214-1
Petri, G., Gresse von Wangenheim, C. & A. Ferreti Borgatto, A. (2017). A Large-Scale Evaluation of a Model for the Evaluation of Games for Teaching Software Engineering. 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET), Buenos Aires, Argentina, 2017, pp. 180-189, doi: 10.1109/ICSE-SEET.2017.11. DOI: https://doi.org/10.1109/ICSE-SEET.2017.11
Poole, F., Clarke?Midura, J., Sun, C., & Lam, K. (2019). Exploring the pedagogical affordances of a collaborative board game in a dual language immersion classroom. Foreign Language Annals, 52(4), 753-775. DOI: https://doi.org/10.1111/flan.12425
Razami, H. H., & Ibrahim, R. (2022). Models and constructs to predict students’ digital educational games acceptance: A systematic literature review. Telematics and Informatics, 101874. DOI: https://doi.org/10.1016/j.tele.2022.101874
Qiao, S., Yeung, S. S. S., Zainuddin, Z., Ng, D. T. K., & Chu, S. K. W. (2023). Examining the effects of mixed and non?digital gamification on students' learning performance, cognitive engagement, and course satisfaction. British Journal of Educational Technology 54(1): 394-413. DOI: https://doi.org/10.1111/bjet.13249
Rahimi F. B. & Kim, B. (2021). Learning through redesigning board games in STEM Classroom. Journal of Simulation & Gaming, 52(6), 753-774. DOI: https://doi.org/10.1177/10468781211039260
Ramadhan, A., Hidayanto, A. N., Salsabila, G. A., Wulandari, I., Jaury, J. A., & Anjani, N. N. (2022). The effect of usability on the intention to use the e-learning system sustainably: A case study at Universitas Indonesia. Education and Information Technologies, 27(2), 1489-1522. https://doi.org/10.1007/s10639-021- 10613- DOI: https://doi.org/10.1007/s10639-021-10613-0
Ramos, J. C., L’Erario, A., Mendonça, M., Fabri, J. A., & Palácios, R. H. C. (2023). A board game to improve freshmen on computer networks: Beyond layers abstraction. Education and Information Technologies, 1-25. DOI: https://doi.org/10.1007/s10639-022-11557-9
Rogerson, M. J., Gibbs, M. R., & Smith, W. (2018). Cooperating to compete: the mutuality of cooperation and competition in board game play. In Proceedings of the 2018 CHI conference on human factors in computing systems (193-205). ACM Press. DOI: https://doi.org/10.1145/3173574.3173767
Rogerson, M. J., Sparrow, L. A., & Freeman, S. O. (2022, November). The SMeFT Decks: A Card-Based Ideation Tool for Designing Hybrid Digital Boardgames for Distanced Play. In Proceedings of the 34th Australian Conference on Human-Computer Interaction (pp. 298-309). DOI: https://doi.org/10.1145/3572921.3572933
Sari, R., Fadillah, I., Al Hariri, R., Habibi, M. & Mega, R. (2022). Educational game development is based on role-play games for students with special needs. JTIP, 14(2), 178-184. DOI: https://doi.org/10.24036/jtip.v14i2.445
Savi, R., Gresse von Wangenheim, C., & Borgatto, A. F. (2011). A model for the evaluation of educational games for teaching software engineering. Proc. of the 25th Brazilian Symposium on Software Engineering, 194-203, São Paulo, Brazil (in Portuguese). DOI: https://doi.org/10.1109/SBES.2011.27
Sekaran, U. & Bougie, R. (2013) Research methods for business: a skill-building approach. 6th Edition, Wiley, New York.
Srivastava, A., & Monga, C. (2023). Traditional gameplay with self-learning support for k-12 curriculum. In International Conference on Research into Design (pp. 613–623). Springer. DOI: https://doi.org/10.1007/978-981-99-0428-0_50
Sun, K. (2023). Foraging Island: A Board Game to Foster Social Skills Development and Encourage Interactions Among Youth with Social Challenges (Doctoral dissertation, Pratt Institute).
Swab, R. G., Cogan, A., Pret, T., & Marshall, D. R. (2021). Examining the creative self-efficacy, goal interdependence, and satisfaction of new venture teams in the board game industry. Entrepreneurship Research Journal, (0), 000010151520210142. DOI: https://doi.org/10.1515/erj-2021-0142
Tadayon, M., & Pottie, G.J. 2020. Predicting student performance in an educational game using a hidden Markov model. IEEE Transactions on Education, 3(4): 299-304. DOI: https://doi.org/10.1109/TE.2020.2984900
Tan, J. W., Ng, K. B., & Mogali, S. R. (2022). An exploratory digital board game approach to the review and reinforcement of complex medical subjects like anatomical education: cross-sectional and mixed methods study. JMIR Serious Games, 10(1), e33282. DOI: https://doi.org/10.2196/33282
Tsortanidou, X., Daradoumis, T., & Barberá, E. (2021). A K-6 computational thinking curricular framework: pedagogical implications for teaching practice. Interactive Learning Environments, 1–21. DOI: https://doi.org/10.1080/10494820.2021.1986725
Vasconcelos, L., Sousa, M., Ferreira, F., & Pinheiro, J. (2022). Collaborating: modern board games and collaboratories as a tool for capacity building. SN Social Sciences, 2(9), 190. DOI: https://doi.org/10.1007/s43545-022-00472-y
Vecchio, L. P., & Greco, A. Del. (2023). Game-Based Solutions and the Plastic Problem: A Systematic Review. Sustainability, 15(6), 5558. DOI: https://doi.org/10.3390/su15065558
Vlachopoulos, P., Jan, S.K., & Buckton, R. (2020). A case for team-based learning as an effective collaborative learning methodology in higher education. College Teaching, 69(2): 69-77. DOI: https://doi.org/10.1080/87567555.2020.1816889
Wai, J., & Tran, B. (2022). Student characteristics, institutional factors, and outcomes in higher education and beyond An analysis of standardized test scores and other factors at the institutional level with school rankings and salary. Journal of Intelligence, 10(2), 22 DOI: https://doi.org/10.3390/jintelligence10020022
Wang, L.-L., & Lee, I.-J. (2022). A Preliminary Study on the Application of Tangible User Interface and Augmented Reality Technology with Table Game and Hand-Eye Coordination Operation Tasks in the Fields of Memory and Visuospatial Perception for the Elderly. In International Conference on Human-Computer Interaction (pp. 277–289). Springer. DOI: https://doi.org/10.1007/978-3-031-05654-3_19
Wang, X., Cheng, M., & Li, X. (2023). Teaching and learning computational thinking through game-based learning: a systematic review. Journal of Educational Computing Research, 61(7), 1505-1536. DOI: https://doi.org/10.1177/07356331231180951
Wang, Y., Zhang, S., & Hong, H. (2023). Research on the construction of the evaluation index system of game-based teaching. Frontiers in Psychology, 14, 1177160. DOI: https://doi.org/10.3389/fpsyg.2023.1177160
Wehrle, R., Wiens, M., & Schultmann, F. (2022). Application of collaborative serious gaming for the elicitation of expert knowledge and towards creating Situation Awareness in the field of infrastructure resilience. International Journal of Disaster Risk Reduction, 67, 102665. https://doi.org/10.1016/j.ijdrr.2021.102665. DOI: https://doi.org/10.1016/j.ijdrr.2021.102665
Wong, T.W. 2018. Teaching innovations in Asian higher education: perspectives of educators. Asian Association of Open Universities Journal 13(2): 179-190 DOI 10.1108/AAOUJ-12-2018-0032 DOI: https://doi.org/10.1108/AAOUJ-12-2018-0032
Xinogalos, S. & Satratzemi, M. (2022). The Use of Educational Games in Programming Assignments: SQL Island as a Case Study. Appl. Sci., 12, 6563. https://doi.org/10.3390/app12136563 DOI: https://doi.org/10.3390/app12136563
Yang D. & Kopcha T.D. (2022). Designing a board game for beginning block-based programmers. International journal of design for learning, 13(1), 35-45. DOI: https://doi.org/10.14434/ijdl.v13i1.32211
Yannakakis, G. N. & Togelius, J. (2018). Game AI panorama. Artificial Intelligence and Games, 259-277. DOI: https://doi.org/10.1007/978-3-319-63519-4_6
Copyright (c) 2024 SHAHREENA DAUD, ZARINAH ABU YAZID, NORRAEFFA MD TAIB, MOHD ZAILANI OTHMAN, IDRIS OSMAN
This work is licensed under a Creative Commons Attribution 4.0 International License.
Author (s) should affirm that the material has not been published previously. It has not been submitted and it is not under consideration by any other journal. At the same time author (s) need to execute a publication permission agreement to assume the responsibility of the submitted content and any omissions and errors therein. After submission of revised paper in the light of suggestions of the reviewers, the editorial team edits and formats manuscripts to bring uniformity and standardization in published material.
This work will be licensed under Creative Commons Attribution 4.0 International (CC BY 4.0) and under condition of the license, users are free to read, copy, remix, transform, redistribute, download, print, search or link to the full texts of articles and even build upon their work as long as they credit the author for the original work. Moreover, as per journal policy author (s) hold and retain copyrights without any restrictions.
