How to systematically assess serious games applied to health care

JMIR Serious Games

Volumn 2, Issue 2, 2014, Pages

  Graafland, Maurits ^a   Dankbaar, Mary ^b   Mert, Agali ^c   Lagro, Joep ^d   De Wit Zuurendonk, Laura ^e   Schuit, Stephanie ^b   Schaafstal, Alma ^f   Schijven, Marlies ^a  

^a ACADEMIC MEDICAL CENTER   (Netherlands)

^b ERASMUS MEDICAL CENTER   (Netherlands)

^c Center for Augmented Motor Learning and Training   (Netherlands)

^d HAGA HOSPITAL   (Netherlands)

^e MÁXIMA MEDICAL CENTER   (Netherlands)

^f WINDESHEIM UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

Author keywords

Applied game; Consensus; Mobile health; Serious game; Telehealth; Video game

Indexed keywords

EID: 84941915631     PISSN: None     EISSN: 22919279     Source Type: Journal    
DOI: 10.2196/games.3825     Document Type: Review

References (32)

1. Kueider AM, Parisi JM, Gross AL, Rebok GW. Computerized cognitive training with older adults: A systematic review. PLoS One 2012; 7(7):e40588 [FREE Full text] [doi: 10.1371/journal.pone.0040588] [Medline: 22792378]
2. Gamito P, Oliveira J, Lopes P, Brito R, Morais D, Silva D, et al. Executive functioning in alcoholics following an mHealth cognitive stimulation program: Randomized controlled trial. J Med Internet Res 2014; 16(4):e102 [FREE Full text] [doi: 10.2196/jmir.2923] [Medline: 24742381]
3. Prange GB, Kottink AI, Buurke JH, Eckhardt MM, van Keulen-Rouweler BJ, Ribbers GM, et al. The Effect of Arm Support Combined With Rehabilitation Games on Upper-Extremity Function in Subacute Stroke: A Randomized Controlled Trial. Neurorehabil Neural Repair 2014 May 29. [doi: 10.1177/1545968314535985] [Medline: 24878589]
4. Majumdar D, Koch PA, Lee H, Contento IR, Islas-Ramos AD, Fu D. "Creature-101": A Serious Game to Promote Energy Balance-Related Behaviors Among Middle School Adolescents. Games Health J 2013 Oct; 2(5):280-290 [FREE Full text] [doi: 10.1089/g4h.2013.0045] [Medline: 24761326]
5. Cooper H, Cooper J, Milton B. Technology-based approaches to patient education for young people living with diabetes: A systematic literature review. Pediatr Diabetes 2009 Nov; 10(7):474-483. [doi: 10.1111/j.1399-5448.2009.00509.x] [Medline: 19490492]
6. Read JL, Shortell SM. Interactive games to promote behavior change in prevention and treatment. JAMA 2011 Apr 27; 305(16):1704-1705. [doi: 10.1001/jama.2011.408] [Medline: 21447802]
7. Kato PM, Cole SW, Bradlyn AS, Pollock BH. A video game improves behavioral outcomes in adolescents and young adults with cancer: A randomized trial. Pediatrics 2008 Aug; 122(2):e305-e317 [FREE Full text] [doi: 10.1542/peds.2007-3134] [Medline: 18676516]
8. Graafland M, Schraagen JM, Schijven MP. Systematic review of serious games for medical education and surgical skills training. Br J Surg 2012 Oct; 99(10):1322-1330. [doi: 10.1002/bjs.8819] [Medline: 22961509]
9. Buttussi F, Pellis T, Cabas Vidani A, Pausler D, Carchietti E, Chittaro L. Evaluation of a 3D serious game for advanced life support retraining. Int J Med Inform 2013 Sep; 82(9):798-809. [doi: 10.1016/j.ijmedinf.2013.05.007] [Medline: 23763908]
10. Lagro J, van de Pol MH, Laan A, Huijbregts-Verheyden FJ, Fluit LC, Olde Rikkert MG. A Randomized Controlled Trial on Teaching Geriatric Medical Decision Making and Cost Consciousness With the Serious Game GeriatriX. J Am Med Dir Assoc 2014 Jun 6. [doi: 10.1016/j.jamda.2014.04.011] [Medline: 24913210]
11. Forsberg A, Nilsagård Y, Boström K. Perceptions of using videogames in rehabilitation: A dual perspective of people with multiple sclerosis and physiotherapists. Disabil Rehabil 2014 May 16:1-7. [doi: 10.3109/09638288.2014.918196] [Medline: 24833535]
12. Graafland M, Vollebergh MF, Lagarde SM, van Haperen M, Bemelman WA, Schijven MP. A Serious Game Can Be a Valid Method to Train Clinical Decision-Making in Surgery. World J Surg 2014 Aug 27. [doi: 10.1007/s00268-014-2743-4] [Medline: 25159118]
13. van Velsen L, Beaujean DJ, van Gemert-Pijnen JE. Why mobile health app overload drives us crazy, and how to restore the sanity. BMC Med Inform Decis Mak 2013; 13:23 [FREE Full text] [doi: 10.1186/1472-6947-13-23] [Medline: 23399513]
14. Connolly TM, Boyle EA, MacArthur E, Hainey T, Boyle JM. A systematic literature review of empirical evidence on computer games and serious games. Computers & Education 2012 Sep; 59(2):661-686. [doi: 10.1016/j.compedu.2012.03.004]
15. Kotz D. A threat taxonomy for mHealth privacy. In: Crowcroft J, Manjunath D, Misra A. editors Third International Conference on Communication Systems and Networks (COMSNETS 2011).: IEEE; 2011 Presented at: Third International Conference on Communication Systems and Networks; 2011; New York, NY p. 1. [doi: 10.1109/COMSNETS.2011.5716518]
16. Dutch Society for Simulation in Healthcare. Official Website Internet. DSSH official website 2014:2014.
17. Lewis TL. A systematic self-certification model for mobile medical apps. J Med Internet Res 2013; 15(4):e89 [FREE Full text] [doi: 10.2196/jmir.2446] [Medline: 23615332]
18. Albrecht UV. Transparency of health-apps for trust and decision making. J Med Internet Res 2013; 15(12):e277 [FREE Full text] [doi: 10.2196/jmir.2981] [Medline: 24449711]
19. Journal of Medical Internet Research (JMIR). 2014. Apps Peer-Review launched InternetURL: http://mhealth.jmir.org/announcement/view/67 [accessed 2014-11-04] [WebCite Cache ID 6TpSDiKIJ]
20. Michael DR, Chen S. Serious Games: Games That Educate, Train, and Inform. Boston, MA: Course Technology PTR; 2006.
21. Jalink MB, Goris J, Heineman E, Pierie JP, ten Cate Hoedemaker HO. Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills. Surg Endosc 2014 Feb; 28(2):537-542. [doi: 10.1007/s00464-013-3199-6] [Medline: 24061627]
22. Badurdeen S, Abdul-Samad O, Story G, Wilson C, Down S, Harris A. Nintendo Wii video-gaming ability predicts laparoscopic skill. Surg Endosc 2010 Aug; 24(8):1824-1828. [doi: 10.1007/s00464-009-0862-z] [Medline: 20108147]
23. SCORM. SCORM Explained InternetURL: http://scorm.com/scorm-explained/[accessed 2014-11-04] [WebCite Cache ID 6TpSOWvl4]
24. Anderson LW, Krathwohl DR, Bloom B. A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. New York, NY: Longman; 2001.
25. Van Staalduinen JP, de Freitas S. A Game-Based Learning Framework: Linking Game DesignLearning Outcomes. In: Khine MS, editor. Learning to Play. New York, NY: Peter Lang Publishing, Inc; 2011:29.
26. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999.
27. Schijven MP, Jakimowicz JJ. Validation of virtual reality simulators: Key to the successful integration of a novel teaching technology into minimal access surgery. Minim Invasive Ther Allied Technol 2005; 14(4):244-246. [doi: 10.1080/13645700500221881] [Medline: 16754170]
28. Gallagher AG, Ritter EM, Satava RM. Fundamental principles of validation, and reliability: Rigorous science for the assessment of surgical education and training. Surg Endosc 2003 Oct; 17(10):1525-1529. [doi: 10.1007/s00464-003-0035-4] [Medline: 14502403]
29. Cook DA, Zendejas B, Hamstra SJ, Hatala R, Brydges R. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ Theory Pract 2014 May; 19(2):233-250. [doi: 10.1007/s10459-013-9458-4] [Medline: 23636643]
30. Health on the Net Foundation Code of Conduct (HONcode). Operational definition of the HONcode principles InternetURL: http://www.hon.ch/HONcode/Webmasters/Guidelines/guidelines.html [accessed 2014-11-04] [WebCite Cache ID 6TpScFyun]
31. Bellotti F, Kapralos B, Lee K, Moreno-Ger P, Berta R. Assessment in and of Serious Games: An Overview. Advances in Human-Computer Interaction 2013; 2013:1-11. [doi: 10.1155/2013/136864]
32. Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006 Feb; 119(2):166.e7-166.16. [doi: 10.1016/j.amjmed.2005.10.036] [Medline: 16443422]