Inter- and Intrarater Reliability Using Different Software Versions of E4D Compare in Dental Education

Journal of Dental Education

Volumn 79, Issue 6, 2015, Pages 711-718

  Callan, Richard S ^a   Cooper, Jeril R ^a   Young, Nancy B ^a   Mollica, Anthony G ^a   Furness, Alan R ^a   Looney, Stephen W ^b  

^a AUGUSTA UNIVERSITY   (United States)

^b MEDICAL COLLEGE OF GEORGIA   (United States)

Author keywords

assessment; CAD CAM; dental education; grading; interrater reliability; intrarater reliability

Indexed keywords

COMPARATIVE STUDY; COMPUTER AIDED DESIGN; COMPUTER PROGRAM; DENTAL EDUCATION; DENTAL SURGERY; DEVICES; EDUCATION; EDUCATIONAL TECHNOLOGY; FEEDBACK SYSTEM; HUMAN; PROCEDURES; REPRODUCIBILITY; STANDARDS; TOOTH CROWN;

COMPUTER-AIDED DESIGN; CROWNS; DENTISTRY, OPERATIVE; EDUCATION, DENTAL; EDUCATIONAL MEASUREMENT; EDUCATIONAL TECHNOLOGY; FACULTY, DENTAL; FEEDBACK; HUMANS; REPRODUCIBILITY OF RESULTS; SELF-EVALUATION PROGRAMS; SOFTWARE; TOOTH PREPARATION, PROSTHODONTIC;

EID: 84938881337     PISSN: 00220337     EISSN: 19307837     Source Type: Journal    
DOI: 10.1002/j.0022-0337.2015.79.6.tb05945.x     Document Type: Article

References (32)

1. Haj-Ali R., Feil P. Rater reliability: short- and long-term effects of calibration training. J Dent Educ 2006; 70 (4): 428–33.
2. Mackenzie R.S., Antonson D.E., Weldy P.L. et al. Analysis of disagreement in the evaluation of clinical products. J Dent Educ 1982; 46 (5): 284–9.
3. Renne W.G., McGill S.T., Mennito A.S. et al. E4D Compare software: an alternative to faculty grading in dental education. J Dent Educ 2013; 77 (2): 168–75.
4. Reed T.R., Feil P.H., Greer D.E. The reliability and agreement of subtask assessments. J Dent Educ 1988; 52 (10): 554–7.
5. Sharaf A.A., AbdelAziz A.M., El Meligy O.A. Intra- and inter-examiner variability in evaluating preclinical pediatric dentistry operative procedures. J Dent Educ 2007; 71 (4): 540–4.
6. O’Connor P., Lorey R.E. Improving interrater agreement in evaluation in dentistry by the use of comparison stimuli. J Dent Educ 1978; 42 (4): 174–9.
7. Vann W.F., Machen J.B., Hounshell P.B. Effects of criteria and checklists on reliability in preclinical evaluation. J Dent Educ 1983; 47 (10): 671–5.
8. Morrow J.A., Pulido M.T., Smith P.B. et al. Effective use of e-grading in the dental simulation clinic. J Dent Educ 2014; 78 (6): 829–37.
9. Cardoso J.A., Barbosa C., Fernandes S. et al. Reducing subjectivity in the evaluation of preclinical dental preparations for fixed prosthodontics using the Kavo PrepAssistant. Eur J Dent Educ 2006; 10 (3): 149–56.
10. Chambers D.W., LaBarre E.E. Why professional judgment is better than objective description in dental faculty evaluations of student performance. J Dent Educ 2014; 78 (5): 681–93.
11. Navazesh M., Rich S.K., Chopiuk N.B., Keim R.G. Triple jump examinations for dental student assessment. J Dent Educ 2013; 77 (10): 1315–20.
12. Callan R.S., Blalock J.S., Cooper J.R. et al. Reliability of CAD/CAM technology in assessing crown preparations in a preclinical dental school environment. J Dent Educ 2014; 78 (1): 40–50.
13. Gadbury-Amoyt C.C., Williams B.J., Van Ness C.J. Using tablet technology and instructional videos to enhance preclinical dental laboratory learning. J Dent Educ 2014; 78 (2): 250–8.
14. Arnetzl G., Dornhofer R. PREPassistant: a system for evaluating tooth preparations. Int J Comput Dent 2004; 7 (2): 187–97.
15. Cox M.J., Schleyer T., Johnson L.A. et al. Making a mark: taking assessment to technology. Br Dent J 2008; 205 (1): 33–9.
16. Kournetas N., Jaeger B., Axmann D. et al. Assessing the reliability of a digital preparation assistant system used in dental education. J Dent Educ 2004; 68 (12): 1228–34.
17. Welk A., Splieth C., Rosin M. et al. DentSim: a future teaching option for dentists. Int J Comput Dent 2004; 7 (2): 123–30.
18. Urbankova A. Impact of computerized dental simulation training on preclinical operative dentistry examination scores. J Dent Educ 2010; 74 (4): 402–9.
19. Konukseven E.I., Onder M.E., Mumcuoglu E., Kisnisci R.S. Development of a visiohaptic integrated dental training simulation system. J Dent Educ 2010; 74 (8): 880–91.
20. Mackenzie R.S. Defining clinical competence in terms of quality, quantity, and need for performance criteria. J Dent Educ 1973; 37 (9): 37–44.
21. Knight G.W., Guenzel P.J. Discrimination training and formative evaluation for remediation in basic waxing skills. J Dent Educ 1990; 54 (3): 194–8.
22. Knight G.W., Guenzel P.J., Fitzgerald M. Teaching recognition skills to improve products. J Dent Educ 1990; 54 (12): 739–42.
23. Devigus A. Practice makes perfect. Eur J Esthet Dent 2006; 1 (1): 5–6.
24. Quimby M.L., Vig K.W., Rashid R.G., Firestone A.R. The accuracy and reliability of measurements made on computer-based digital models. Angle Orthod 2004; 74 (3): 298–303.
25. E4D Compare user manual. Richardson, TX: E4D Technologies, LLC, 2012.
26. Gilder K., Tian L., Cappelleri J.C., Hanumara R.C. Confidence intervals on intraclass correlation coefficients in a balanced two-factor design. J Stat Plan Inference 2007; 1199–212.
27. Morton R.F., McCarter R.J. A study guide to epidemiology and biostatistics. Gaithersburg, MD: Aspen Publishers, 1996: 92.
28. Ende J. Feedback in clinical medical education. JAMA 1983; 250 (6): 777–81.
29. Gunderman R.B. Ingredients of successful medical student teaching. Am J Roentgenol 2004; 182 (5): 1115–7.
30. Feil P.H., Reed T., Hart J.K. Continuous knowledge of results and psychomotor skill acquisition. J Dent Educ 1986; 50 (6): 300–3.
31. Feil P.H., Reed T. The effect of knowledge of the desired outcome on dental motor performance. J Dent Educ 1988; 52 (4): 198–201.
32. Feil P.H. A theory of motor performance and its applications to preclinical dental skill acquisition. J Dent Educ 1989; 53 (4): 226–32.