Applying the Nedelsky Method to Determine Passing Scores for End-of-Course Examinations in Dentistry
Main Article Content
Abstract
This research establishes a scientifically defensible passing score for the Oral and Maxillofacial Pathology final examination for dental students at Van Lang University by using the Nedelsky method. Five experts independently reviewed a 50-item multiple-choice test to identify distractors that a minimally competent candidate (MCC) could reasonably eliminate. The Minimum Passing Level (MPL) was calculated by averaging these expert estimates and subsequently applied to the examination results of 132 students. Student scores followed a normal distribution (p = 0.525), with an overall mean of 5.4 ± 1.3. The panel established an MPL of 52.4%, requiring at least 27 correct answers to pass. Compared to arbitrary fixed thresholds of 40% and 50%, the student pass rate decreased from 87.9% and 67.4%, respectively, to 52.3%. Twenty students - 15.2% of the cohort and 22.5% of those passing under the 50% threshold - were reclassified as borderline, indicating that they did not meet the competence level expected by the expert panel. The Nedelsky method created a higher passing standard based on student competence rather than convention. These results support adopting criterion-referenced methods to ensure assessments are fair and consistent with competency-based dental education.
Keywords
competency-based assessment, dental education, Nedelsky method, passing score, standard setting
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
Albino, J. E., Young, S. K., Neumann, L. M., Kramer, G. A., Andrieu, S. C., Henson, L., Horn, B., & Hendricson, W. D. (2008). Assessing dental students’ competence: Best practice recommendations in the performance assessment literature and investigation of current practices in predoctoral dental education. Journal of Dental Education, 72(12), 1405-1435. https://doi.org/10.1002/j.0022-0337.2008.72.12.tb04632.x
Bahammam, L. A. (2017). Cutoff score evaluation of undergraduate dental curriculum. Medical Teacher, 39(sup1), S33-S36. https://doi.org/10.1080/0142159X.2016.1254741
Chang, L. (1999). Judgmental item analysis of the Nedelsky and Angoff standard-setting methods. Applied Measurement in Education, 12(2), 151-165. https://doi.org/10.1207/s15324818ame1202_3
Cohen-Schotanus, J., & van der Vleuten, C. P. (2010). A standard setting method with the best performing students as point of reference: Practical and affordable. Medical Teacher, 32(2), 154-160. https://doi.org/10.3109/01421590903196979
Dalum, J., Christidis, N., Myrberg, I. H., Karlgren, K., Leanderson, C., & Englund, G. S. (2023). Are we passing the acceptable? Standard setting of theoretical proficiency tests for foreign-trained dentists. European journal of dental education : official journal of the Association for Dental Education in Europe, 27(3), 640-649. https://doi.org/10.1111/eje.12851
Downing, S. M., Tekian, A., & Yudkowsky, R. (2006). Research methodology: Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teaching and Learning in Medicine, 18(1), 50-57. https://doi.org/10.1207/s15328015tlm1801_11
Downing, S.M., & Yudkowsky, R. (2009). Assessment in health professions education (1st ed.). Routledge. https://doi.org/10.4324/9780203880135
George, S., Haque, M. S., & Oyebode, F. (2006). Standard setting: comparison of two methods. BMC Medical Education, 6, 46. https://doi.org/10.1186/1472-6920-6-46
Ho, T. K., Abu Kassim, N. L., O’Malley, L., & Roudsari, R. V. (2025a). Standard setting for dental knowledge tests: Reproducibility of the modified Angoff and Ebel method across judges. BMC Medical Education, 25, 1426. https://doi.org/10.1186/s12909-025-07822-3
Ho, T. K., O’Malley, L., & Roudsari, R. V. (2025b). Investigating assessment standards and fixed passing marks in dental undergraduate finals: A mixed-methods approach. BMC Medical Education, 25(1), 481. https://doi.org/10.1186/s12909-025-06944-y
Kim, J., & Yang, J. S. (2020). How to improve reliability of cut-off scores in dental competency exam: A comparison of rating methods in standard setting. European Journal of Dental Education, 24(4), 734-740. https://doi.org/10.1111/eje.12563
Mortaz Hejri, S., & Jalili, M. (2014). Standard setting in medical education: fundamental concepts and emerging challenges. Medical journal of the Islamic Republic of Iran, 28, 34.
Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14(1), 3-19. https://doi.org/10.1177/001316445401400101
Norcini, J. J. (2003). Setting standards on educational tests. Medical Education, 37, 464-469. https://doi.org/10.1046/j.1365-2923.2003.01495.x
Shulruf, B., Wilkinson, T., Weller, J. et al. Insights into the Angoff method: results from a simulation study. BMC Med Educ 16, 134 (2016). https://doi.org/10.1186/s12909-016-0656-7
Verhoeven, B. H., Verwijnen, G. M., Muijtjens, A. M., Scherpbier, A. J., & van der Vleuten, C. P. (2002). Panel expertise for an Angoff standard setting procedure in progress testing: item writers compared to recently graduated students. Medical education, 36(9), 860-867. https://doi.org/10.1046/j.1365-2923.2002.01301.x
Yousef, M. K., Alshawwa, L., Tekian, A., & Park, Y. S. (2017). Challenging the arbitrary cutoff score of 60%: Standard setting evidence from preclinical Operative Dentistry course. Medical teacher, 39(sup1), S75-S79. https://doi.org/10.1080/0142159X.2016.1254752
Yousef, M. K., Alshawwa, L. A., Farsi, J. M., Tekian, A., & Yoon Soo, P. (2020). Determining defensible cut-off scores for dental courses. European journal of dental education : official journal of the Association for Dental Education in Europe, 24(2), 186-192. https://doi.org/10.1111/eje.12483