Different Assessment Methods of Ophthalmology Residents: Conventional Versus Electronic
Hamidreza Hasani1 *
- Ophthalmology Department, School of Medicine, Alborz University of Medical Sciences
Abstract: Assessment is an inseparable part of training in postgraduate medical residents, especially ophthalmology residents in which clinical reasoning evaluation is in more significant. The implementation of methods located at “shows how” level of Miller’s pyramid, believed to be more effective compared to previous conventional tools. In this study, we quantitatively compared electronic and conventional methods in ophthalmology resident assessing.
Methods: Eight different conventional methods comprising residents’ attendance, Logbook, scholarship and research skills, journal club, outpatient department participation, Multiple Choice Question (MCQ), Objective Structured Clinical Examination (OSCE), and professionalism embedded with 360-degree implemented in 24 ophthalmology residents of all grades. Electronic examination consisted of online Patient Management Problem (e-PMP) and modified electronic OSCE (me-OSCE) tests were taken one week later. Finally, these two methods were statistically compared intragroup and intergroup; also correlation between groups was determined.
Results: Totally twenty-four ophthalmology residents in different grades comprised in study. In electronic part assessment, average e-PMP scores (48.01±12.40) were much lower compared to me-OSCE (65.34±17.11). The total average electronic score was 56.67±11.28 while the total average conventional score was 80.74±5.99. Female and male residents’ average score in electronic and conventional method was (59.15±12.32 versus 83.01±4.95) and (55.19±10.77 versus 79.38±6.29), respectively. Correlation between modified electronic OSCE and all conventional methods was insignificant (P-value >0.05). Correlation between e-PMP and five conventional methods including professionalism/360-degree assessment tool was positive and significant (P-value < 0.05). Finally, the overall correlation between conventional and electronic methods was significant. (P-value=0.017)
Conclusion: Electronic assessment methods including e-PMP and me-OSCE are an appropriate replacement tool for currently used conventional methods in ophthalmology residents’ evaluation.