Medical Students’ Perception of a Newly Implemented Objective Structured Clinical Examination (OSCE) in Orthopedic Surgery and Trauma: A Mixed-Method Study
Keywords:Clinical Skills Assessment, Competency-based Education, Orthopedics and Trauma, OSCE, Students’ Perceptions
AbstractIntroduction: Objective Structured Clinical Examination (OSCE) is a well-known, widespread method of assessment of clinical skills. It is being widely used in Egyptian medical schools. This study aimed to explore the perception of the fifth-year medical students on the attributes, quality, validity, reliability and organization of the end-of-rotation Orthopedics Surgery and Trauma OSCE held at FOM-SCU in two academic years (2017-2018 and 2018-2019). It also aimed to assess the students rating of OSCE in relation to the other available assessment methods in clinical rotations. Material and Methods: This is a cross-sectional mixed-method study that was conducted at Suez Canal University Hospital. A convenient sample of the fifth-year medical students, who underwent the OSCE at the end of their Orthopedic Surgery and Trauma rotation during both academic years 2017-2018 and 2018-2019 were involved (n = 254). Quantitative data were collected through a validated questionnaire consisting of 32 items. Focus group discussions of students were conducted and qualitative data were recorded, coded, and thematically analyzed. Results: More than half of the students (55.5%) believed that the exam was fair and covered a wide range of knowledge (63.8%) and clinical skills (72.4%). Considerable percentages of students were doubtful regarding the standardization of OSCE scores (62.6%) and whether those scores provided a true measurement of their clinical skills (65%) and more than half of them were not sure whether gender, personality, or ethnicity affected their exam scores (55.5%) and whether OSCE provides them practical and useful experience (53.5%). OSCE and portfolio were reported as the easiest method among 55.5% and 63.8% of students, respectively, and 31.1% rated MCQs as the most difficult form of assessment. Qualitative analysis identified two themes; namely: “Challenges of implementing OSCE” and “Ways to overcome identified challenges”. Conclusion: Medical students positively perceived and provided good perception on the organization and implementation of the Orthopedics OSCE, although some of them were doubtful regarding its validity and reliability in assessing their clinical skills in Orthopedics and Trauma. The challenges regarding the OSCE can be overcome by more well-structured, practical training and orientation sessions for the examiners, students, and simulated patients.
Abdel Nasser A, Sharif A F, Elkhamisy F A, et al. Medical Community Perspectives Regarding the Egyptian Medical Licensing Exam: A Mixed-Method Study. Cureus. 2021;13(4): e14636. https://doi.org/10.7759/cureus.14636
Liu M, Huang Y-S, Liu K-M. Assessing Core Clinical Competencies Required of Medical Graduates in Taiwan. Kaohsiung J Med Sci. 2006;22:475–83. https://doi.org/10.1016/s1607-551x(09)70341-9
Hsieh M-C, Cheng W-C, Chen T-Y. Objective Structured Clinical Examination (OSCE) including critical simulation: Evaluation of medical student competence. Tzu Chi Med J. 2014;26:40–3. https://doi.org/10.1016/j.tcmj.2013.08.001
Miller GE. The assessment of clinical skills/competence/ performance. Acad Med. 1990;65:S63-7. https://doi.org/10.1097/00001888-199009000-00045
McGaughey J. Standardizing the assessment of clinical competence: an overview of intensive care course design. Nurs Crit Care. 2004;9:238–46. https://doi.org/10.1111/j.13621017.2004.00082.x
Defloor T, Van Hecke A, Verhaeghe S, Gobert M, Darras E, Grypdonck M. The clinical nursing competences and their complexity in Belgian general hospitals. J Adv Nurs. 2006;56:669–78.
Cowan DT, Norman I, Coopamah VP. Competence in nursing practice: a controversial concept–a focused review of literature. Nurse Educ Today. 2005;25:355–62. https://doi.org/10.1016/j.aaen.2006.11.002
Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975 Feb 22;1(5955):447-51. https://dx.doi.org/10.1136%2Fbmj.1.5955.447
Abdelaziz A, Kassab SE, Abdelnasser A, Hosny S. Medical Education in Egypt: Historical Background, Current Status, and Challenges. Health Prof Educ. 2018;4:236–44. https://doi.org/10.1016/j.hpe.2017.12.007
Collins LG, Schrimmer A, Diamond J, Burke J. Evaluating verbal and non-verbal communication skills, in an ethnogeriatric OSCE. Patient Educ Couns. 2011;83:158–62. https://doi.org/10.1016/j.pec.2010.05.012
Brown G, Manogue M, Martin M. The validity and reliability of an OSCE in dentistry. Eur J Dent Educ. 1999;3:117–25. https:// doi.org/10.1111/j.1600-0579.1999.tb00077.x
Pierre RB, Wierenga A, Barton M, Branday JM, Christie CDC. Student evaluation of an OSCE in paediatrics at the University of the West Indies, Jamaica. BMC Med Educ. 2004;4:22. https://doi.org/10.1186/1472-6920-4-22
Abdalla A Saeed, Waleed M Al Suwayh, Amal S. Alomri. Students’ perceptions and attitudes towards Objective Structured Clinical Examination (OSCE) in the College of Medicine, KSAU-HS, King Fahad Medical City, Riyadh, Saudi Arabia. JMSCR. 2016; 04(03): 9741-9747. http://dx.doi.org/10.18535/jmscr/v4i3.29
Idris SA, Hamza AA, Elhaj MAB, Elsiddig KE, Hafiz MM, Adam ME. Students’ perception of surgical objective structured clinical examination (OSCE) at final year MBBS, University of Khartoum, Sudan. Med J. 2014;1:17–20.
Jabeen N, Ehsan H , Mahmood M. Students’ Perception Regarding Objective Structured Clinical Examination (OSCE). J Islamabad Med Dent College. 2015:4(2):85-87.
Elfaki O, Al-Humayed S. Medical Students’ Perception of OSCE at the Department of Internal Medicine, College of Medicine, King Khalid University, Abha, KSA. J Coll Physicians Surg Pak. 2016, Vol. 26 (2): 158-159
Khaoua MA. The OSCE in Gynaecology and Obstetrics: About the experience of the Faculty of Medicine of Marrakech. Doctorate Degree Thesis, Faculty of Medicine and Pharmacy of Marrakech, University Qadi AYYAD; 2018. http://wd.fmpm.uca.ma/biblio/theses/annee-htm/FT/2018/these209-18.pdf (last accessed: January 16, 2022).
Kalbitz M, Liener U, Kornmann M, Gebhard F, Huber-Lang M. Evaluation of an objective structured clinical examination (OSCE) in surgery and orthopedics by medical students. Unfallchirurg.2010;113:726-730,732-733. https://doi.org/10.1007/s00113-0091690-2
Griesser MJ, Beran MC, Flanigan DC, Quackenbush M, Van Hoff C, Bishop JY. Implementation of an objective structured clinical exam (OSCE) into orthopedic surgery residency training. J Surg Educ. 2012;69:180–9. https://doi.org/10.1016/j.jsurg.2011.07.015
Marshall G, Jones N. A pilot study into the anxiety induced by various assessment methods. Radiography. 2003;9:185–91. https://doi.org/10.1016/S1078-8174(03)00062-2
Brand HS, Schoonheim?Klein M. Is the OSCE more stressful? Examination anxiety and its consequences in different assessment methods in dental education. Eur J Dent Educ. 2009;13:147–53.
Khan A, Ayub M, Shah Z. An audit of the medical students’ perceptions regarding objective structured clinical examination. Educ Res Int. 2016;2016:1–4. http://dx.doi.org/10.1155/2016/4806398
Omu AE, Al-Azemi MK, Omu FE, Al-Harmi J, Diejomaoh MFE. Attitudes of academic staff and students towards the Objective structured clinical examination (OSCE) in obstetrics and gynaecology. Creat Educ. 2016;7:886. http://dx.doi.org/10.4236/ ce.2016.76093
Chong L, Taylor S, Haywood M, Adelstein B-A, Shulruf B. The sights and insights of examiners in objective structured clinical examinations. J Educ Eval Health Prof. 2017;14:1–8. https://doi.org/10.3352/jeehp.2017.14.34
Gormley G. Summative OSCEs in undergraduate medical education. Ulster Med J 2011;80(3):127-132.
Fouad S, Gouda E, Nasser AA, Kamal D. Perception of Students, Staff and Simulated Patients towards Objective Structured Clinical Examination (OSCE). Educ Med J. 2019;11:27–42. http://dx.doi.org/10.21315/eimj2019.11.2.4
Aoki M, Ishii S, Usui M, Mizuguchi M, Miyano S. The Slope of the Acromion and Rotator Cuff Impingement. Katakansetsu. 1986;10:168–71. https://doi.org/10.11296/katakansetsu1977.10.2_168 28. Epstein RM. Assessment in medical education. N Engl J Med.2007;356:387–96.
Rentschler DD, Eaton J, Cappiello J, McNally SF, McWilliam P. Evaluation of undergraduate students using objective structured clinical evaluation. J Nurs Educ. 2007;46:135–9. https://doi. org/10.3928/01484834-20070301-09
El-Nemer A, Kandeel N. Using OSCE as an assessment tool for clinical skills: Nursing students’ feedback. Aust J Basic Appl Sci. 2009;3:2465–72.
Taylor CA, Green KE. OSCE feedback: A randomized trial of effectiveness, cost-effectiveness and student satisfaction. Creat Educ. 2013;4:9. http://dx.doi.org/10.4236/ce.2013.46A002
Rao VD, Reddy MPK, Reddy MR, Hanumiah A, Sunder PS, Reddy TN, et al. Student evaluation of an OSCE in general medicine at Mamata Medical College, Andhra Pradesh. Int J Med Res Health Sci. 2014; 3:342–5. http://dx.doi.org/10.5958/j.2319-5886.3.2.071
Azim Majumder A, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019;10:387–97. https://dx.doi.org/10.2147%2FAMEP.S197275
Khan H. OSCEs are outdated: clinical skills assessment should be centred around workplace-based assessments (WPBAs) to put the ‘art’ back into medicine. MedEdPublish. 2017;6:189. https://doi.org/10.15694/mep.2017.000189
Abouzeid E & Abdelnasser A. Evaluation of the Portfolio’s Implementation in Clinical Clerkship: Students’ and Staff’s Perception in Egypt. J Med Educ. 2019;17:205–14. https://dx.doi.org/10.22037/jme.v17i4.23742
Walsh M, Bailey PH, Koren I. Objective structured clinical evaluation of clinical competence: An integrative review. J Adv Nurs. 2009;65:1584–95. https://doi.org/10.1111/j.1365-2648.2009.05054.x
Zayyan M. Objective structured clinical examination: The assessment of choice. Oman Med J. 2011;26:219–22. https://doi.org/10.5001/omj.2011.55