ABSTRACT:
The traditional paper-based Objective Structured Clinical Examination (OSCE) has been the mainstay in the assessment of the clinical competency of students in health sciences programs. The process, though, seems tedious and time-consuming. Hence, there is an increasing call for electronic OSCE. How the examiners perceived the usage and assessment process of the electronic OSCE needs to be clarified. The study aimed to evaluate the use of the electronic system in assessing students’ clinical skill competence and the evaluators’ perceptions of electronic OSCE. This study was an online-based cross-sectional survey among examiners in a pharmacy school in Jeddah, Saudi Arabia. Through online workshops, the 4th and final-year students and their examiners were trained on using electronic OSCE. Several stations and circuits were systematically arranged for the examination. The students were examined one after another. At the end of the examination, a Google form questionnaire containing 22 items was administered to all the examiners to assess their perceptions towards electronic OSCE. The data was analyzed using descriptive statistics. The research involved 23(100%) examiners who agreed that the workshop session prepared them for adopting an electronic system for evaluating clinical skills. Most assessors found electronic OSCE easy to access (56.5%) and use, and 73.9% of participants believed it was easier than paper-based assessments. About 69.6% of examiners had positive perceptions about the use and assessment process of electronic OSCE. This study highlights the effectiveness of electronic OSCE systems in assessing pharmacy students' clinical skill proficiency, with high satisfaction levels and favorable opinions from examiners.
Cite this article:
Reem Diri. Innovation Way to Digitize Objective Structured Clinical Exams Evaluation using Electronic Software: Faculty of Pharmacy Experience. Research Journal of Pharmacy and Technology. 2024; 17(9):4449-6. doi: 10.52711/0974-360X.2024.00687
Cite(Electronic):
Reem Diri. Innovation Way to Digitize Objective Structured Clinical Exams Evaluation using Electronic Software: Faculty of Pharmacy Experience. Research Journal of Pharmacy and Technology. 2024; 17(9):4449-6. doi: 10.52711/0974-360X.2024.00687 Available on: https://rjptonline.org/AbstractView.aspx?PID=2024-17-9-48
REFERENCES:
1. Awaisu A, Abd Rahman NS, Nik Mohamed MH, Bux Rahman Bux SH, Mohamed Nazar NI. Malaysian Pharmacy Students' Assessment of an Objective Structured Clinical Examination (OSCE). Am J Pharm Educ. 2010; 74(2): 34. https://doi.org/10.5688/aj740234
2. Urteaga EM, Attridge RL, Tovar JM, Witte AP. Evaluation of Clinical and Communication Skills of Pharmacy Students and Pharmacists with an Objective Structured Clinical Examination. Am J Pharm Educ. 2015; 79(8): 122. https://doi.org/10.5688/ajpe798122
3. Witheridge A, Ferns G, Scott-Smith W. Revisiting Miller's pyramid in medical education: The gap between traditional assessment and diagnostic reasoning. Int J Med Educ. 2019; 10: 191-192. https://doi.org/10.5116/ijme.5d9b.0c37
4. Corbo M, Patel JP, Abdel Tawab R, Davies JG. Evaluating clinical skills of undergraduate pharmacy students using objective structured clinical examinations (OSCEs). Pharm Educ. 2006; 6(1): 53-58. https://doi.org/10.1080/15602210500528372
5. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975; 1(5955): 447-451. https://doi.org/10.1136/bmj.1.5955.447
6. Kristina SA, Wijoyo Y. Assessment of Pharmacy Students' Clinical Skills using Objective Structured Clinical Examination (OSCE): A Literature Review. Syst Rev Pharm. 2018; 10(1): 55-60. https://doi.org/10.5530/srp.2019.1.9
7. Lyngå P, Masiello I, Karlgren K, Joelsson-Alm E. Experiences of using an OSCE protocol in clinical examinations of nursing students-A comparison of student and faculty assessments. Nurse Educ Pract. 2019; 35: 130-134. https://doi.org/10.1016/j.nepr.2019.02.004
8. Song Y-K, Chung EK, Lee YS, Yoon J-H, Kim H. Objective structured clinical examination as a competency assessment tool of students' readiness for advanced pharmacy practice experiences in South Korea: A pilot study. BMC Med Educ. 2023; 23(1): 231. https://doi.org/10.1186/s12909-023-04226-z
9. Wardman MJ, Yorke VC, Hallam JL. Evaluation of a multi‐methods approach to the collection and dissemination of feedback on OSCE performance in dental education. Eur J Dent Educ. 2018; 22(2). https://doi.org/10.1111/eje.12273
10. Epstein RM. Defining and Assessing Professional Competence. JAMA. 2002; 287(2): 226. https://doi.org/10.1001/jama.287.2.226
11. Kolivand M, Esfandyari M, Heydarpour S. Examining validity and reliability of objective structured clinical examination for evaluation of clinical skills of midwifery undergraduate students: A descriptive study. BMC Med Educ. 2020; 20(1): 96. https://doi.org/10.1186/s12909-020-02017-4
12. Grover S, Pandya M, Ranasinghe C, Ramji SP, Bola H, Raj S. Assessing the utility of virtual OSCE sessions as an educational tool: A national pilot study. BMC Med Educ. 2022; 22(1): 178. https://doi.org/10.1186/s12909-022-03248-3
13. Choudhari, Sahil, and T. N. Maheswari. Objective Structured Clinical Examination (OSCE): A Review. Research Journal of Pharmacy and Technology. 2016; 9(8): 1257–59.
14. S, Vijayalakshmi, et al. Objective Structured Clinical Examination (OSCE) on Antenatal Assessment among Nursing Students. Asian Journal of Nursing Education and Research. 2021; 11(3): 401–04. ajner.com, https://doi.org/10.52711/2349-2996.2021.00096.
15. Kshirsagar, Shweta Saisagar. A Study to Assess Perception of Nursing Students about the Effectiveness of Objective Structured Clinical Examination (OSCE) during Perineal Care Procedure in the Selected College of Metropolitan City. International Journal of Nursing Education and Research. 2021; 9(4) 425–28.
16. Sree, Pulla Divya, et al. Accessibility of Computer and Knowledge among Pharmacy Students at a Private University of Tamilnadu. Research Journal of Pharmacy and Technology. 2017; 10(1): 188–92.
17. Shirwaikar A. Objective structured clinical examination (OSCE) in pharmacy education-A trend. Pharm Pract. 2015; 13(4): 627. https://doi.org/10.18549/PharmPract.2015.04.627
18. Yousef AA, Awary BH, AlQurashi F, et al. Innovative Method to Digitize a Web-Based OSCE Evaluation System for Medical Students: A Cross-Sectional Study in University Hospital in Saudi Arabia. Int J Gen Med. 2022; 15: 1085-1095. https://doi.org/10.2147/IJGM.S351052
19. Treadwell I. The usability of personal digital assistants (PDAs) for assessment of practical performance. Med Educ. 2006; 40(9): 855-861. https://doi.org/10.1111/j.1365-2929.2006.02543.x
20. Kennedy M, Dickinson R, Alldred D, et al. Virtual Objective Structured Clinical Examinations for Independent and Supplementary Prescribing Trainees: Redeveloping a high‐stakes assessment. J Pharm Pract Res. 2022; 52(3): 247-253. https://doi.org/10.1002/jppr.1803
21. Strawbridge J, Hayden JC, Robson T, et al. Educating pharmacy students through a pandemic: Reflecting on our COVID-19 experience. Res Social Adm Pharm. 2022; 18(7): 3204-3209. https://doi.org/10.1016/j.sapharm.2021.08.007
22. Daniel M, Gordon M, Patricio M, et al. An update on developments in medical education in response to the COVID-19 pandemic: A BEME scoping review: BEME Guide No. 64. Med Teach. 2021; 43(3): 253-271. https://doi.org/10.1080/0142159X.2020.1864310
23. Lim AS, Lee SWH, Karunaratne N, Caliph S. Pharmacy Students' Perceptions and Performance on the Use of an Online Virtual Experience Tool for Practicing Objective Structured Clinical Examinations. Am J Pharm Educ. 2020; 84(11): 7920. https://doi.org/10.5688/ajpe7920
24. Bendale, Atul R., et al. Computer Literacy in Pharmacy Students (A Survey Carried out at Smt. B. N. B. Swaminarayan Pharmacy College, Affiliated to GTU, Gujarat). Research Journal of Science and Technology. 2011; Feb.; 3(1): 28–32.
25. Samreen, Ameena, et al. An Overview of Various Subjects Included as Syllabus for B. Pharmacy Students by JNTUH for Its Definitions, Significance, Objectives and Outcomes. Asian Journal of Research in Pharmaceutical Science. 2017; 7(1): 38–48.
26. Forouzanfar, Ali. Computer Based Objective Clinical Examination (COCE) of Student’s Medical Skills (Diagnosis, Prognosis and Treatment Planning), A New Method of Clinical Assay. Research Journal of Pharmacy and Technology. 2019; Apr.; 12(4): 1615–18. rjptonline.org, https://doi.org/10.5958/0974-360X.2019.00269.5.
27. Snodgrass SJ, Ashby SE, Rivett DA, Russell T. Implementation of an electronic Objective Structured Clinical Exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives. Australas J Educ Technol. 2014; 30(2). https://doi.org/10.14742/ajet.348
28. Wagner FL, Feller S, Schmitz FM, et al. Usability and preference of electronic vs. Paper and pencil OSCE checklists by examiners and influence of checklist type on missed ratings in the Swiss Federal Licensing Exam. GMS J Med Educ. 2022; 39(2). doi:10.3205/zma001545
29. Shaiba LA, Alnamnakani MA, Temsah M-H, et al. Medical Faculty's and Students' Perceptions toward Pediatric Electronic OSCE during the COVID-19 Pandemic in Saudi Arabia. Healthcare. 2021; 9(8): 950. https://doi.org/10.3390/healthcare9080950
30. Alrakaf, Saleh, et al. First Year Undergraduate Pharmacy Students’ and Academics’ Views of and Preferences for Learning and Teaching. A Preliminary Investigation. Research Journal of Pharmacy and Technology. 2014; Feb.,7(2); 161–67.
31. Hasani H, Khoshnoodifar M, Khavandegar A, et al. Comparison of electronic versus conventional assessment methods in ophthalmology residents; a learner assessment scholarship study. BMC Med Educ. 2021; 21(1): 342. https://doi.org/10.1186/s12909-021-02759-9
32. Meskell P, Burke E, Kropmans TJB, et al. Back to the future: An online OSCE Management Information System for nursing OSCEs. Nurse Educ Today. 2015; 35(11): 1091-1096. https://doi.org/10.1016/j.nedt.2015.06.010
33. Luimes JD, Labrecque ME. Implementation of Electronic Objective Structured Clinical Examination Evaluation in a Nurse Practitioner Program. J Nurs Educ. 2018; 57(8): 502-505. https://doi.org/10.3928/01484834-20180720-10
34. Vijayalakshmi, K., and S. Revathi. Performance of Nursing Students in Psychiatric Nursing Using Objective Structured Clinical Examination (OSCE) versus Traditional Practical Examination (TPE)-a Comparative Approach. Asian Journal of Nursing Education and Research. 2017; 7(4): 561–68.
35. Kaliyadan F, Khan A, Kuruvilla J, Feroze K. Validation of a computer based objective structured clinical examination in the assessment of undergraduate dermatology courses. Indian J Dermatol Venereol Leprol. 2014; 80(2): 134. https://doi.org/10.4103/0378-6323.129386
36. Shorbagi S, Sulaiman N, Hasswan A, et al. Assessing the utility and efficacy of e-OSCE among undergraduate medical students during the COVID-19 pandemic. BMC Med Educ. 2022; 22(1): 156. https://doi.org/10.1186/s12909-022-03218-9
37. Derkach, Tetiana M., and Anna I. Kharitonenko. Preferred Learning Styles of Undergraduate and Graduate Pharmacy Students. Research Journal of Pharmacy and Technology. 2018; Oct.; 11(10); 4277–84. https://doi.org/10.5958/0974-360X.2018.00784.9.