Advertisement

Zoom Objective Structured Clinical Exams: Virtually the same as the real thing?

Published:November 14, 2022DOI:https://doi.org/10.1016/j.acap.2022.11.004

      Abstract

      Objective

      : Objective structured clinical exams (OSCE) are used to train and assess resident foundational family-centered communication skills incorporating key stakeholders. In 2020 encounters were conducted virtually. We sought to compare standardized patient (SP) and family faculty (FF) assessment across OSCE and virtual OSCE (VOSCE) formats.

      Methods

      : The intern classes of 2019 and 2020 completed a live OSCE and VOSCE respectively where they disclosed an error to an SP. The 10 minute encounter was observed by an FF and facilitator followed by a 20 minute debrief. The SP and FF completed a behavioral checklist to evaluate skill mastery.

      Results

      : Eighteen (90%) of the 20 interns completed the encounter each year. Total mastery scores were significantly higher for SP assessment than for FF assessment in both OSCE [68% vs 46% (z=-3.005, p<.05)] and VOSCE formats [68% vs 53% (z=-2.105, p<0.05)]. Total mastery scores of SPs across OSCE and VOSCE formats did not significantly differ, nor did FF scores based on evaluation format.

      Conclusions

      : Our current experience suggests VOSCEs are a viable alternative to in person sessions given the comparable assessment across the two modalities. The ease of participating in virtual sessions may provide a way to more easily partner with key stakeholders.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Pediatrics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Hopwood J
        • Myers G
        • Sturrock A.
        Twelve tips for conducting a virtual OSCE.
        Med Teach. 2020 Oct 20; : 1-4https://doi.org/10.1080/0142159X.2020.1830961
        • Hannan TA
        • Umar SY
        • Rob Z
        • Choudhury RR.
        Designing and running an online Objective Structured Clinical Examination (OSCE) on Zoom: A peer-led example.
        Medical Teacher. 2021 Feb 24; https://doi.org/10.1080/0142159X.2021.1887836
        • Shehata MH
        • Kumar AP
        • Arekat MR
        • Alsenbesy M
        • Mohammed Al Ansari A
        • Atwa H
        • Ahmed SA
        • Deifalla A
        A toolbox for conducting an online OSCE.
        Clin Teach. 2021 Jun; 18: 236-242https://doi.org/10.1111/tct.13285
        • Abraham JR
        • Foulds JL
        • Lee JA
        • Sonnenberg LK.
        vOSCEs 2.0: Operationalising a universal low-cost virtual OSCE.
        Med Educ. 2021 May; 55: 641https://doi.org/10.1111/medu.14492
        • Craig C
        • Kasana N
        • Modi A.
        Virtual OSCE delivery: The way of the future?.
        Med Educ. 2020 Dec; 54: 1185-1186https://doi.org/10.1111/medu.14286
        • Boyle JG
        • Colquhoun I
        • Noonan Z
        • McDowall S
        • Walters MR
        • Leach JP.
        Viva la VOSCE?.
        BMC Med Educ. 2020 Dec 18; 20: 514https://doi.org/10.1186/s12909-020-02444-3
        • Lara S
        • Foster CW
        • Hawks M
        • Montgomery M.
        Remote Assessment of Clinical Skills During COVID-19: A Virtual, High-Stakes, Summative Pediatric Objective Structured Clinical Examination.
        Acad Pediatr. 2020 Aug; 20: 760-761https://doi.org/10.1016/j.acap.2020.05.029
        • Blythe J
        • Patel NSA
        • Spiring W
        • Easton G
        • Evans D
        • Meskevicius-Sadler E
        • Noshib H
        • Gordon H.
        Undertaking a high stakes virtual OSCE ("VOSCE") during Covid-19.
        BMC Med Educ. 2021 Apr 20; 21: 221https://doi.org/10.1186/s12909-021-02660-5
        • Howell HB
        • Desai PV
        • Altshuler L
        • McGrath M
        • Ramsey R
        • Vrablik L
        • Levy FH
        • Zabar S.
        Teaching and assessing communication skills in pediatric residents: How do parents think we are doing?.
        Acad Pediatr. 2021 Jun 26; (S1876-2859(21)00318-1)
      1. Institute for Patient- and Family-Centered Care. Available at: https://www.ipfcc.org/. Accessed June 7, 2021.

      2. Armstrong, Richard. When to use the Bonferroni correction. Ophthalmic and Physiological Optics.2014;34. 10.1111/opo.12131.

        • Sartori DJ
        • Hayes RW
        • Horlick M
        • Adams JG
        • Zabar SR.
        The TeleHealth OSCE: Preparing Trainees to Use Telemedicine as a Tool for Transitions of Care.
        J Grad Med Educ. 2020 Dec; 12: 764-768https://doi.org/10.4300/JGME-D-20-00039.1
        • Farrell SE
        • Junkin AR
        • Hayden EM.
        Assessing Clinical Skills Via Telehealth Objective Standardized Clinical Examination: Feasibility, Acceptability, Comparability, and Educational Value.
        Telemed J E Health. 2021 May 17; (Epub ahead of print)https://doi.org/10.1089/tmj.2021.0094
        • Jumreornvong O
        • Yang E
        • Race J
        • Appel J
        Telemedicine and medical education in the age of COVID-19.
        Acad Med. 2020; 95: 1838-1843
        • Silverman JA
        • Foulds JL.
        Development and use of a Virtual Objective Structured Clinical Examination.
        Can Med Educ J. 2020 Dec 7; 11: e206-e207https://doi.org/10.36834/cmej.70398
        • Lawrence K
        • Hanley K
        • Adams J
        • Sartori DJ
        • Greene R
        • Zabar S.
        Building Telemedicine Capacity for Trainees During the Novel Coronavirus Outbreak: a Case Study and Lessons Learned.
        J Gen Intern Med. 2020 Sep; 35: 2675-2679https://doi.org/10.1007/s11606-020-05979-9
        • Hess BJ
        • Kvern B.
        A call to understand the psychometric implications of virtual OSCE delivery.
        Med Teach. 2020 Nov 21; : 1-2https://doi.org/10.1080/0142159X.2020.1849591