Using a Modified Delphi Methodology to Identify Essential Telemedicine Skills for Pediatric Residents

Published:September 06, 2022DOI:



      Telemedicine in pediatrics has increased during the coronavirus disease-2019 (COVID-19) pandemic. Despite rapid uptake by pediatric residency programs, consensus on essential telemedicine skills for pediatric residents is lacking.


      Use a modified Delphi methodology to identify essential telemedicine skills and behaviors for pediatric residents.


      A focused literature search was performed to identify items for review by pediatric telemedicine experts. A modified Delphi methodology consisting of iterative rounds of anonymous surveys was conducted until consensus for each item was reached. Consensus was defined as >80% of experts identifying a topic as “very important.” All items were mapped to one of the Accreditation Council for Graduate Medical Education (ACGME) core competencies.


      Seventeen pediatric telemedicine skills and behaviors achieved a consensus of “very important.” Most items mapped to the ACGME core competency domains of interpersonal and communication skills and professionalism.


      There was a high degree of agreement among pediatric telemedicine experts on the importance of 17 telemedicine skills and behaviors for pediatric trainees. These skills can inform pediatric telemedicine curricula and provide validity evidence for pediatric telemedicine assessment tools.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Academic Pediatrics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


      1. Nasca T, Accreditation Council for Graduate Medical Education. ACGME Response to the Coronavirus (COVID-19).; 2020. Accessed October 29, 2021.

        • Sartori DJ
        • Olsen S
        • Weinshel E
        • Zabar SR.
        Preparing trainees for telemedicine: a virtual OSCE pilot.
        Med Educ. 2019; 53: 517-518
        • Lawrence K
        • Hanley K
        • Adams J
        • Sartori DJ
        • Greene R
        • Zabar S.
        Building Telemedicine Capacity for Trainees During the Novel Coronavirus Outbreak: a Case Study and Lessons Learned.
        J Gen Intern Med. 2020; (Published online)
        • Costich M
        • Robbins-Milne L
        • Bracho-Sanchez E
        • Lane M
        • Friedman S.
        Design and implementation of an interactive, competency-based pilot pediatric telemedicine curriculum.
        Med Educ Online. 2021; 26
      2. American Academy of Family Physicians. What's the difference between telemedicine and telehealth?.
        AAFP. 2021; (Accessed September 13)
        • Fitzgerald M
        • Bhatt A
        • Thompson LA
        • et al.
        Telemedicine in Pediatric Training: A National Needs Assessment of the Current State of Telemedicine Education in Pediatric Training.
        Acad Pediatr. 2021; (Published online October 31)
        • McSwain SD
        • Bernard J
        • Burke BL
        • et al.
        Policy: American telemedicine association operating procedures for pediatric telehealth.
        Telemed e-Health. 2017; 23: 699-706
        • Ha E
        • Zwicky K
        • Yu G
        • Schechtman A.
        Developing a Telemedicine Curriculum for a Family Medicine Residency.
        PRiMER. 2020; 4
        • Joshi A
        • Silvas K
        • Chandra S.
        Developing a Telehealth checklist using the Modified Delphi Method.
        West J Emerg Med Integr Emerg Care with Popul Heal. 2020; 21 (Accessed February 16, 2021. file:///C:/Users/tes9045/Downloads/Developing a Telehealth checklist using the Modified Delphi Method (1).pdf)
        • Sartori DJ
        • Hayes RW
        • Horlick M
        • Adams JG
        • Zabar SR.
        The TeleHealth OSCE: Preparing Trainees to Use Telemedicine as a Tool for Transitions of Care.
        J Grad Med Educ. 2020; 12: 764-768
        • Roth LT
        • Costich M
        • Moerdler S
        • et al.
        Can you hear me now? A toolkit for telemedicine training.
        Clin Teach. 2021; 18: 348-353
        • Hart A
        • Romney D
        • Sarin R
        • et al.
        Developing Telemedicine Curriculum Competencies for Graduate Medical Education.
        Vol Publish Ah. 2021;
        • Curfman A
        • McSwain SD
        • Chuo J
        • et al.
        Pediatric Telehealth in the COVID-19 Pandemic Era and Beyond.
        Pediatrics. 2021; 148e2020047795
        • Fitzgerald M
        • Black E
        • DuBose-Morris R
        • et al.
        Entrustable Professional Activities: Supplemental EPA for General Pediatrics.
        Am Board Pediatr. 2021; (Published online)
        • Fitzgerald M
        • Black E
        • DuBose-Morris R
        • et al.
        Entrustable Professional Activities General Pediatrics and All Subspecialties Telemedicine EPA : Provide Health Care to Patients and Families Through the Entrustable Professional Activities Curricular Components Supporting Supplemental Telemedicine EPA fo.
        Am Board Pediatr. 2021; (Published online): 1-3
        • Zackoff MW
        • Real FJ
        • Abramson EL
        • Li STT
        • Klein MD
        • Gusic ME.
        Enhancing Educational Scholarship Through Conceptual Frameworks: A Challenge and Roadmap for Medical Educators.
        Acad Pediatr. 2019; 19: 135-141
        • Hasson F
        • Sinead K
        • McKenna H.
        Research guidelines for the Delphi survey technique.
        J Adv Nurs. 2000; 32: 1008-1015
        • Harris PA
        • Taylor R
        • Minor BL
        • et al.
        The REDCap consortium: Building an international community of software platform partners.
        J Biomed Inform. 2019; 95103208
      3. Sinead K, Hasson F, McKenna H.The Delphi Technique in Nursing and Health Research.; 2011.

      4. The Accreditation Council for Graduate Medical Education.
        Pediatrics Milestones. 2021; : 1-29
      5. Edgar L, Sydney McLean C, Sean Hogan MO, Hamstra S, Holmboe ES.The Milestones Guidebook.

        • Almathami HKY
        • Than Win K
        • Vlahu-Gjorgievska E.
        Barriers and Facilitators That Influence Telemedicine-Based, Real-Time, Online Consultation at Patients’ Homes: Systematic Literature Review.
        J Med Internet Res. 2020; 22
      6. Telehealth Competencies | AAMC. Accessed July 26, 2022.

        • Tabish SA.
        Assessment Methods in Medical Education.
        Int J Health Sci (Qassim). 2008; 2: 3-7