Advertisement

How good is good enough?: Current-day pediatric residency program directors’ challenges in assessing and achieving resident procedural competency

Published:November 18, 2022DOI:https://doi.org/10.1016/j.acap.2022.11.005

      Abstract

      Objective

      Significant gaps exist in the pediatric resident (PR) procedural experience.  Graduating PRs are not achieving competency in the 13 ACGME recommended procedures. It is unclear why PR are not able to achieve competency, or how existing gaps may be addressed.

      Methods

      We performed in-depth one-on-one semi-structured interviews with 12 pediatric residency program directors (PPDs). The interviews were audio-recorded, and transcribed verbatim.  Coding of the data using conventional content analysis led to generation of categories, which were validated through consensus development.

      Results

      We identified 4 main categories, including 1) programs struggle to ensure adequate training in procedural skills for PRs, with various barriers reported; 2) programs develop individualized strategies to address challenges in procedural skills training, and multiple options are necessary; 3) PPDs face challenges defining procedural competency and standardizing expectations; and 4) expectations for PR procedural training may require modification based upon current practice environments. Solutions include simulation, procedural boot camps, and procedural/ subspecialty electives.

      Conclusions

      Numerous methods to combat challenges in PR procedural training have been identified by participating PPDs, including simulation, tailoring electives, and developing institutional guidelines.  However, accreditation bodies may need to update procedural expectations based on individual resident career goals and realities of current day practice.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Pediatrics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

      1. Du N, Forson-Dare Z, Sawyer T, et al. Procedural Competency for Pediatric Residents in the Contemporary Training Environment: An Unachievable Goal? [version 1]. MedEdPublish NaN, 10:28 https://doi.org/10.15694/mep.2021.000028.1

      2. Accreditation Council for Graduate Medical Education, Common Program Requirements for Graduate Medical Education in Pediatrics. https://www.acgme.org/globalassets/PFAssets/ProgramRequirements/320_Pediatrics_2020.pdf?ver=2020-06-29-162726-647&ver=2020-06-29-162726-647. Accessed April 8, 2022.

        • Gaies MG
        • Landrigan CP
        • Hafler JP
        • et al.
        Assessing procedural skills training in pediatric residency programs.
        Pediatrics. 2007; 120: 715-722https://doi.org/10.1542/peds.2007-0325
        • Schumacher DJ
        • Frintner MP
        • Cull W.
        Graduating Pediatric Resident Reports on Procedural Training and Preparation.
        Acad Pediatr. 2018; 18: 73-78https://doi.org/10.1016/j.acap.2017.08.001
        • Guntupalli SR
        • Doo DW
        • Guy M
        • et al.
        Preparedness of Obstetrics and Gynecology Residents for Fellowship Training.
        Obstet Gynecol. 2015; 126: 559-568https://doi.org/10.1097/AOG.00000000000009996
        • Mattar SG
        • Alseidi AA
        • Jones DB
        • et al.
        General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors.
        Ann Surg. 2013; 258: 440-449https://doi.org/10.1097/SLA.0b013e3182a191ca
        • Bell Jr, RH
        • Biester TW
        • Tabuenca A
        • et al.
        Operative experience of residents in US general surgery programs: a gap between expectation and experience.
        Ann Surg. 2009; 249: 719-724https://doi.org/10.1097/SLA.0b013e3181a38e59
        • DeLaroche A
        • Riggs T
        • Maisels MJ.
        Impact of the new 16-hour duty period on pediatric interns' neonatal education.
        Clin Pediatr (Phila). 2014; 53: 51-59https://doi.org/10.1177/0009922813500847
        • Zaichkin J
        • Kamath-Rayne BD
        • Weiner G.
        The NRP 8th Edition: Innovation in Education.
        Neonatal Netw. 2021 Jul 1; 40 (PMID: 34330875): 251-261https://doi.org/10.1891/11-T-756
        • DeMauro SB
        • Millar D
        • Kirpalani H.
        Noninvasive respiratory support for neonates.
        Curr Opin Pediatr. 2014; 26: 157-162https://doi.org/10.1097/MOP.0000000000000066
        • Aronson PL
        • Wang ME
        • Shapiro ED
        • et al.
        Risk Stratification of Febrile Infants ≤60 Days Old Without Routine Lumbar Puncture.
        Pediatrics. 2018; 142e20181879https://doi.org/10.1542/peds.2018-1879
        • Moote M
        • Krsek C
        • Kleinpell R
        • et al.
        Physician Assistant and Nurse Practitioner Utilization in Academic Medical Centers.
        Am J Med Qual. 2019; 34: 465-472https://doi.org/10.1177/1062860619873216
        • Schulman M
        • Lucchese KR
        • Sullivan AC.
        Transition from housestaff to nonphysicians as neonatal intensive care providers: cost, impact on revenue, and quality of care.
        Am J Perinatol. 1995; 12: 442-446https://doi.org/10.1055/s-2007-994517
      3. Juretschke LJ. New standards for resident duty hours and the potential impact on the neonatal nurse practitioner role.
        Adv Neonatal Care. 2003; 3: 159-161https://doi.org/10.1016/s1536-0903(03)00144-9
        • Lee HC
        • Rhee CJ
        • Sectish TC
        • et al.
        Changes in attendance at deliveries by pediatric residents 2000 to 2005.
        Am J Perinatol. 2009; 26: 129-134https://doi.org/10.1055/s-0028-1091395
        • Gozzo YF
        • Cummings CL
        • Chapman RL
        • et al.
        Who is performing medical procedures in the neonatal intensive care unit?.
        J Perinatol. 2011; 31: 206-211https://doi.org/10.1038/jp.2010.121
        • Gilhooly J
        • Redden HR
        • Leonard DT.
        Competency in neonatal endotracheal intubation: mission impossible?.
        Pediatrics. 2015; 135: e1290-e1291https://doi.org/10.1542/peds.2015-0571
        • Ben-Isaac E
        • Keefer M
        • Thompson M
        • et al.
        Assessing the utility of procedural training for pediatrics residents in general pediatric practice.
        J Grad Med Educ. 2013; 5: 88-92https://doi.org/10.4300/JGME-D-11-00255.1
        • Hsieh HF
        • Shannon SE
        Three approaches to qualitative content analysis.
        Qual Health Res. 2005; 15: 1277-1288
        • Carraccio CL
        • Benson BJ
        • Nixon LJ
        • Derstine PL.
        From the educational bench to the clinical bedside: translating the Dreyfus developmental model to the learning of clinical skills.
        Acad Med. 2008; 83: 761-767https://doi.org/10.1097/ACM.0b013e31817eb632.20
        • Curry LA
        • Nembhard IM
        • Bradley EH.
        Qualitative and mixed methods provide unique contributions to outcomes research.
        Circulation. 2009; 119: 1442-1452https://doi.org/10.1161/CIRCULATIONAHA.107.742775
        • LaDonna KA
        • Artino Jr., AR
        • Balmer DF
        Beyond the Guise of Saturation: Rigor and Qualitative Interview Data.
        J Grad Med Educ. Oct 2021; 13: 607-611https://doi.org/10.4300/JGME-D-21-00752.1
        • Kessler D
        • Pusic M
        • Chang TP
        • et al.
        Impact of Just-in-Time and Just-in-Place Simulation on Intern Success With Infant Lumbar Puncture.
        Pediatrics. 2015; 135: e1237-e1246https://doi.org/10.1542/peds.2014-1911
        • Johnston L
        • Sawyer T
        • Ades A
        • et al.
        Impact of Physician Training Level on Neonatal Tracheal Intubation Success Rates and Adverse Events: A Report from National Emergency Airway Registry for Neonates (NEAR4NEOS).
        Neonatology. 2021; 118: 434-442https://doi.org/10.1159/000516372
        • Backes CH
        • Bonachea EM
        • Rivera BK
        • et al.
        Preparedness of pediatric residents for fellowship: a survey of US neonatal-perinatal fellowship program directors.
        J Perinatol. 2016; 36: 1132-1137https://doi.org/10.1038/jp.2016.153
        • Sawyer T
        • French H
        • Ades A
        • et al.
        Neonatal-perinatal medicine fellow procedural experience and competency determination: results of a national survey.
        J Perinatol. 2016; 36: 570-574https://doi.org/10.1038/jp.2016.19
        • Clyne B
        • Barber Doucet H
        • Brown L
        • et al.
        Maintaining procedural skills for academic emergency medicine faculty: A needs assessment.
        AEM Educ Train. 2021; 5: e10648https://doi.org/10.1002/aet2.10648
        • Wood AM
        • Jones Jr, MD
        • Wood JH
        • et al.
        Neonatal resuscitation skills among pediatricians and family physicians: is residency training preparing for postresidency practice?.
        J Grad Med Educ. 2011; 3: 475-480https://doi.org/10.4300/JGME-D-10-00234.1
        • Iyer MS
        • Way DP
        • Kline J
        • et al.
        A Comparison of National Pediatric Procedures Training Guidelines With Actual Clinical Practice in Ohio.
        J Grad Med Educ. 2019; 11: 159-167https://doi.org/10.4300/JGME-D-18-00746.1
        • Nasim U
        • Morgan ZJ
        • Peterson LE
        The Declining Scope of Practice of Family Physicians Is Limited to Urban Areas.
        J Rural Health. 2021; 37: 734-744https://doi.org/10.1111/jrh.12540
        • Feigin RD
        • Drutz JE
        • Smith EO
        • et al.
        Practice variations by population: training significance.
        Pediatrics. 1996; 98: 186-190
        • Huang J
        • Tang Y
        • Tang J
        • et al.
        Educational efficacy of high-fidelity simulation in neonatal resuscitation training: a systematic review and meta-analysis.
        BMC Med Educ. 2019; 19 (Published 2019 Aug 29): 323https://doi.org/10.1186/s12909-019-1763-z
        • Sawyer T
        • White M
        • Zaveri P
        • et al.
        Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine.
        Acad Med. 2015; 90: 1025-1033https://doi.org/10.1097/ACM.0000000000000734
        • Ericsson KA.
        Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.
        Acad Med. 2004; 79: S70-S81
        • McGaghie WC
        • Issenberg SB
        • Cohen ER
        • et al.
        Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence.
        Acad Med. 2011; 86: 706-711
        • Barsuk J
        • McGaghie W
        • Cohen E
        • et al.
        Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit.
        J Hosp Med. 2009; 4: 397-403
        • Wayne D
        • Butter J
        • Siddall V
        • et al.
        Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice.
        J Gen Intern Med. 2006; 21: 251-256
        • Kessler D
        • Auerbach M
        • Pusic M
        • et al.
        A Randomized Trial of Simulation-Based Deliberate Practice for Infant Lumbar Puncture Skills.
        Simul Healthc. 2011; 6: 197-203
        • Sawyer T
        • Gray MM.
        Procedural training and assessment of competency utilizing simulation.
        Semin Perinatol. 2016; 40: 438-446https://doi.org/10.1053/j.semperi.2016.08.004
        • Evans P
        • Shults J
        • Weinberg DD
        • et al.
        Intubation Competence During Neonatal Fellowship Training.
        Pediatrics. 2021; 148e2020036145https://doi.org/10.1542/peds.2020-036145
        • de Oliveira Filho GR.
        The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method.
        Anesth Analg. 2002; 95https://doi.org/10.1097/00000539-200208000-00033
        • Connolly TM
        • Watters DA.
        Monitoring performance in thyroidectomy: cumulative sum analysis of outcomes.
        Thyroid. 2010; 20: 407-412https://doi.org/10.1089/thy.2009.0259
        • Lim TO
        • Soraya A
        • Ding LM
        • et al.
        Assessing doctors' competence: application of CUSUM technique in monitoring doctors' performance.
        Int J Qual Health Care. 2002; 14: 251-258https://doi.org/10.1093/oxfordjournals.intqhc.a002616
        • Ahmed K
        • Miskovic D
        • Darzi A
        • et al.
        Observational tools for assessment of procedural skills: a systematic review.
        Am J Surg. 2011; 202 (e6): 469-480
        • Jones Jr, MD
        • McGuinness GA
        Residency Review and Redesign in Pediatrics (R3P) Committee. The future of pediatric residency education: prescription for more flexibility [published correction appears in J Pediatr. 2009 Apr;154(4):629].
        J Pediatr. 2009; 154: 157-158https://doi.org/10.1016/j.jpeds.2008.10.040
        • McGuinness G
        Residency review committee for pediatrics: its role and responsibilities.
        J Pediatr. 2001; 139: 341-342https://doi.org/10.1067/mpd.2001.116047