Abstract
Objective
To develop and test a new quality measure assessing timeliness of follow-up mental health care for youth presenting to the emergency department (ED) with suicidal ideation or self-harm.
Methods
Based on a conceptual framework, evidence review, and a modified Delphi process, we developed a quality measure assessing whether youth 5 to 17 years old evaluated for suicidal ideation or self-harm in the ED and discharged to home had a follow-up mental health care visit within 7 days. The measure was tested in 4 geographically dispersed states (California, Pennsylvania, South Carolina, Tennessee) using Medicaid administrative data. We examined measure feasibility of implementation, variation, reliability, and validity. To test validity, adjusted regression models examined associations between quality measure scores and subsequent all-cause and same-cause hospital readmissions/ED return visits.
Results
Overall, there were 16,486 eligible ED visits between September 1, 2014 and July 31, 2016; 53.5% of eligible ED visits had an associated mental health care follow-up visit within 7 days. Measure scores varied by state, ranging from 26.3% to 66.5%, and by youth characteristics: visits by youth who were non-White, male, and living in an urban area were significantly less likely to be associated with a follow-up visit within 7 days. Better quality measure performance was not associated with decreased reutilization.
Conclusions
This new ED quality measure may be useful for monitoring and improving the quality of care for this vulnerable population; however, future work is needed to establish the measure's predictive validity using more prevalent outcomes such as recurrence of suicidal ideation or deliberate self-harm.
Suicidal ideation and deliberate self-harm is a major health concern in the pediatric population. Suicide is the second-leading cause of death among children, adolescents, and young adults aged 10 to 24.
In 2019, almost 19% of United States high school students reported seriously considering suicide, 16% made a plan to kill themselves, and 3% made a suicide attempt that required medical attention.
It is estimated that 1.12 million emergency department (ED) visits by children and adolescents 5 to 17 years old (referred to as youth from here forward) in 2015 were due to suicide attempts and suicidal ideation, almost double the estimated number of such visits in 2007.
3- Burstein B
- Agostino H
- Greenfield B.
Suicidal attempts and ideation among children and adolescents in US emergency departments, 2007-2015.
In order to develop and evaluate the validity of pediatric quality measures related to mental health care, the Pediatric Quality Measures Program (PQMP) funded Center of Excellence on Quality of Care Measures for Children with Complex Needs was charged with developing quality measures to assess hospital-based mental health services for youth. In this paper, we describe the development and testing of a new quality measure that assesses whether youth presenting to the ED for suicidal ideation or self-harm received timely follow-up mental health care.
Specifically, the measure assesses whether a follow-up visit with a mental health care provider occurred within 7 days of the index ED visit. Evidence supporting this measure includes previous findings that timely follow-up after an ED visit for suicidal ideation/self-harm is associated with a longer period of time to the next ED visit, and lower rates of subsequent suicidal ideation/self-harm.
7- Sobolewski B
- Richey L
- Kowatch RA
- et al.
Mental health follow-up among adolescents with suicidal behaviors after emergency department discharge.
,11A review of evidence-based follow-up care for suicide prevention: where do we go from here?.
, 12- Brown GK
- Ten Have T
- Henriques GR
- et al.
Cognitive therapy for the prevention of suicide attempts: a randomized controlled trial.
, 13- Donaldson D
- Spirito A
- Esposito-Smythers C.
Treatment for adolescents following a suicide attempt: results of a pilot trial.
, 14- Katz LY
- Cox BJ
- Gunasekara S
- et al.
Feasibility of dialectical behavior therapy for suicidal adolescent inpatients.
, 15- Fleischmann A
- Bertolote JM
- Wasserman D
- et al.
Effectiveness of brief intervention and contact for suicide attempters: a randomized controlled trial in five countries.
, 16A follow-up program for suicide attempters: Evaluation of effectiveness.
, 17- Vaiva G
- Ducrocq F
- Meyer P
- et al.
Effect of telephone contact on further suicide attempts in patients discharged from an emergency department: randomised controlled study.
In addition, prior work has shown that active engagement strategies based on cognitive analytic or behavioral therapies, such as Therapeutic Assessment and Family Intervention for Suicide Prevention, can be effective in facilitating mental health treatment access and ongoing participation.
18- Ougrin D
- Tranah T
- Leigh E
- et al.
Practitioner review: self-harm in adolescents.
, 19Practice parameter for the assessment and treatment of children and adolescents with suicidal behavior.
, 20- Ougrin D
- Zundel T
- Ng A
- et al.
Trial of Therapeutic Assessment in London: randomised controlled trial of Therapeutic Assessment versus standard psychosocial assessment in adolescents presenting with self-harm.
, 21- Asarnow JR
- Baraff LJ
- Berk M
- et al.
An emergency department intervention for linking pediatric suicidal patients to follow-up mental health treatment.
While there is no common standard for how soon after discharge the appointment should occur, within one week parallels other recommendations and published studies and was judged to be a reasonable amount of time for the appointment to occur by a Delphi panel (see Method) that assessed the face validity of this measure.
9- Fontanella CA
- Warner LA
- Steelesmith DL
- et al.
Association of timely outpatient mental health services for youths after psychiatric hospitalization with risk of death by suicide.
,22- Croake S
- Brown JD
- Miller D
- et al.
Follow-up care after emergency department visits for mental and substance use disorders among Medicaid beneficiaries.
, 23- Slesnick N
- Feng X
- Guo X
- et al.
A test of outreach and drop-in linkage versus shelter linkage for connecting homeless youth to services.
, 24- Bardach NS
- Doupnik SK
- Rodean J
- et al.
ED visits and readmissions after follow-up for mental health hospitalization.
Method
Measure Development
Measure development began with the creation of a conceptual framework
25- Parast L
- Bardach NS
- Burkhart Q
- et al.
Development of new quality measures for hospital-based care of suicidal youth.
and a thorough review of existing clinical practice guidelines
26Practice parameter for the assessment and treatment of children and adolescents with suicidal behavior.
,27Issues AWGoQ
Practice parameter for the assessment and treatment of children and adolescents with depressive disorders.
and existing literature on hospital-based care for youth with suicidal ideation/self-harm; details of this literature review are described elsewhere.
28- Bardach NS
- Burkhart Q
- Richardson LP
- et al.
Hospital-based quality measures for pediatric mental health care.
Based on this framework and evidence review, we developed draft quality measures to assess hospital-based care for youth with suicidal ideation or self-harm. Using the RAND–University of California, Los Angeles, modified Delphi method, a multistake holder panel evaluated and scored each measure on validity and feasibility. This approach was used to identify measures for further development and testing.
28- Bardach NS
- Burkhart Q
- Richardson LP
- et al.
Hospital-based quality measures for pediatric mental health care.
This method resulted in 21 measures endorsed for potential field-testing: 4 measures to be assessed using a caregiver survey
25- Parast L
- Bardach NS
- Burkhart Q
- et al.
Development of new quality measures for hospital-based care of suicidal youth.
, 16 measures to be assessed using medical record abstraction
28- Bardach NS
- Burkhart Q
- Richardson LP
- et al.
Hospital-based quality measures for pediatric mental health care.
, and 1 measure to be assessed using administrative (claims) data.
In this paper, we focus on the development and testing of the one administrative data quality measure endorsed by the panel, which concerned timely follow-up care for youth presenting to the ED with suicidal ideation/self-harm and discharged to home (development and testing of the remaining 20 measures has been described elsewhere
25- Parast L
- Bardach NS
- Burkhart Q
- et al.
Development of new quality measures for hospital-based care of suicidal youth.
,28- Bardach NS
- Burkhart Q
- Richardson LP
- et al.
Hospital-based quality measures for pediatric mental health care.
).
Measure Definition
Denominator: Eligible ED visits attended by youth 5 to 17 years old with a diagnosis (not necessarily primary) of suicidal ideation or self-harm who were discharged to home. For the visit to be eligible, the youth had to be enrolled in the health plan (in this case Medicaid) at the time of the ED visit and for at least one month after the ED visit. ED visits followed by an inpatient admission within 7 days were not eligible because these patients may have had an appointment scheduled with an outpatient mental health provider within the 7-day window but were admitted and so could not attend the appointment. ED visit eligibility was determined using administrative billing codes and an algorithm that indicated the presence of Evaluation & Management Current Procedural Terminology (CPT) codes and a Place of Service code 23 (emergency room-hospital), or a revenue center code of 0450-0459 (emergency room) or 0981 (professional fees-emergency room). Visits for suicidal ideation or self-harm were identified using International Classification of Diseases, Ninth Revision (ICD-9) codes of E950-E959, V62.84, or 300.9 or ICD-10 codes; see
Appendix for ICD-10 codes.
29- Chang BP
- Sano ED
- Suh EH
- et al.
Demographic characteristics of individuals admitted to the Hospital for Suicidal Ideation in the emergency department.
, 30- Walkup JT
- Townsend L
- Crystal S
- et al.
A systematic review of validated methods for identifying suicide or suicidal ideation using administrative or claims data.
, 31- VanCott AC
- Cramer JA
- Copeland LA
- et al.
Suicide-related behaviors in older patients with new anti-epileptic drug use: data from the VA hospital system.
Numerator: Eligible ED visits that were followed by a mental health care visit (including tele-health) within 7 days of discharge. CPT codes associated with mental health care service provision were used to identify follow-up visits that fulfilled this measure definition (see
Appendix for further details).
The quality measure was dichotomously scored: if a youth having an ED visit for suicidal ideation or self-harm subsequently had a follow-up mental health care visit (including tele-health) within 7 days of ED discharge, the measure score was one, otherwise the measure score was zero. At the State Medicaid health plan level, the measure score was calculated as the percentage of scores that were equal to one, with higher percentages indicating better quality of care.
Field Test Sample
We tested the measure in 4 State Medicaid insurance programs: South Carolina (SC), California (CA), Tennessee (TN), Pennsylvania (PA). Specifically, we assessed the feasibility of using existing administrative data to score this quality measure, examine variation in measure performance, and evaluate the predictive validity of the measure. In state Medicaid administrative data, we identified all eligible ED visits (defined above) between September 1, 2014 and July 31, 2016. Although the measure specifications require continuous enrollment for only one month following the index ED visit, here we required the youth to be continuously enrolled in Medicaid for 2 months immediately following the ED visit to allow for validation metric availability, described below. For youth with multiple eligible ED visits between September 1, 2014 and July 31, 2016, only the first eligible ED visit was included (that is, a youth may only contribute to the measure denominator one time). As described above, to pass the quality measure and be counted in the numerator, a youth with an eligible ED visit had to have an associated administrative claim indicating a mental health care follow-up visit occurred within 7 days of ED discharge.
Validation Metrics
We used 4 validation metrics to examine the measure's predictive validity: 1) all-cause ED return visits within 8 to 30 days of the index ED visit; 2) all-cause inpatient admissions within 8 to 30 days of the index ED visit; 3) same-cause ED return visits within 8 to 30 days of the index ED visit; and 4) same-cause inpatient admissions within 8 to 30 days of the index ED visit. Codes used to identify same-cause visits/admissions were the same codes used to assess eligibility for the measure (see
Appendix). ED visits within the first 7 days of the index ED visit were not counted as return visits (N = 1,675; 84% of these were among youth in CA, 39% were among Hispanic youth, 37% were among White youth) because it is possible that an ED return visit occurring within this time-frame might have occurred prior to a scheduled mental health care follow-up visit (which we hypothesized may prevent such reutilization). Based on previous work showing that engagement in treatment can reduce future suicidal ideation,
12- Brown GK
- Ten Have T
- Henriques GR
- et al.
Cognitive therapy for the prevention of suicide attempts: a randomized controlled trial.
, 13- Donaldson D
- Spirito A
- Esposito-Smythers C.
Treatment for adolescents following a suicide attempt: results of a pilot trial.
, 14- Katz LY
- Cox BJ
- Gunasekara S
- et al.
Feasibility of dialectical behavior therapy for suicidal adolescent inpatients.
we hypothesized that better performance on the quality measure would be associated with decreased 30-day ED return visits and hospital admissions.
Measure Testing
Measure feasibility was evaluated by examining the eligibility counts by state. Variation in measure scores by youth characteristics was assessed using multivariate logistic regression. We examined the independent association between performance on the quality measure and age, gender, race/ethnicity, and residence in a metropolitan statistical area (MSA).
Since this measure was developed primarily for implementation at the health plan level, we assessed health plan-level (managed care organization [MCO]) and hospital-level (1) variability and (2) reliability using an intraclass correlation coefficient (ICC) which assesses the extent to which the quality measure can differentiate between hospitals/health plans in terms of performance. The ICC was used to calculate the number of eligible visits per hospital/health plan needed to achieve excellent reliability using the Spearman-Brown formula.
32Introduction to Measurement Theory.
This assessment of reliability parallels the National Quality Forum measure evaluation criteria which states that a measure must be well-defined and precisely specified so it can be implemented consistently within and across organizations and allow for comparability.
Health plan information was not available for SC and thus, SC was only included in the hospital-level reliability assessment.
Predictive validity was examined using logistic regression models (pooling all states) adjusted for state, race/ethnicity, age, and gender where the outcomes were the validation metrics described above. Study procedures and use of data were approved by each state's Medicaid agency and the institutional review board of the RAND Corporation.
Discussion
This paper describes the development and testing of a new quality measure that assesses mental health follow-up care for youth aged 5 to 17 years presenting to the ED with suicidal ideation or self-harm. Given the high prevalence of depression in this age group,
,36- Bardach NS
- Coker TR
- Zima BT
- et al.
Common and costly hospitalizations for pediatric mental health disorders.
and the associated risk of suicide, the relatively low scores observed in our study should be of concern to clinicians and policymakers. Overall, only 53.5% of ED visits for suicidal ideation or self-harm resulting in a discharge to home were followed by a mental health care follow-up visit within 7 days, and this percentage was even lower (<40%) in 3 of the 4 states where it was assessed.
Our results are relatively consistent with previous work which has shown moderate rates of follow-up in this population ranging from 39% to 87%.
6- Stewart SE
- Manion IG
- Davidson S
- et al.
Suicidal children and adolescents with first emergency room presentations: predictors of six-month outcome.
, 7- Sobolewski B
- Richey L
- Kowatch RA
- et al.
Mental health follow-up among adolescents with suicidal behaviors after emergency department discharge.
, 8- Litt IF
- Cuskey WR
- Rudd S.
Emergency room evaluation of the adolescent who attempts suicide: compliance with follow-up.
,24- Bardach NS
- Doupnik SK
- Rodean J
- et al.
ED visits and readmissions after follow-up for mental health hospitalization.
From a provider perspective, it is important to consider the barriers to accessing follow-up care that these youth and their caregivers may face. Caregiver concerns about lengthy evaluations, long waiting periods, billing procedures, provider availability, and time off work/school may contribute to lack of follow-up.
37- Haynes RB
- Taylor DW
- Sackett DL.
Compliance in health care.
,38- Hazzard A
- Hutchinson SJ
- Krawiecki N.
Factors related to adherence to medication regimens in pediatric seizure patients.
In addition, caregiver perceptions regarding the severity of their child's mental health conditions may hinder follow-up.
39- Rotheram-Borus MJ
- Piacentini J
- Miller S
- et al.
Brief cognitive-behavioral treatment for adolescent suicide attempters and their families.
Mental health care provider capacity may in part explain the wide range of measure performance across states. For example, the lowest measure score was observed in TN at 26.3% and TN, of the 4 states, also has the lowest mental health provider capacity (eg, 41 counties in TN versus less than 10 in each of the other 3 states have less than one psychologist per 10,000 children aged 0–17 years).
, Certainly, lack of mental health provider capacity would limit the ability of providers and caregivers to ensure timely follow-up.
Our examination of reliability at the health-plan and hospital-level demonstrates that excellent reliability can be achieved with a relatively moderate sample size ie, 21 per health plan or 16 per hospital, thus implying that this measure can usefully distinguish between health plans/hospitals with respect to performance. Future use of measure scores may be helpful in identifying high vs low measure performance and thus, help with targeting quality improvement interventions as needed.
Based on our conceptual framework and prior evidence showing decreased recurrence of suicidal ideation and suicide attempts,
11A review of evidence-based follow-up care for suicide prevention: where do we go from here?.
,16A follow-up program for suicide attempters: Evaluation of effectiveness.
,17- Vaiva G
- Ducrocq F
- Meyer P
- et al.
Effect of telephone contact on further suicide attempts in patients discharged from an emergency department: randomised controlled study.
we hypothesized that a mental health care follow-up visit within 7 days would be associated with lower odds of both 30-day ED return visits and inpatient admissions; however, we did not find an association between quality measure scores and these utilization outcomes (all-cause or same-case). There are a few possible explanations for this observed lack of association. First, while a notably high percentage (8.7%) of visits were followed by a return ED visit within 30 days, the utilization outcomes were relatively uncommon events eg, 2.5% for 30-day inpatient admissions, <1% for same-cause outcomes, making small effect sizes difficult to detect without a larger sample size. Second, it may be necessary to consider the use of additional outcome validation measures more closely linked to the potential benefits associated with meeting this quality metric, such as future suicidal ideation,
9- Fontanella CA
- Warner LA
- Steelesmith DL
- et al.
Association of timely outpatient mental health services for youths after psychiatric hospitalization with risk of death by suicide.
longer-term ongoing mental health follow-up (eg, 90 or 180 days), improvement in Patient Health questionnaire (PHQ-9)
42- Kroenke K
- Spitzer RL
- Williams JB.
The PHQ-9: validity of a brief depression severity measure.
scores, time to return to school, or school performance, though importantly, these are not available in claims data. Additional work is needed to better understand the relationship between receipt of appropriate follow-up care and outcomes including those described above and future hospital-based utilization in this population of youth.
Our results demonstrating a lower likelihood of follow-up within 7 days among non-White youth compared to White youth are concerning and add to existing work showing that minority youth are less likely to receive appropriate mental health care.
43Disparities in behavioral health diagnoses: considering racial and ethnic youth groups.
, 44Racial/ethnic differences in mental health service use among adolescents with major depression.
, 45Smedley BD, Stith AY, Nelson AR. Committee on understanding and eliminating racial and ethnic disparities in health care. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care.2003:180-191.
, 46U.S. Department of Health and Human Services
Mental Health: Culture, Race, and Ethnicity—A Supplement to Mental Health: A Report of the Surgeon General.
Such racial/ethnic disparities in mental health care may be driven by a multitude of factors including differences in past experiences with the quality of care received from mental health providers, access to care, stigma, distrust in the mental healthcare system, and/or provider behavior.
47- Wong EC
- Collins RL
- Cerully J
- Seelam R
- Roth B.
Racial and ethnic differences in mental illness stigma and discrimination among Californians experiencing mental health challenges.
, 48- Eylem O
- De Wit L
- Van Straten A
- et al.
Stigma for common mental disorders in racial minorities and majorities a systematic review and meta-analysis.
, 49Merino Y, Adams L, Hall WJ. Implicit bias and mental health professionals: priorities and directions for research. In: Am Psychiatric Assoc; 2018.
These findings indicate that it is important for providers to consider the development and implementation of interventions to increase access to services and outreach for these youth and their families.
Interestingly, adjusted analyses highlighted significantly higher quality scores among youth living outside an MSA. Previous work examining access to and utilization of mental health care services has demonstrated the opposite, with individuals living in more urban settings having more access and utilization.
50- Hauenstein EJ
- Petterson S
- Rovnyak V
- et al.
Rurality and mental health treatment.
, 51- Anderson N
- Neuwirth S
- Lenardson JD
- et al.
Patterns of care for rural and urban children with mental health problems.
, 52Integrated care in rural areas.
One possible explanation for our finding is the growing availability of telehealth services for mental health care.
53- Hilt RJ
- Barclay RP
- Bush J
- et al.
A statewide child telepsychiatry consult system yields desired health system changes and savings.
,54- Hilt RJ
- Romaire MA
- McDonell MG
- et al.
The partnership access line: evaluating a child psychiatry consult program in Washington State.
If youth living outside an MSA are more likely to engage in telehealth services, that may explain these findings. Importantly, state laws and Medicaid policies regarding telemedicine vary dramatically from state to state. While the utilization of telehealth has substantially increased during the COVID-19 pandemic, we note that this study was conducted in 2014–2016. According to a 2018 report, CA was identified as having progressive telemedicine Medicaid program policies, while TN was identified as moderate, and both PA and SC were identified as having restrictive telemedicine policies.
It is possible that differences in the availability of telehealth programs, telehealth utilization, and telehealth policies may partially explain our observed differences by state and/or our MSA findings. Unfortunately, it was not possible to differentiate between in-person and telehealth follow-up visits in our study, so future research in this area is warranted. If in fact youth in rural areas are more likely than those in urban areas to engage in telemedicine mental health services, this may lead to reductions in suicide rates in rural areas which historically tend to be higher than in urban areas.
56- Fontanella CA
- Hiance-Steelesmith DL
- Phillips GS
- et al.
Widening rural-urban disparities in youth suicides, United States, 1996-2010.
,57Increasing rural–urban gradients in US suicide mortality, 1970–1997.
The development and testing of this new quality measure is an important first step toward addressing the dearth of quality measures available to assess pediatric hospital-based mental health care. Attempting suicide is a leading predictor of subsequent suicide attempts.
58- Tishler CL
- Reiss NS
- Rhodes AR.
Suicidal behavior in children younger than twelve: a diagnostic challenge for emergency department personnel.
, 59- Kennedy SP
- Baraff LJ
- Suddath RL
- Asarnow JR.
Emergency department management of suicidal adolescents.
, 60- Goldston DB
- Daniel SS
- Reboussin DM
- et al.
Suicide attempts among formerly hospitalized adolescents: A prospective naturalistic study of risk during the first 5 years after discharge.
, 61- Joiner TE
- Rudd MD
- Rouleau MR
- et al.
Parameters of suicidal crises vary as a function of previous suicide attempts in youth inpatients.
Thus, implementing best practices for youth presenting to the ED with suicidal ideation or self-harm has the potential to improve the care of a large proportion of those at risk for future suicide attempts. Previously established guidelines have explicitly recommended mental health follow-up care for this population.
19Practice parameter for the assessment and treatment of children and adolescents with suicidal behavior.
,62- Brown J
- Burr B
- Coleman M
- et al.
Mental health treatment for self-injurious behaviors: clinical practice guidelines for children and adolescents in the emergency department.
This study has some limitations. First, since this measure was only tested in 4 states among youth with Medicaid coverage, our understanding of the implementation and performance on this measure for youth in other states, with other types of insurance, and with different resources and demographic compositions is limited. Second, we may not have identified all eligible youth or all follow-up visits due to imperfect sensitivity/specificity of the codes used, inconsistent or incorrect use of codes, or potential errors or missingness in the administrative data. Though we parallel previous work in our selection of diagnosis codes to identify youth with suicidal ideation or self-harm, there are limitations to relying on diagnosis codes alone (as opposed to in combination with medical record abstraction and/or natural language processing).
29- Chang BP
- Sano ED
- Suh EH
- et al.
Demographic characteristics of individuals admitted to the Hospital for Suicidal Ideation in the emergency department.
,30- Walkup JT
- Townsend L
- Crystal S
- et al.
A systematic review of validated methods for identifying suicide or suicidal ideation using administrative or claims data.
Similarly, it is possible that there is incorrect or inconsistent (eg, across states) use of codes to identify mental health follow-up visits. Third, we acknowledge that the content and quality of follow-up visits likely varies, and the administrative data measure we developed does not allow us to assess this variation in care or how it may influence outcomes. Fourth, though we adjust for individual characteristics including race/ethnicity, age, and gender in our validation analysis, there may be important unmeasured confounders such as severity of illness not available in administrative data. Lastly, as noted earlier, given the low rates for some of the utilization outcomes (eg, <1% for same-cause outcomes), our study may have been underpowered to detect small effect sizes. In addition, quality measures calculated using administrative claims data are difficult to monitor in real-time since claims may take weeks or months after the index visit to be finalized and made available for quality measurement and improvement purposes. However, while more readily available in real-time, quality measures requiring medical record abstraction are comparatively more resource intensive and burdensome.
In conclusion, this new quality measure evaluates a key aspect of ED care for youth with suicidal ideation or self-harm and may facilitate assessing and improving quality of care for this vulnerable population. The development and testing of this measure is an important first step toward understanding the quality of care received by youth with suicidal ideation or self-harm in the ED setting. This measure could be used in the future to examine and monitor rates of timely follow-up within a hospital, health plan or state over time and/or to examine changes in timely follow-up rate that may occur following mental-health related quality improvement interventions in a hospital or health plan. Though our results reflect no association between measure performance and hospital-based reutilization outcomes over a 30-day follow-up period, previous findings have established that timely follow-up after an ED visit for suicidal ideation or self-harm is associated with a longer period of time to the next ED visit, and lower rates of subsequent suicidal ideation and deliberate self-harm.
7- Sobolewski B
- Richey L
- Kowatch RA
- et al.
Mental health follow-up among adolescents with suicidal behaviors after emergency department discharge.
,11A review of evidence-based follow-up care for suicide prevention: where do we go from here?.
, 12- Brown GK
- Ten Have T
- Henriques GR
- et al.
Cognitive therapy for the prevention of suicide attempts: a randomized controlled trial.
, 13- Donaldson D
- Spirito A
- Esposito-Smythers C.
Treatment for adolescents following a suicide attempt: results of a pilot trial.
, 14- Katz LY
- Cox BJ
- Gunasekara S
- et al.
Feasibility of dialectical behavior therapy for suicidal adolescent inpatients.
, 15- Fleischmann A
- Bertolote JM
- Wasserman D
- et al.
Effectiveness of brief intervention and contact for suicide attempters: a randomized controlled trial in five countries.
, 16A follow-up program for suicide attempters: Evaluation of effectiveness.
, 17- Vaiva G
- Ducrocq F
- Meyer P
- et al.
Effect of telephone contact on further suicide attempts in patients discharged from an emergency department: randomised controlled study.
Nonetheless, future work is needed to establish this measure's predictive validity using more prevalent outcomes, eg, recurrence of suicidal ideation.
Acknowledgments
Funding: This study was done under funding from a cooperative agreement with the Agency for Healthcare Research and Quality and Centers for Medicare and Medicaid Services, grant number U18HS025291. Research reported in this publication was also supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1TR002537. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in the study design; in the collection, analysis, or interpretation of data; in the writing of the report; nor in the decision to submit the article for publication.
The views expressed in this article are those of the authors, and no official endorsement by the Agency for Healthcare Research and Quality (AHRQ), the Centers for Medicare and Medicaid Services (CMS), or the Department of Health and Human Services (DHHS) is intended or should be inferred.
This article is published as part of a supplement sponsored by the US Department of Health and Human Services, the Centers for Medicare and Medicaid Services, and the Agency for Healthcare Research and Quality.
Appendix
ICD-10 codes used to identify ED visits for suicidal ideation or self-harm
T1491, R45851, X71.8XXA, X71.9XXA, X72.XXXA, X73.0XXA, X73.1XXA, X73.2XXA, X73.9XXA, X75.XXXA,X74.01XA, X74.02XA, X74.9XXA, X78.9XXA,X80.XXXA,X81.8XXA, X76.XXXA,X77.2XXA, X83.2XXA, X83.1XXA, X82.8XXA, X83.0XXA, X83.8XXA, X79, X76, X77.9, X77.2, X77.3, X77.8, X77.0, X77.1, X77.0, X83.2, X82.0, X82.8, X82.1, X82.2, X83.0, X78.9, X78.2, X78.0, X78.1, X78.8, X71.9, X71.0, X71.3, X71.8, X71.1, X71.2, X83.1, X75, X76, X74.9, X74.01, X72, X73.1, X73.9, X73.8, X73.2, X73.0, X74.8, X83.8, X81.8, X77.0, X81.0, X81.1, X80
Current Procedural Terminology (CPT) codes used to identify mental health care follow-up
CPT codes:
2014: 90785, 90791-90792, 90832-90834, 90836-90838, 90839-90840, 90845-90847, 90849, 90853, 90863, 90865, 90867-90870, 90875-90876, 90880, 96101, 96103, 96153, 96154,97770, 96155, 96120, 96151
2016: added 99354, 99355, 99415, 99416, 98968, 99443
HCPC codes: H2010, H2011, H2015, S0201, S9480
Article info
Publication history
Accepted:
March 5,
2021
Received:
December 10,
2020
Footnotes
The authors have no conflicts of interest to disclose.
Copyright
Copyright © 2021 by Academic Pediatric Association