Advertisement
Commentary| Volume 54, ISSUE 3, SUPPLEMENT , S3-S9, March 2014

Historical Context for the Creation of the Office of Adolescent Health and the Teen Pregnancy Prevention Program

  • Evelyn M. Kappeler
    Affiliations
    Office of Adolescent Health, Office of the Assistant Secretary for Health, Department of Health and Human Services, Rockville, Maryland
    Search for articles by this author
  • Amy Feldman Farb
    Correspondence
    Address correspondence to: Amy Feldman Farb, Ph.D., HHS-Office of Adolescent Health, 1101 Wootton Parkway, Suite 700, Rockville, MD 20852.
    Affiliations
    Office of Adolescent Health, Office of the Assistant Secretary for Health, Department of Health and Human Services, Rockville, Maryland
    Search for articles by this author

      Abstract

      In Fiscal Year 2010, Federal funds were dedicated to support evidence-based approaches to effectively target teen pregnancy prevention and resulted in the establishment of the Office of Adolescent Health (OAH) and the Teen Pregnancy Prevention (TPP) Program. Through the tiered TPP Program, OAH supports replication and evaluation of programs using models whose effectiveness has been demonstrated through rigorous evaluation and the development and testing of promising or innovative pregnancy prevention strategies and approaches. This article documents the creation of OAH and the development of the TPP Program, the identification of a TPP evidence base, current program and evaluation efforts at OAH, and government coordination and partnerships related to reducing teen pregnancy. This article is of interest to those working to improve the health and wellbeing of adolescents.

      Keywords

      A Call to Build Rigorous Evidence to Drive Policy and Programs

      During the last decade, state, local, and Federal governments have implemented a large number of new evidence-based practices, the largest number during the last 5 years in particular [
      • Liebman J.B.
      Building on recent advances in evidenced-based policymaking. April 2013.
      ]. The Obama Administration has cultivated what many consider the greatest opportunity for rigorous evidence to shape social policy in the history of the U.S. government [
      • Haskins R
      • Baron J.
      The Obama Administration’s evidence-based social policy initiatives: An overview.
      ]. The plan originally designed at the Office of Management and Budget (OMB) was to create evidence-based social policy initiatives to improve policymaking and program outcomes, thereby using an evidence-based approach as a key part of the President's legislative agenda. Former OMB Director Peter Orszag called for designing new initiatives to build rigorous data, rather than treating evaluation as an afterthought, and using the evidence that emerges for action [
      • Orszag P.
      Building rigorous evidence to drive policy.
      ].
      President Obama's Fiscal Year (FY) 2010 budget proposed funds to support evidence-based approaches to more effectively target teen pregnancy prevention funds, utilizing evidence-based models and promising practices [
      ]. As part of that effort, the Health and Human Services (HHS) FY 2010 budget requested $110 million for a two-tiered evidence-based program [
      ]. The budget request redirected funding from the Health and Human Services (HHS) Administration on Children and Families (ACF) abstinence-only until marriage education programs to evidence-based and promising teen pregnancy prevention programs. Under this new initiative, the majority of funds were to support programs using models whose effectiveness has been demonstrated through rigorous evaluation, which came to be known as “Tier 1.” A smaller portion of funds was to be available to develop and test promising or innovative teen prevention programs, referred to as “Tier 2.”
      The final spending bill included funding for a new Teenage Pregnancy Prevention (TPP) Program within the Office of the Secretary of Health and Human Services, and provided specific guidance regarding administration of the program. The conferees directed the Secretary to establish an Office of Adolescent Health (OAH) within the Office of the Assistant Secretary for Health
      Authorized under section 1708 of the Public Health Service Act.
      . Congress also expressed its intent that the OAH be responsible for implementing and administering the TPP program, and that it coordinate its efforts with ACF, the Centers for Disease Control and Prevention (CDC), and other appropriate HHS offices and operating divisions.
      By the end of the second year of the Obama Administration, six new Federal evidence-based initiatives were underway to advance the use of evidence-based program models and to generate high-quality evidence on program models that were either new or had no rigorous evaluation previously. This includes the Teenage Pregnancy Prevention Program, housed in OAH.
      As the budget proposal for a new teen pregnancy prevention initiative was being considered on the Hill, an HHS workgroup was established with staff representatives from various offices. The workgroup was tasked with reviewing major issues to be considered in the development and shaping of this new program and a funding opportunity announcement (FOA). The FOA would be the public vehicle for announcing the major components and expectations for this new program effort. The Office of the Assistant Secretary for Planning and Evaluation (ASPE) served as the convener of the workgroup, which had representatives from ASPE, ACF, CDC, and the Office of Public Health and Science (now the Office of the Assistant Secretary for Health).
      The workgroup addressed the key topics originally believed HHS would have the authority to undertake, and later examined the final appropriations language. The workgroup considered a wide range of questions on critical topics that would guide the structure and implementation of this new program, such as: (1) How would HHS identify the evidence base of programs proven to be effective through rigorous research? (2) Should the focus be on outcomes and if so, which outcomes should be included? (3) What standards would this new program require for the replication of evidence-based interventions? (4) What would it mean to replicate with fidelity and how would the program manage any adaptations? (5) What should be the scale of grants awarded under Tier 1? (6) What entities should be eligible to apply for grants under Tier 1? There were similar questions about the scope and shape of the Tier 2 efforts as well as what would be considered innovative or promising for potential funding?
      Additional questions addressed by the workgroup included: What are the general Federal and grantee-level evaluation strategies that should be utilized to demonstrate the initiative's effectiveness? What performance measures would be required of grantees to obtain and track? How would staff monitor grantee performance? How should the target population be defined? How should program planning and implementation readiness be assured for Tier 1 and 2 grantees and should a planning/needs assessment/training and technical assistance start-up period be required in Year 1 of the grants? The legislation required funded programs be medically accurate and age appropriate. How would OAH assess medical accuracy and age appropriateness of materials used by grantees?

      Funding for Evidence-Based Approaches

      In December 2010 with the enactment of the FY 2010 appropriations, the new Teen Pregnancy Prevention Program had a mandate and funding. The spending bill provided a total of $110 million for the program and stipulated that not less than $75,000,000 would be available for programs that replicate teenage pregnancy prevention programs proven effective through rigorous evaluation, and that a range of evidence-based programs be eligible for these funds. In addition, the spending bill language provided that not less than $25,000,000 was to be available for research and demonstration grants to develop, replicate, refine, and test additional models and innovative strategies for preventing teenage pregnancy; and that the remaining amounts may be used for training and technical assistance, evaluation, outreach, and additional program support.
      Multiple efforts were underway simultaneously at HHS—the workgroup examining key issues to shape the TPP program, the establishment of the Office of Adolescent Health, and a group working to define and identify the evidence base—all shaping what would eventually become the Teen Pregnancy Prevention Program. With the final appropriations language and the recommendations of the HHS workgroup, the Office of Adolescent Health focused on writing and issuing the new competitive FOA for the TPP program. At the same time, another workgroup with leadership from ACF, met on a regular basis to define the criteria to be used to identify the evidence base of programs and contracted to conduct an independent, systematic review of the evidence base on programs to reduce teen pregnancy, sexually transmitted infections (STIs), and associated sexual risk behaviors.
      Two separate FOAs were issued in April 2010. One defined the parameters of replication efforts and the other laid out the requirements for research and demonstration projects. Tier 1 of the TPP program includes replications of evidence-based program models, those models that have demonstrated impacts, through rigorous evaluation, on key sexual behavioral outcomes including reduction of teen pregnancy, delay of sexual activity, increased contraceptive use, or reduced transmission of STIs. The other FOA set forth the parameters of the Tier 2 projects to test interventions based on (a) some preliminary evidence of effectiveness; (b) a significant adaptation of an evidence-based program; or (c) a new and innovative approach to teenage pregnancy prevention.
      Both FOAs stated that the proposed intervention(s) should clearly define the target population by age groups (e.g., 9–14; 15–17; 18–19), and priority populations (e.g., adolescents in foster care) within geographic areas with high teen birth rates. A sound rationale based on statistical data and other community factors was necessary to justify the specified population to be served. Both FOAs explicitly stated that 6–12 months of the first year would be allocated to hiring, training, conducting needs assessments, piloting the program, and otherwise ensuring readiness for full implementation. Applicants were notified that all core curricula materials (e.g., teacher training manuals, student handbooks) for use in the projects must be submitted to the OAH for review and approval prior to full implementation of the project. The review ensured that the materials were medically accurate. Grantees were required to self-certify the age appropriateness of their program and activities. In addition, all grantees were expected to monitor and report on program implementation and outcomes through a common set of performance measures developed by OAH and approved by OMB. All of the projects were funded as cooperative agreements for a 5-year grant period. A cooperative agreement, as opposed to a grant, is an award instrument with substantial involvement of the awarding agency and the recipient. OAH opted to utilize this mechanism to provide for close collaboration with recipients, ensure adherence to project aims, enable review and approval of curricula and educational materials, and assist with ongoing technical assistance and troubleshooting.
      To establish the standards of evidence for Tier 1 programs and to describe the evidence base to applicants, a list of program models was developed and the list was published in the FOA. The FOA required applicants to choose one or more of these evidence-based models to implement with fidelity to the original program models with only minimal adaptations allowed for new settings or different youth populations.
      The Tier 2 FOA required applicants to choose interventions that could be rigorously evaluated, had the potential to demonstrate evidence, and could eventually be replicated. Funded projects were required to develop a manual that outlines curriculum or intervention instruction and delivery. Grantees were also required to monitor and document ongoing program implementation to facilitate potential future replication.

      Identifying the Evidence-Base

      Prior to awarding $75 million in grants for replicating evidence-based programs, HHS undertook a process to identify programs that would be eligible for TPP funding and had documented positive impact on teen pregnancy and related factors. Within an intensely short period of time, under ACF leadership and with contractor assistance, HHS defined the evaluation standards necessary to be considered “effective based on rigorous evaluation” and conducted a systematic, comprehensive review of the literature on teen pregnancy, STIs, and sexual risk behaviors. A total of 88 studies met the preliminary review criteria and were included in the data extraction and analysis phase of the review. Ultimately, the HHS Pregnancy Prevention Evidence Review produced a list of 28 evidence-based program models for youth. The evidence review includes programs that use a number of approaches—abstinence-based, sexual health education, youth development, and programs for delivery in clinical settings and for special populations—all of which show positive results in a least one rigorous program evaluation. A searchable database of the model programs and a description of the evidence review methods are located on the OAH Web site.
      The original list of 28 evidence-based program models was published in the FOA, establishing the evidence-based list of program models that could be proposed for replication (and evaluation) by applicants. The release of the Tier 1 FOA was essentially a public announcement of both the requirements for this new grant program, but also the standards that defined what constituted an evidence-based teen pregnancy prevention program. Previously, various nongovernment organizations had identified lists of “what works” in teen pregnancy prevention, but this was the first time the Federal government had released such a list and clearly described the evidence standards.

      The Office of Adolescent Health Today

      Congress provided funding to establish OAH due to its concern about the historic lack of funding and focus on the significant unmet and often interrelated health needs of adolescents, recognizing that health problems that emerge during the second decade of life have important consequences for adult morbidity and mortality. As such, the OAH is dedicated to improving the health and well-being of adolescents to enable them to become healthy, productive adults. OAH coordinates adolescent health promotion and disease prevention programs and initiatives across the U.S. Department of Health and Human Services (HHS) and works in partnership with other HHS agencies to support evidence-based approaches to improve the health of adolescents.

      The Adolescent Health Working Group

      OAH convenes the Adolescent Health Working Group, which provides a forum for HHS agencies and other Federal agencies to learn from each other and support a full-range of evidence-based approaches to improve adolescent health, to address adolescents' health risks, and highlight programs focused on positive youth development.

      HIV/AIDS prevention

      With a competitive award from the Secretary's Minority AIDS Initiative Fund, OAH created a National Resource Center for HIV/AIDS Prevention among Adolescents (http://preventyouthhiv.org/). The Center supports adolescent service providers with Web-based resources, evidence-based research, and training and technical assistance to promote HIV/AIDS prevention among adolescents, in particular adolescents from minority and high-risk populations.

      Teen pregnancy prevention

      OAH operates grant programs aimed at reducing teen pregnancy (the TPP Program) and supporting pregnant and parenting teens, the Pregnancy Assistance Fund (PAF), and maintains a substantial evaluation portfolio associated with these grants. In addition, OAH provides ongoing training and technical assistance to its grantees and collaborates extensively with the other HHS agencies that fund teen pregnancy prevention programs.
      As part of the PAF Program, OAH funds competitive grants to states and Tribal entities to provide expectant and parenting adolescents and women with a seamless network of support services to help them complete high school or postsecondary degrees and gain access to health care, child care, family housing, and other critical support. PAF funds are also used to improve services for pregnant women who are victims of domestic violence, sexual violence, sexual assault, and stalking. OAH provides extensive training and technical assistance to the grantees and a rigorous evaluation is beginning in Summer 2013.
      OAH created and maintains online resource centers for both the PAF and TPP Programs. Each resource center is designed for program grantees and other organizations working to prevent teen pregnancy and improve adolescent health and well-being. The resource centers support organizations working with adolescents by providing skill-building materials in a one-stop shop. OAH identifies and gathers resources (Web-based seminars, tip sheets, e-learning modules, and podcasts) from across the Federal government on a range of topics related to teen pregnancy prevention, including mental health, substance use, and dating violence. These resources are stored in an extensive library and updated on a monthly basis.

      The Teenage Pregnancy Prevention program

      The tiered approach to the TPP program with the bulk of funding dedicated to the replication of evidence-based programs, funds 75 grants to replicate programs that have been proven effective through rigorous evaluations (Tier 1) and 19 demonstration grants to develop and test additional models and innovative strategies (Tier 2). The 2010–2015 TPP Program cohort began their fourth of five grant years in September 2013.
      TPP grantees serve over 100,000 youth annually in 37 states and the District of Columbia. Among these, 47 of the programs serve youth who are African-American, Latino, Native American, Haitian, or migrant, and those who are in low-income housing communities and rural areas. In addition, four programs target special populations of pregnant or parenting teens, those in alternative schools, and adolescents in juvenile detention.
      Tier 1 TPP replication grantees are replicating 23 of the original 28 evidence-based program models from the HHS Pregnancy Prevention Research Evidence Review list. Ten of those program models are being rigorously evaluated. Tier 1 programs reach about an equal number of males and females, primarily between 11 and 16 years of age. The majority of those served are African-American (42.4%) or Caucasian (36.2%). Thirty-one percent of participants are Latino, a high-risk group for teen pregnancy.
      Tier 2 TPP demonstration grants serve slightly more females (56%), between the ages of 11 and 16 years (90%). The majority of youth are Caucasian (37%) followed by African-Americans (25%), and bi- or multi-racial youth (15%). Forty-six percent are Hispanic or Latino. Of the 19 research and demonstration programs being evaluated, eight are specifically designed for ethnic and minority populations, including African-American youth, Alaska Native youth, American Indian youth, Latino youth, Native Hawaiian youth, and Haitian American youth.
      OAH has grantees all over the nation as depicted in Figure 1. The red markers are TPP replication grants, purple denotes the replication grants also conducting evaluations, blue markers are the TPP research and development grants, dark blue marks the OAH/CDC community-wide grants and finally, green markers are the Pregnancy Assistance Fund grantees.

      Teen Pregnancy Prevention Evaluation Strategies

      A mixture of evaluation strategies is utilized in both TPP Tiers to address the question of whether the replicated evidence-based teen pregnancy prevention programs and the new, innovative strategies for preventing teen pregnancy are effective. The evaluation strategies include: (1) Federal evaluation; and (2) grantee-level evaluation with Federal training, technical assistance, and oversight. The multipronged evaluation approach ensures that programs can be replicated effectively and expands the evidence base of what works and what does not. Figure 2 depicts the locations of OAH-funded evaluation activities.
      Figure thumbnail gr2
      Figure 2Rigorous evaluations being conducted through TPP program funding.

      Grantee-led evaluations

      There are 31 grantee-led rigorous evaluations of TPP replication and research and demonstration grants administered by OAH. Each receives intensive technical support from the OAH-sponsored evaluation contractor and OAH's in-house evaluation specialist. In the first year of the grants, each individual evaluation plan was reviewed to ensure the evaluations, as designed, would meet the rigorous standards of the HHS Pregnancy Prevention Evidence Review. To ensure that the evaluations will be implemented in a manner consistent with the high standards of the evidence review, ongoing evaluation technical assistance is provided to the grantees in the form of monthly progress check-in calls, impromptu calls as the grantees encounter real world challenges in implementing their evaluations, reviews of 6-month progress reports, analysis plans and end of grant evaluation reports, and evaluation issue briefs. The support is extensive, involving the contractor, the in-house evaluator, and project officers.

      Federally led evaluations

      OAH currently manages two Federally funded evaluation studies that address unique questions about the implementation and effectiveness of a subset of HHS Teen Pregnancy Prevention grantees. One of these studies, the Evaluation of Adolescent Pregnancy Prevention Approaches (PPA), originally began at ACF in 2008, as a rigorous evaluation of the impact of strategies to prevent sexual activity, pregnancy, sexually transmitted disease (STD), and/or related risks among unmarried youth. Specifically, ACF aimed to conduct an experimental evaluation of the impact of abstinence until marriage education programs, as well as abstinence-based education, sex education programs, sexually transmitted disease/HIV education and prevention programs and similar programs, on high-school aged youth. At the time, however, there were not Federally funded grant programs to draw from, and the study struggled to recruit sites. With the TPP Program now in place, in particular the innovative strategies grants, there were several potential sites for this evaluation. In 2011 the study was transferred to the Office of Adolescent Health and is being conducted with seven OAH and ACF grantees.
      As part of a government-wide effort to strengthen program evaluations, HHS also requested additional funds to support a Federal evaluation of the replication projects funded by the TPP grant program. This study was one of 23 proposals designed to strengthen the quality and rigor of Federal program evaluation. In response, Congress provided additional funds within the Public Health Service Act program evaluation funding, to carry out evaluations of teenage pregnancy prevention approaches. The Teen Pregnancy Prevention (TPP) Replication Study Evaluation is an experimental evaluation study that examines the implementation and impact of three OAH TPP replications of three different evidence-based program models—Cuidate!, Safer Sex, and Reducing the Risk—for a total of nine sites. The TPP programs include a sexual health and risk prevention curriculum delivered to groups in schools or community settings, an HIV/AIDs prevention program for small groups with emphasis on Latino cultural values, and a clinic-based HIV/AIDs prevention program for high-risk females. The study examines whether program models that were commonly chosen by replication grantees and widely used in the field can achieve impacts with different populations and in different settings.

      Government Coordination and Partnerships

      The TPP program has features unique among Federally funded grant programs, namely collaboration across HHS offices. At about the time OAH was developing the initial FOA for the Tier 2 demonstration projects, the Patient Protection and Affordable Care Act was signed into law. Among other things it included funding for a new program, the Personal Responsibility Education Program (PREP), a program of formula grants to states to educate young people on both abstinence and contraception, and provide adult preparation education. In addition, the Affordable Care Act also authorized $10 million in competitive, discretionary grant funds for a new program to support projects to explore innovative approaches to teen pregnancy prevention with vulnerable populations including homeless youth, youth in foster care, youth living in rural areas or areas with high teen birth rates, youth from minority groups, and mothers under the age of 21 years. This program came to be known as Personal Responsibility Education Innovation Strategies (PREIS). Given the similar nature of the TPP Tier 2 and the PREIS approaches, HHS made a decision to braid the two programs in one funding announcement that set forth a common set of requirements and established a partnership between OAH and ACF. PREIS is administered by ACF's Family Youth Services Bureau in collaboration with the OAH's Teen Pregnancy Prevention Tier 2 Research and Demonstration Program. OAH awarded grants to 19 organizations and ACF supports 13 PREIS projects, which are demonstration projects to implement and test innovative approaches to teen pregnancy prevention. The TPP FOAs also served to inform the frameworks for the subsequent funding announcement released by ACF for states to submit applications for the PREP grants.
      At the same time, OAH established a partnership with the CDC's Division of Reproductive Health to build on their previous work and expertise in community-based approaches to teen pregnancy prevention. In a slightly different partnership arrangement, OAH helps CDC support eight community-wide project sites and CDC provides funding for five national training organizations.
      Another distinctive feature of the TPP grant program is the collaborative approach to evaluation. The Office of the Assistant Secretary for Planning and Evaluation (ASPE), OAH, and the other Federal agencies collaborate on performance measures for grantees, grantee-led program evaluation, and additional Federal TPP evaluations. Figure 3 presents the current TPP efforts taking place at HHS.
      Figure thumbnail gr3
      Figure 3Teen pregnancy prevention efforts at the Department of Health and Human Services.

      Looking to the Future

      The Office of Adolescent Health works to elevate the importance of the second decade of life. Adolescent health experts recognize adolescence as a critical period of development where health-promoting behaviors (such as establishing physical activity habits or learning to positively cope with stress) or risky behaviors (such as smoking, drug use, or unprotected sex) emerge. Behaviors learned in the second decade of life have a substantial influence on health status into adulthood. OAH is working to build awareness of the importance of the teen years on healthy development and lifelong health. OAH's attention to adolescent health is timely and will serve to advance the Healthy People 2020 objectives, which now include a new topic area focused on adolescents.
      Our goal in regard to teen pregnancy prevention specifically is to reduce teen pregnancy, as well as sexually transmitted diseases and associated sexual risk behaviors while also building the evidence base about these outcomes. We strive to build capacity within communities to select and implement, and eventually sustain, effective programs that best meet their needs. To this end, OAH supports the annual HHS Pregnancy Prevention Research Evidence Review, invests heavily in implementation and evaluation support for grantees, and conducts Federal evaluations.
      A great deal of attention is given to the health of young children, who are generally well-understood to be in a critical developmental period by both health practitioners and the general public. What is often overlooked is the importance of adolescent development. The Teen Pregnancy Prevention program is just one of the Office of Adolescent Health's efforts to address Congress' call for new attention to the adolescent years as a critically important decade. The tools, resources, lessons learned in undertaking such a program, and ultimately the results of the numerous rigorous outcome evaluations within OAH, and in collaboration with our partner offices within HHS, will be shared with those working toward improving the health of adolescents. Together, great progress is being made toward improving the lives of our country's adolescents and putting them on a path to healthy adult years.

      References

        • Liebman J.B.
        Building on recent advances in evidenced-based policymaking. April 2013.
        Brookings. April 2013; (Available at:) (Accessed August 29, 2013)
        • Haskins R
        • Baron J.
        The Obama Administration’s evidence-based social policy initiatives: An overview.
        in: “Evidence for social policy and practice perspectives on how research and evidence can influence decision making in public services. NESTA, April 2011 (Available at:) (Accessed August 29, 2013)
        • Orszag P.
        Building rigorous evidence to drive policy.
        Office of Management Budget blog. June 8, 2009; (Accessed August 29, 2013)
      1. Justification of estimates for appropriations committees. U.S. Department Health & Human Services, 2010 (Available at:) (Accessed August 29, 2013)
      2. Fiscal year 2010 budget in brief. U.S. Department of Health & Human Services, May 2009 (Available at:) (Accessed August 29, 2013)