Advancing the Use of Evidence and Economics in State Government Policymaking
How can state governments make better use of the growing base of evidence about “what works” and thereby provide taxpayers improved returns on their dollars?
Since the 1990s, the Washington State legislature has directed WSIPP to review research on “what works” (and what does not) in public policy. WSIPP’s work has spanned many topic areas, including criminal justice, education, child welfare, behavioral health, health care, workforce development, public health, and prevention. In our systematic reviews, we assess the research evidence to identify public policies that improve statewide outcomes of legislative interest; we then estimate the benefits, costs, and risk associated with different options.
In recent years, representatives from other states have contacted us with an interest in duplicating Washington’s approach. The Pew-MacArthur Results First initiative, which funds part of WSIPP’s work, aims to enable other states to take a similar approach as Washington. As part of this project, WSIPP has developed software that allows analysts to input state-specific data to examine the cost and benefits of various policy choices that impact outcomes of interest to state governments.
WSIPP’s benefit-cost model includes a tool to analyze hypothetical “portfolios” of policy choices in order to forecast the overall impact on outcomes given a combination of policies and programs. In addition to projecting short- and long-term benefits and costs of portfolios, the new tool can also project future high school graduation, crime, and child abuse and neglect rates.
The current project
In 2016 and 2017, WSIPP’s “evidence and economics” approach will expand into new research areas, including aging and higher education. WSIPP will also update and substantively extend analyses in previous areas, such as health care, children's services, workforce development, and crime.
Child Welfare Services and Performance-Based Contracts
Child welfare services
The 2009 Washington State Legislature established the Child Welfare Transformation Design Committee to advise the Department of Social and Health Services (DSHS) in changing practices in child welfare. Legislation directed DSHS to set up two demonstration sites to compare child welfare case management by private “supervising agencies” with child welfare case management by DSHS employees.
The 2016 Legislature directed these demonstration sites to be implemented by December, 2019. WSIPP was assigned to report on the “measurable effects achieved by the supervising agencies and compare those measurable effects with the existing services offered by the state” by April 1, 2018. Under the current implementation plan, WSIPP will be able to report on measureable effects by 2023.
The 2012 Legislature directed the DSHS to enter into performance-based contracts by December 2013, with one or more network administrators for family support and related services. WSIPP must report to the Governor and the legislature regarding the conversion of existing contracts to performance-based contracts.
An initial report was released in December 2014. The 2016 Legislature delayed the final report, initially due June 30, 2016, until April 1, 2023.
The 2012 Washington State Legislature directed DSHS to employ one of two responses for reports that are screened in and accepted for response: an investigation (currently the only option) or a family assessment. A family assessment is defined as a comprehensive assessment of child safety, risk of subsequent child abuse or neglect, and family strengths and needs that is applied to a child abuse or neglect report. The assessment does not include a determination as to whether child abuse or neglect occurred but does determine the need for services to address the safety of the child and the risk of subsequent maltreatment.
WSIPP will conduct an evaluation of the implementation of the family assessment response. The evaluation will include child safety measures, out-of-home placement rates, re-referral rates, and caseload sizes and demographics.
A preliminary report was published in December 1, 2014. The final report is due by December 1, 2016.
*The report has been postponed due to a delay in receiving administrative data required for this evaluation. WSIPP will complete the report no later than February 28, 2017.*
Evaluation of Hub Home Model for Foster Care Delivery
The 2016 Washington State Legislature directed WSIPP to evaluate the impact and cost effectiveness of the Mockingbird Family Hub Home Model for foster care delivery. In the Hub Home Model, families live nearby a Hub Home which offers support to the families.
WSIPP’s evaluation must include the impact the Hub Home Model has on child safety, permanency, placement stability, and if possible, sibling connections, culturally relevant care, and caregiver retention. Additionally, WSIPP will report on long-term cost savings compared to traditional foster care.
An interim report is due to the legislature January 15, 2017, and a final report is due June 30, 2017.
The 2016 Washington State Legislature directed WSIPP to examine programs intended to assist persons who reenter the community after incarceration. We will systematically review the national research literature and conduct a meta-analysis on reentry programs to determine if they are cost-effective at reducing crime or other outcomes.
The report is due to the governor, the legislature, and the Washington Statewide Reentry Council by June 1, 2017.
The 2015 Washington State Legislature directed the Washington State Institute for Public Policy (WSIPP) to complete an evaluation of the College Bound Scholarship Program, emphasizing degree completion rates at second and postsecondary levels. The study will include, but is not limited to, the following:
Scholarship recipient grade point average and its relationship to positive outcomes;
Variance in remediation needed and differentials in persistence between College Bound Scholarship recipients and their peers; and
The impact of ineligibility for the College Bound Scholarship Program, for reasons such as moving into the state after middle school or change in family income.
The report is due to the legislature by December 1, 2018.
Evaluation of the Effect of Integration on the Involuntary Treatment Systems for Substance Abuse and Mental Health
The 2016 Washington State Legislature directed WSIPP to evaluate the effect of the integration of the involuntary treatment systems for substance use disorders and mental health. WSIPP’s report must include whether the integrated system:
Increases efficiency of evaluation and treatment of persons involuntarily detained for substance use disorders;
Is cost-effective, including impacts on health care, housing, employment, and criminal justice costs;
Results in better outcomes for persons involuntarily detained;
Increases the effectiveness of the crisis response system statewide;
Impacts commitment based on mental disorders;
Is sufficiently resourced with enough involuntary treatment beds, less restrictive treatment options, and state funds to provide timely and appropriate treatment for all individuals interacting with the integrated involuntary treatment system; and
Diverted a significant number of individuals from the mental health involuntary treatment system whose risk results from substance abuse, including an estimate of the net savings from serving these clients into the appropriate substance abuse treatment system.
Preliminary reports are due to the legislature on December 1, 2020 and June 30, 2021, and a final report is due June 30, 2023.
LAP Inventory: Effective Practices to Assist Struggling Students
The 2013 Washington State Legislature directed the Washington State Institute for Public Policy (WSIPP) to prepare an inventory of evidence- and research-based effective practices, strategies, and activities for school districts to use in the Learning Assistance Program (LAP).
The state program provides supplemental academic support to eligible K-12 students achieving below grade level or not on track to meet local or state graduation requirements. LAP funds may support programs in reading, writing, mathematics, and readiness, as well as programs to reduce disruptive behavior.
The 2016 Washington State Legislature directed WSIPP to review the effect of revisions to Washington's Professional Educator Standards Board's (PESB) expedited professional certification process for out-of-state teachers who have at least five years of successful teaching experience.
The report will include the following:
The extent to which advanced level teacher certificates from other states compare to the standards and requirements of the Washington professional certificate;
The extent to which the federal or state-issued advanced level certificates that allow individuals to teach internationally compare to the standards and requirements of the Washington professional certificate; and
Whether the revised expedited professional certification process for out-of-state teachers has increased the number of professional certifications issued to individuals from out-of-state.
The report is due to the legislature by September 1, 2020.
Early Achievers Quality Rating and Improvement System
The 2015 Washington State Legislature required the Early Childhood Education and Assistance Program (ECEAP) providers and licensed child care providers serving non-school aged children who receive state subsidies participate in Early Achievers. Early Achievers is Washington State’s quality rating and improvement system for early childhood education and child care providers.
In the same bill, WSIPP was directed to examine the relationship between the Early Achievers quality ratings and outcomes for children who participate in state-subsidized early education and child care. A preliminary report is due to the legislature by December 31, 2019, with subsequent reports in 2020, and 2021. A final report including a benefit-cost analysis of Early Achievers is due to the legislature by December 31, 2022.
The 2016 Washington State Legislature directed WSIPP to evaluate how Washington and other states have addressed the funding of school safety and security programs.
The report is due to the governor, the legislature, and the Office of the Superintendent of Public Instruction by December 1, 2017.
In November, 2012, Washington State voters passed Initiative 502 to regulate and tax cannabis for persons twenty-one years of age and older. As part of I-502, WSIPP was directed to “conduct cost-benefit evaluations of the implementation” of the law. The evaluations must include measures of impacts on public health, public safety, cannabis use, the economy, the criminal justice system, and state and local costs and revenues.
A preliminary report was released in September 2015. Subsequent reports will be released in 2017, 2022, and 2032.