Evaluating Innovations in Child Welfare

Action Research specializes in collaborative, applied child welfare research. Our program evaluation approach is characterized by our (1) substantive expertise in the field, (2) commitment to methodological rigor executed with practical efficiency, and (3) continuous engagement with stakeholders as key partners in any evaluation. Our evaluation team’s child welfare knowledge, at once broad and deep, is strengthened by diverse projects that span multiple jurisdictions, stakeholders, and segments of the child welfare system. This allows us to draw on and apply lessons learned across projects and jurisdictions to enhance our insights and findings.

Action Research’s transparent and collaborative process sets us apart: many program evaluators prefer a more distanced approach to maintain objectivity. While Action Research values objectivity, we embrace engaging stakeholders to leverage their expertise—from developing plans and reviewing preliminary insights to verifying findings and commenting on draft reports. In our experience, adhering to rigorous and transparent methods ensures objectivity while our collaborative approach produces results that stakeholders trust and understand and feasible recommendations that government can implement with the resources available.

See below for current and past evaluation projects.

Ohio Multidisciplinary Parent Representation

At the request of the Supreme Court of Ohio (SCO) and in collaboration with the Ohio Department of Children and Youth (ODCY), Action Research is conducting a four year evaluation of six pilot programs that use a multidisciplinary approach to parent representation. The pilots vary in design and intervention points but share a common commitment to using a multidisciplinary model that includes a lawyer, a social worker, and a parent advocate. The pilots operate at the county level, as Ohio has a state-supervised, county-administered child welfare and court systems. In each of the past two years, Action Research conducted site visits to interview stakeholders and to assess the physical layout of the programs. Action Research also reviews quantitative data related to client services, outcomes, and program finances yearly. The resulting reports include data analysis, learning summaries, and suggestions for program improvements and replication.

To learn more, click here to read our most recent report.

Eye Movement Desensitization and Reprocessing

At the request of the New York City Department of Health and Mental Hygiene (DOHMH) and the Administration for Children’s Services (ACS) and with funding provided by the Conrad N. Hilton Foundation, Action Research is undertaking a three-year process evaluation of a pilot initiative to train clinicians in New York City to provide Eye Movement Desensitization and Reprocessing (EMDR) in foster care settings. EMDR is an evidence-based trauma therapy, primarily used by clinicians in private practice, with notable success among combat veterans. The Title IV-E Prevention Services Clearinghouse recognizes EMDR as a “supported” intervention based on studies in other contexts, which allows foster care agencies to access federal funding to provide EMDR services to clients. To our knowledge, however, this pilot represents the first jurisdiction-wide attempt to deliver EMDR to children and youth in foster care.

 To learn more, click here to read our latest report.

Youth Transitioning to Adulthood

The District Attorney of New York selected a team led by Action Research that included Child Trends and the Center for Innovation through Data Intelligence to conduct a four-year process and outcome evaluation of two programs designed to improve outcomes for youth transitioning to adulthood from foster care in New York City. This population faces significant challenges such as high rates of homelessness, poverty, unemployment, physical and mental health issues, and a lack of access to healthcare. Our study provided crucial insights into the challenges providers faced in implementing the program models to service this population, the solutions employed to overcome those challenges, and the effectiveness of the programs in improving youth outcomes in areas such as employment, housing, and justice system involvement.

To learn more, click here for a summary of the final report.

Models of Parent Legal Representation 
In partnership with the New York University School of Law and with funding from Casey Family Programs, Action Research evaluated the outcomes on children of three programs that provide interdisciplinary legal representation (ILR) to parents facing child abuse or neglect petitions in New York City Family Court. ILR is an innovative legal intervention that combines lawyers, social workers, and parent advocates in a team to offer families comprehensive support. This approach often engages families earlier in their involvement with the child welfare system compared to traditional panel attorneys. We also explored the issue of over-reporting neglect cases in the child welfare system. Our understanding was enriched through comprehensive literature reviews, analyses of administrative data, and consultations with key stakeholders, including an advisory board. Our findings contributed to the literature on family strengthening and support services, demonstrating that providing ILR can hasten permanency through reunification and guardianship compared to traditional panel representation alone. We have since leveraged our substantive expertise and the insights gained from this study in other ongoing evaluations in Ohio, California, and New York.

To learn more, click here.

Manage by Data

Child welfare agencies are overflowing with data, but often struggle to use those data to improve outcomes for children and families. Manage by Data, an initiative of the New Jersey Department of Children and Families (NJDCF) funded by the Northeast and Caribbean Implementation Center (NCIC), sought to address this gap as part of NJDCF’s efforts to infuse data-driven decision making throughout the organization. Manage by Data aimed to build the capacity of mid-level staff to use data analysis to manage toward improved outcomes: to diagnose practice issues, to develop solutions, and to track and adjust those solutions as they are implemented.

 To learn more, click here.