The evaluation of the QIC-EY will involve the following five primary evaluation methods:
1. Systematic and technical review
The systematic and technical review informs preparation activities before the project’s implementation rolls out. It entails identifying core competencies for the development of the training and coaching model as well as identifying and reviewing fit of evidence-informed, youth engagement programs for implementation in child welfare settings.
2. Process
The process evaluation comprises a site component and a center component. The site component measures exposure to the training and coaching model as well as fidelity to implementation of the site-selected, youth engagement models. The center component focuses on how well the various stakeholders who make up the center perform their allotted duties. This includes duties such as providing thought leadership and direction, establishing and promoting best practices, conducting research and supporting development, providing recommendations to ensure continuous quality improvement, plus supporting and educating through coaching and workforce training.
3. Outcome
The outcome evaluation examines the impact of the project’s youth engagement models and training and coaching model on key long-term and short-term, child welfare outcomes.
4. Cost
The cost evaluation is designed to ensure a better understanding of the costs of delivering the workforce training, coaching and specific youth engagement models at each pilot site. This data will be summarized along with outcome estimates to provide maximum information for all stakeholders.
5. Dissemination
The dissemination evaluation assesses the impact of sharing project materials. It does this by answering the following questions:
- To what extent did national team partners participate in disseminating materials from the project, and in which formats did dissemination occur?
- Who are the project’s key audiences?
- Are key audiences aware of the project?
- Is information about project activities moving through significant child welfare networks?
- Have lessons learned throughout the project reached decision makers?
- Are key audiences using materials developed through the project so that county-based and region-based pilots can be scaled statewide?
