Research And Service Evaluation

---

Program Evaluation

Research and service evaluation takes place at a Centre-wide level. Initiatives at this level focus on evaluating service delivery. Indicators include the Brief Child and Family Phone Interview (BCFPI), the Child and Adolescent Functional Assessment Scale (CAFAS), Client Satisfaction Questionnaires, and Service Delivery Information. Data from these sources provide information concerning our clients, their satisfaction with services, and the effectiveness of the services they have received. This information is used to inform the development and delivery of services at the Centre.

At a programmatic level, the Director of Research and Evaluation works with program staff to develop an evaluation process to reflect the specific objectives of their program. For example, clients may be asked to complete questionnaires at the beginning and end of the program, as well as a satisfaction questionnaire to evaluate the effectiveness of the program and the client’s experience.

The Director of Research and Evaluation also works to develop research and service evaluation initiatives for special projects within the Centre and in collaboration with other organizations and researchers within the larger community that are in keeping with the goals and mandate of the Centre. Examples of this include the Toronto Family Group Conferencing Project and the Etobicoke Brighter Futures Coalition.

Some Current Projects

Toronto Family Group Conferencing Project

At the provincial level, The George Hull Centre for Children and Families continues to be recognized as a leader in Family Group Conferencing. In November 2006, the Centre was appointed to manage the FGC Provincial Resource, providing training, mentoring and consultation across the province. Since 2008, the Research Department has been assisting the Provincial body to conduct a study on the use of Family Group Conferencing with youth involved with Child Welfare. Results from this study will be used to create training materials for child welfare workers and provide professional development modules for Family Group Conferencing coordinators across the province.

Etobicoke Brighter Futures Coalition Evaluation

The Etobicoke Brighter Futures Coalition (EBFC) reflects a collaborative of approximately 40 members that provide programs and services directed at improving the health and wellbeing of high-risk children between 0 to 6 years of age. In December 2009, the Centre assisted the Coalition in conducting a survey of all Coalition members. The survey was designed to determine internal levels of collaboration (using a standardized measure) and to compare how these levels had changed over time. The survey also provided information on issues that are important to members, what had been the recent successes and challenges and what should be the priorities for work in the future. Survey results will be integrated into EBFC strategic planning efforts.

Highfield Community Enrichment Project

The George Hull Centre’s Highfield Community Enrichment Project is a primary prevention demonstration program based at Highfield Junior School, 85 Mount Olive Drive, located in Rexdale. The area is a high-need, low-income neighbourhood populated by struggling newcomers, many of whom live in the high-rise apartment buildings surrounding the school. In 2008 the Highfield project received a Toronto Community Foundation Vital Ideas Grant to evaluate their Kindergarten Readiness Program during the summer of 2008. The results found that children participating in the program showed improvement in many areas, especially concrete skill development, mastering school routines and improved social skills.
All respondents supported the idea that their child was better prepared for school as a result of the program. Results show that the program was successful in reducing parent and child anxieties associated with starting school. 98% of caregivers said they would recommend the program to a friend. Recommendations from the evaluation included increased parent involvement in the program, increased communication between kindergarten teachers and program staff, and longer program time. The program replicated and refined their evaluation for the summer of 2009, and the results continue to be used to make meaningful program improvements.

Short Term Intervention Program Evaluation

In September 2007, the Community Clinic began offering a Short-Term Intervention Program (STIP) to families. The STIP utilizes an innovative, collaborative therapy model of family therapy. The key program goals for this program are providing timely, early intervention for clients, reduction of wait times and the promotion of therapeutic collaboration and learning within the Centre’s multidisciplinary team.
In September 2008, the George Hull Centre received an Evaluation Capacity Building grant from The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO for this program. This represents the first grant to be received by the Clinic for evaluation of a clinical approach. Over the seven month term, extensive consultation was done with internal staff, CHEO, and external agencies. This process produced a solid program logic model and an evaluation plan with both process and outcome measures. In September 2009, the Centre received an Evaluation Implementation Grant from CHEO to conduct the program evaluation over a 12-month period.

Ontario Early Years Centre