Improving the evidence-base for third sector delivered programs working with high-risk young people

Abstract

Young people who engage in multiple risk behaviour (high-risk young people) such as substance abuse, antisocial behaviour, or suicidal ideation are more likely to experience serious harms later in life. Despite these harms, there is very little intervention research available to guide policy makers or service providers to make decisions about investment in effective programs for high-risk young people. One potential reason for this is that the majority of interventions available for vulnerable populations globally, are implemented by Third Sector Organisations (TSOs) who lack the capacity and capability to conduct rigorous evaluation. This thesis aimed to demonstrate a range of methods to support TSOs to conduct better quality evaluations of their activities, so they can better improve outcomes for participants and demonstrate their effectiveness to relevant funding bodies.

To understand what had worked to improve outcomes for high-risk young people, a systematic review of the international peer-reviewed literature was undertaken and the common program components across the methodologically adequate studies identified (Chapter 2). Next, a team of researchers worked with the staff of a TSO to understand, and systematically define, the interventions and activities they implemented as part of their service delivery model. This expertise of TSO service providers was then combined with the effective program components, identified in the systematic review from Chapter 2, to inform development of a standardised program framework (Chapter 3). A novel process for embedding best-evidence outcome measures into the TSOs routine data collection processes was also trialled to enable them to continuously tailor their service delivery model to participant needs, whilst facilitating access to high-quality data for evaluation (Chapter 4). Finally, using this self-report participant data and routinely collected crime data, an evaluation of the program implemented in five communities was conducted using a rigorous evaluation design to determine impact (Chapter 5).

Dissemination of the methods described in this thesis will not only improve the internal capacity and capability of TSO-delivered programs to conduct evaluations but will increase the capacity of governments and policy experts to invest limited resources into effective programs, and ultimately lead to better outcomes for high-risk young people and their communities.