Evaluation of Services
October 2019: Update on evaluation of sexual violence services
MSD contracted Malatest International to carry out a three-year evaluation of specialist sexual violence services to evaluate the impact of the implementation of Budget 2016 through a formative, process and summative evaluation.
The formative evaluation and the first process evaluation are complete. However, the announcement of Budget 2019 and the increased investment in sexual violence services, has meant the evaluation of the implementation of Budget 2016 is no longer practical.
For this reason, MSD and Malatest have agreed to stop the current evaluation.
MSD is now in the process of looking at the broader research and evaluation programme of work that will be required to support the implementation of Budget 2019.
Further information will be made available about the research and evaluation programme of work in November 2019.
Evaluation Background
MSD contracted Malatest International to do a three year evaluation of services, including:
- Sexual Harm Crisis Support Services
- 'Safe to talk' national sexual harm helpline
- Harmful Sexual Behaviour Services
- Services for Male Survivors of Sexual Abuse.
The focus of the evaluation was to:
- Assess the implementation of service development and outcomes of the services
- Evaluate the changes in each separate service and the extent the services achieve the desired aims
- Evaluate the extent the service changes improve access for people who need the services and reduce the impact of sexual harm.
Formative evaluation and process evaluation outcomes
Formative evaluation (February – June 2018): to refine and develop the evaluation measures, indicators and approach to information gathering, including client data collected by providers.
The formative evaluation report describes the current state of the sector and changes to the sector that resulted from additional Budget 2016 funding.
This formative evaluation reports that funding allocated to Specialist Sexual Harm Services (SSHS) through Budget 2016 has had a positive impact on the sector. Funding allocated through Budget 2016, for many services, provided increased stability, certainty and availability of services.
However, while government investment available through Budget 2016 made a positive difference for service providers, some shortfalls remained. In discussion with providers, a number of challenges to the workforce were identified, including; a lack of available and applicable specialist training for staff as well as shortages in available workforce, particularly Māori and Pacific counsellors.
Process evaluation (July 2018 – June 2021): focussed on providers to assess services delivered, changes in provider capability and capacity, and to track and provide feedback on progress. Information for the process evaluation includes monitoring reports based on administrative data collected by service providers.
Outcomes (summative) evaluation (January 2021 – June 2021): will consider to what extent accessible, co-ordinated, connected and sustainable specialist services have been developed and their effectiveness in reducing the impact of sexual harm and improving outcomes for individuals, families/whānau and communities.
For more information about the evaluation, please subscribe to our family violence and sexual violence service provider update.
For more information about Malatest International, visit their website.