By Leanne Lester, Zoe Callis and Paul Flatau
As more data is being collected by Zonta House, the importance of linking the data, ensuring measurement tools are valid and reliable, and that all program outcomes are measurable has become paramount. This process has enabled UWA to assess the impact and effectiveness of Zonta House programs. Linking of data sources The linking of Penelope and SHIP data enabled a complete evaluation of Zonta House programs. It is recommended that processes be developed to ensure the accuracy of data entry into both Penelope and SHIP systems. As the linking is done through birth dates and Statistical Linkage Keys, it is imperative that birth dates and client names are entered correctly into both systems. Mapping program logic to available data By mapping the program logic to available data we were able to ascertain that all outcomes were measurable using both internal (Penelope) and external (SHIP and Department of Communities) hosted data sources. Measuring program logic outcomes The results of the data analysis show Zonta House are performing well and achieving their outcomes in the crisis and transitional accommodation programs, Recovery Support, Outreach Support, Positive Pathways, Future Employment Connections, and Positive Pathways programs. Understanding a woman’s journey through Zonta House By mapping the flow of a woman’s journey through Zonta House we were able to determine common pathways of program engagement, and pathways of engagement which were more likely to lead to a woman’s exit from Zonta House. It is recommended that Zonta House encourage engagement with programs such as Safer Pathways, Recovery Support, Positive Pathways and Outreach Support programs as soon as possible within a woman’s journey through Zonta House. Reliability and validity of the Life Matrix In this study we explored the potential value for the Life Matrix to be used as a routine measure at Zonta House. Of particular interest was whether the Life Matrix was reliable and valid. Five domains of the Life Matrix (emotional wellbeing; social wellbeing; community and cultural involvement; mental health; and physical health) showed a reliable underlying theme of wellbeing and contribute to the Revised Total Life Matrix Score. Validity was tested against the Depression, Anxiety and Stress Scale (DASS 21), with significant correlations in the expected direction showing convergence between the two instruments. Clients in the moderate/severe/ extremely severe band had significantly lower Revised Total Life Matrix Scores than those in the normal and mild bands, also demonstrating convergence. The Life Matrix domains are significantly correlated with SHIP variables. The Life Matrix is a reliable and valid tool and is recommended for use. Optimisation of visualisation Many limitations were found when trying to extract and display data from the Penelope system. To enable effective visualisation of data, it is recommended that work is done directly with the developers of Penelope to access and customise visualisations
Perth: Centre for Social Impact The University of Western Australia 2021. 57p.
