Embedding Evaluation as Part of Core Business

This project implements a Co-Designed Evaluation Framework Prototype to improve outcomes for people with disabilities, their families and carers.

Project leads: 
Dr Deborah Debono, Faculty of Health

Duration: 2022

Co-designed innovations have the potential to improve the lives and health of people with intellectual disability, their families and carers. Understanding which innovations work, for whom, from whose perspective, and how they are best implemented in the real world can help to select those most appropriate for addressing specific needs. Support for individualised, rigorous, and systematic process and outcome evaluation is not embedded in disability services, hindering reliable measurement of the effects of diverse innovations and their dissemination. The lack a tested CD-EFP increases the risk that evidence for effective innovations and their implementation is not captured.

In 2019-2021, Onemda funded Phase 1 of a 4-phase project to co-design – with people with intellectual disability, carers and staff – a Co-Designed Evaluation Framework Prototype (CD-EFP) to systematically evaluate innovations at Onemda (see Report). This project will implement the CD-EFP to identify strategies to support potential adaptation and scalability across the disability sector.

Building on Phase 1, this study will draw on both the Consolidated Framework for Implementation Research (CFIR) and Theoretical Domains Framework Implementation (TDFI) approach to identify barriers and enablers to implementation of the CD-EFP. Informed by the CFIR and TDFI we will conduct:

  1. Surveys, interviews and focus groups to identify barriers and enablers to implementation of the CD-EFP
  2. Map existing quality of life measures available for people with intellectual disability for suitability for inclusion in the CD-EFP
  3. Consistent with the TDFI, conduct workshops to co-design strategies to address barriers and enablers to implementation.

What impact will we create? 

Embedding evaluation requires implementation of a customised CD-EF. Embedded evaluation will contribute to evidence on effective innovations.  Guidance on how the CD-EF can be adapted and scaled across the sector will have wide health and social impacts for people with disability, their carers, services and policy makers.

Once we have an implementable CD-EF, an implementation toolkit will be developed (Phase 3) to support implementation across Onemda and other organizations (Phase 4).  The CD-EF and toolkit will be made available on the Onemda and UTS websites for adaptation by other organisations to support them to evaluate and translate best practice. Onemda will facilitate the dissemination of the CD-EF through their partnership networks. 

Who are we working with?

  • Janice O'Connor, The Onemda Association Inc.
  • Professor Jo Travaglia, Discipline Lead – Collaborative for Health Services Management, Faculty of Health
  • Dr Hamish Robertson, Faculty of Health
  • Dr Phillippa Carnemolla, Faculty of Design Architecture and Build
  • Dr Natalie Taylor, Implementation Scientist, Cancer Council
  • Domenic Svejkar
  • Professor Bronwyn Hemsley, Faculty of Health, Head of Discipline Speech Pathology
  • Professor Simon Darcy, UTS Business School, Management Discipline
  • Dr Tim Luckett, Faculty of Health, IMPACCT (Improving Palliative, Aged and Chronic Care through Clinical Research and Translation)

Funding Support

  • Faculty of Health, Industry Partnership Grant
  • Onemda Association Inc.

Network Research Themes

  • Inclusion and Social Participation
  • Health and Wellbeing
Acknowledgement of Country

UTS acknowledges the Gadigal people of the Eora Nation, the Boorooberongal people of the Dharug Nation, the Bidiagal people and the Gamaygal people, upon whose ancestral lands our university stands. We would also like to pay respect to the Elders both past and present, acknowledging them as the traditional custodians of knowledge for these lands.