Evaluation of the Data Innovation Accelerator (DIA)
In April 2019, TIP was awarded the contract to undertake the inception (formative) and mid-term evaluation of the ERDF part funded DIA for Cardiff University, the accountable body.
The inception evaluation:
Tested the logic model, specifically identifying outcomes and whether the DIA was set up to deliver likely outputs indicators.
Confirmed what data needs to be systematically collected to evaluate the progress and impact of the DIA.
Identified wider metrics and consequential benefits that should be adopted to more widely and accurately reflect DIA’s short- and long-term impacts (outcomes and outputs).
Reviewed progress and plans for engaging with potential beneficiaries and identified opportunities for improvement.
Reviewed the Cross Cutting Themes strategy and planned activities.
Made recommendations for future delivery, resulting in greater impact and delivering higher value for money.
The mid-term evaluation:
Assessed whether the recommendations from the inception evaluation were implemented successfully and as necessary.
Analysed progress against indicators and comment on DIA’s position to continue and make progress.
Reported on the demographics and objectives of SMEs, summarising trends and patterns.
Reported on barriers and constraints to smooth delivery that have been identified by management, highlighted by stakeholders and evidenced by beneficiaries, not least the impact of COVID-19 being that many SMEs no longer prioritised long-term projects, with a focus on survival and day-to-day operations being paramount. We advised DIA to deliver shorter projects, with a focus on improving ‘efficiency’.
Undertook beneficiary feedback on the DIA approach and delivery methodology.
For both the inception and mid-term evaluations, we undertook personal and telephone interviews with key internal and external project stakeholders. This allowed us to understand inputs identified in the logic model, the position the support offering, and evaluate delivery and likely achievement of targets. During the mid-term evaluation, we also addressed the impacts of COVID-19 to make key recommendations for ongoing activities.