Improvement Analytics Unit
An innovative partnership between NHS England and NHS Improvement and the Health Foundation providing robust evaluation of complex changes in the NHS.
The Improvement Analytics Unit (IAU) is a unique partnership between NHS England and NHS Improvement and the Health Foundation that evaluates complex local initiatives in health care in order to support learning and improvement.
We evaluate initiatives such as those being delivered as part of the sustainability and transformation partnerships (STPs) and Integrated Care Systems (ICSs). By providing rapid feedback to service leaders and decision-makers at both a local and national level, we help to identify what is working well and what might need to change in the future to improve outcomes.
Over the last decade, a number of national transformation programmes have been established to improve quality and efficiency in health care, often through the provision of more integrated care. The best analytical approaches to evaluate the impact of complex changes such as these are demanding to apply and the required capability is not always available in the NHS.
The Improvement Analytics Unit aims to fill this gap by:
- providing robust evaluation of complex change to support the development of strong and effective health care systems
- identifying whether outcomes for patients have changed following the introduction of a new initiative and to identify, so far as possible, why
- helping to spread the use of data analytics in the NHS for the purposes of quality improvement
- strengthening the robustness of the body of evidence available to inform national policy development.
Robustly evaluating the impact of complex change often requires the use of a counterfactual control group. Counterfactual analysis relies on making a comparison between a group of patients who have experienced an intervention with a carefully matched control group who have not. We take a wide range of factors into account so that we can be sure that any differences observed between the two groups are likely to be the result of the intervention.
The team at the Improvement Analytics Unit are experts in the use of counterfactual analysis – one of the most rigorous ways to determine the real impact of interventions.
Our aim is to support learning and improvement through evaluation.
Combining analysis from the Improvement Analytics Unit with local intelligence helps to guide the development of improvement on the ground. We know such improvement is complex and takes time. However along the way, the analysis can be used by those delivering change to bring valuable insights and to identify whether they need to alter their approach (‘course correct’) to improve outcomes.
Arne Wolters is Acting Head of the Unit, with joint strategic oversight from Adam Steventon, the Health Foundation’s Director of Data Analytics, and Ming Tang, National Director Data and Analytics at NHS England and NHS Improvement.
For further information, or to register your interest in taking part in an evaluation, please get in contact with Arne Wolters.
How has COVID-19 affected service delivery in GP practices that offered remote consultations before the pandemic?
The digital-first primary care goal set out in the NHS Long Term Plan has been thrown into the spotlight during COVID-19. We examine early results from 51 GP practices using askmyGP to explore how pri...
COVID-19 has seen the rapid and widescale adoption of online and digital tools such as total triage and remote consultations. Is this shift affecting the prescribing behaviour of clinicians?
New analysis from the Improvement Analytics Unit looks at how shifts to total triage and remote consultation is impacting the use of emergency care.
New analysis from the Improvement Analytics Unit has found that multidisciplinary teams may increase emergency hospital use, at least in the short term.
This briefing explores IAUs evidence on how multidisciplinary teams may increase emergency hospital activity at least in the short term.
Integrated care programmes: We need to think long term when implementing and evaluating complex change
This IAU evaluation of an integrated care programme in Nottinghamshire measured progress over six years, showing potential to reduce hospital use over the longer-term.
A collection of resources developed by the Improvement Analytics Unit to promote understanding of robust quantitative evaluation methods among analysts and those who commission evaluations.
The IAU statistical analysis protocols are intended to guide analytical processes. They include the proposed evaluation design, statistical methods, and the limitations of the analysis.
Using insight from novel data analysis has the potential to maximise the impact of improvement programmes. Here, Filipe Santos explores new findings on care home residents’ use of emergency services.