Header Image

How do we deploy AI safely?

Healthcare Partnership Network North, 6-7 March 2025

AI is already starting to make a real impact in healthcare but despite its early successes, many staff and patients are still wary about how, where, and when AI should be used.

At HPN North this year, a panel of senior NHS digital leaders came together to explore one of the most pressing questions in healthcare today: how do we safely and effectively deploy AI in the NHS?

From corporate use cases to clinical risks, we heard a mix of personal stories, practical insights, and honest reflections about the real-world complexities of adopting AI in a sector where safety, sensitivity, and service remain top priority.

Corporate AI: underutilised but full of potential

Lee Rickles, Chief Information Officer at Humber Teaching Hospitals NHS Foundation Trust spoke about the advancement of AI and its use from a corporate perspective. ‘I think with AI, what we’ve got is quite a significant and an accelerated way that AI is operating in the last two years. If you look at a year ago compared to where we are now, cognitive AI has evolved massively. If you went back two years, it was very rudimentary from the point of view of using it from a corporate perspective.’

Although Lee praised AI’s potential to revolutionise certain practices, listing its uses from autogenerating supervision records to speeding up the recruitment process, he also acknowledged that there still is a long way to go due to a few significant barriers, including:

  • Archaic systems (e.g. ESR) and fragmented tech infrastructure.
  • Funding and capacity issues.
  • Security concerns with cloud/data usage.

Despite some challenges, Lee did identify some ‘low hanging fruit’, which can be implemented quickly and effectively. This included tools such as Microsoft Copilot and Teams Premium, which are already boosting activity across NHS trusts.

Jacqui Cooper, Chief Nursing Information Officer at Health Innovation Manchester and NHS Greater Manchester also praised Copilot’s capabilities, especially when it comes to admin-based work. ‘I think it’s fair to say that the more senior you become as a nurse, the more admin burden you have and that’s huge. It doesn’t always come naturally to nurses to do all that side of their job. And the one thing Co-pilot can do is really help them with that.’

Holly Carr, Chief Clinical Information Officer at Stockport NHS Foundation Trust commented that corporate AI use poses a lower risk than clinical AI. ‘I think in, in some ways you’ve got the low hanging fruit and the quick wins because actually the level of risk associated with that is reduced. Interestingly, it’s, it’s the area I think we can make some of the greatest efficiencies. But with that comes the trepidation of jobs.’

Involving patients in AI and building trust in clinical settings

There is still a level of uncertainty surrounding AI, particularly when it comes to clinical use. This led the panel onto a conversation around trust, and how involved the public should be in conversations about AI used in healthcare.

Our panel host, David Walliker, Chief Digital and Information Officer, Manchester University NHS Foundation Trust kicked off the discussion by talking about the challenge of trust, both for clinicians and the public. ‘It’s the conversation we probably need to have with our clinical professionals because it’s a mindset change. It’s and there’s a trust thing.’ David likened the issue to flying, admitting, ‘I love tech, that’s my job. But I wouldn’t get on an aeroplane that didn’t have a pilot. So, there is something about where are you prepared to go up to tech. So, where do we involve the patients in this conversation?’

Although she felt that there was some level of communication needed, Jacqui expressed scepticism about how much detail patients really need. ‘I think there’s a real fine line in what we do tell them and what we don’t tell them. We don’t include patients enough in their care, but I think for AI, it’s probably a different conversation.’

Holly agreed, noting that the perception of AI could be a key barrier when it comes to public acceptance. ‘We know that AI can mean as little as helping with bookings, helping to formulate a sentence or put punctuation in, but I think to the public it seems like it’s something significant.’ She continued, ‘As soon as you mention AI, the fear is I’m being looked after by a robot… I think that’s one of the big fears and they need the reassurance that a clinician is going to look at it at the end.’

Digital literacy and bridging the generational gap

Towards the end of the session, the panel highlighted a generational gap when it comes to digital confidence.

As David pointed out, for those who have grown up in a fully digital world, using smartphones, and apps is second nature. He explained, ‘The first round of doctors in residence coming out of medical training now have only ever lived in this time. This is normal.’

However, those who didn’t could struggle to adapt due to lack of familiarity and confidence with technology.

Jacqui shared that many nurses lack confidence in using digital tools – even with something as simple as Microsoft Teams – and need active, hands-on support to feel comfortable. ‘They really do need spoon feeding. So, a plea out there, don’t switch it on and tell them – help them.’

Join our future discussions

A big thank you to our panellists for their expertise and thought-provoking insights. If you’d like to take part in future discussions register your interest to join us at HPN Midlands and HPN Mental Health on 26-27 June!