2.4 The importance of developing confidence in Artificial Intelligence (AI) among patients and the public

An overview of the importance of developing confidence in artificial intelligence (AI) among patients.

While this report focuses on understanding confidence in artificial intelligence (AI) technologies among the healthcare workforce, it is important to recognise that improving confidence in AI amongst patients and the public (including through public engagement and participation initiatives) will play an equally crucial part in the successful adoption of AI technologies in health and care settings.

Interviewees for this research cautioned that without public acceptance and confidence in AI, it will be highly challenging from an ethical and patient-led care perspective to use these technologies in health and care settings. Developing confidence in AI technologies across patient groups and communities through public participation and education activities will be a necessary component of a holistic approach to deploying AI technologies effectively and safely.

A survey of people across England, conducted as part of developing the National Strategy for AI in Health and Social Care,⁸ found that almost half of the 1,000 respondents had heard nothing at all or very little about AI. The results also showed that greater awareness or understanding of AI leads to greater belief in the benefits it can bring to health and social care.

Interviewees for this research noted that conducting early and ongoing engagement of patients and the public, to inform how AI is developed and implemented, can enhance confidence in AI both amongst the public and in the healthcare workforce (see section 4.1).

Although most current activities focus on the provision and access of patient data, further activities could aim to strengthen the involvement of patients in the design, governance and implementation of AI, including in safety reporting and post-market surveillance (monitoring the performance and safety of an AI technology when released on the market).

For example, the NHS AI Lab will be trialling the engagement of patients to identify possible risks and biases during the early stages of AI product development. This will support industry innovators to assess these risks and make any necessary adjustments to their products.¹⁵

References

⁸ The National Strategy for AI in Health and Social Care - NHS AI Lab programmes - NHS Transformation Directorate. https://www.nhsx.nhs.uk/ai-lab/ai-lab-programmes/the-national-strategy-for-ai-in-health-and-social-care/. Accessed February 28, 2022.

¹⁵ UK to pilot world-leading approach to improve ethical adoption of AI in healthcare. GOV.UK. https://www.gov.uk/government/news/uk-to-pilot-world-leading-approach-to-improve-ethical-adoption-of-ai-in-healthcare. Accessed March 8, 2022.