The Eve Appeal shares concerns over Google AI search summaries
PIF member The Eve Appeal has shared concerns over Google AI summaries listing inaccurate health information. The charity has published a news story on its website and social media accounts to raise awareness of the limitations of AI overviews (AIOs). It warns the AI summary may not always pull accurate and appropriate information and may source information from non-UK websites. Summaries also create a "no click" approach which may stop people from finding out further information and being signposted to support like the Ask Eve Nurse service.
Response was 'completely wrong'
Putting the summaries to the test, The Eve Appeal searched for "vaginal cancer symptoms and tests" on Google and immediately found inaccurate information.
The summary listed a Pap test as a test for vaginal cancer. A Pap test is an old type of cervical screening used in England, Scotland or Wales before 2019 and still used in America. It is a test to prevent cervical cancer by looking for signs of cell changes which can be treated or monitored to prevent cancer from developing. It is not a test to detect cancer. The Eve Appeal described the search results as "completely wrong".
The charity also found the AI summary changed when the same search was repeated. Different responses were provided each time, pulling information from different sources.
To help people search more safely, The Eve Appeal also shared tips to find trusted and reliable health information. These included looking for the PIF TICK, and adding "-AI" to the end Google searches.
Read more on The Eve Appeal website here.
Recommendations on AI overviews
The Eve Appeal is one of more than 50 organisations which have endorsed recommendations made after PIF, Macmillan and Marie Curie collaborated on a report assessing the impact of Google AI search summaries on the health sector.