AI-generated medical advice on Google’s search engine may be harmful, according to an investigation by The Guardian. Experts argue that the company is not paying sufficient attention to safety warnings and fails to inform users clearly enough that information provided by AI may be erroneous.
Google states that its AI always advises users to consult a doctor, but in reality, this warning is not easily visible. The Guardian’s investigation revealed that the disclaimer stating the information may be inaccurate and requires verification is placed at the very bottom of the text.
To read this warning, one must specifically click the “Show more” button and then scroll to the end of the text. Furthermore, the warning is written in such small and faint font that most users simply do not notice it.
Why is this dangerous?
AI experts and patient rights advocates consider this approach highly dangerous. Experts identify three main threats in the functionality of Google’s AI system that directly pose a risk to user health:
-
The Illusion of a “Perfect Answer”: The AI-generated summary creates a false sense of a definitive answer, which discourages users from verifying information or conducting further research.
-
AI “Hallucinations”: This problem is exacerbated by the tendency of AI models to “hallucinate,” where the system presents incorrect data with a convincing tone. In a medical context, this could prove fatal.
-
Speed Over Accuracy: The situation is further complicated by the fact that Google’s search algorithm is optimized for providing answers as quickly as possible, rather than ensuring their accuracy.
What are the experts demanding?
Representatives from the medical and technology sectors are calling on Google to make safety disclaimers prominent by placing them at the very top of search results, using the same font size as the main information. They argue this is critically important to ensure that users do not accept information unconditionally and, when necessary, prioritize consultation with their own doctors.
A Google representative stated that the company continues to refine the system and often reminds users of the need to visit a professional within the text itself. However, experts believe more radical steps are needed to protect patients.
