If you let AI advise you on health, prepare for problems

If a few years ago you were told that you would trust what a machine says about your body, you would laugh. However, here we are: the search for information driven by artificial intelligence (AI) has become the norm, especially in critical areas like health. Although AI offers instant answers, this immediacy can lead users to not explore original sources or relevant nuances. A recent MIT study indicates that this phenomenon can have a significant cognitive cost, and it may suppress the critical thinking necessary to question the validity of […]

If a few years ago you were told that you would trust what a machine says about your body, you would have laughed. However, here we are: the search for information driven by artificial intelligence (AI) has become the norm, especially in critical areas like health. Although AI offers instant answers, this immediacy can lead users to not explore original sources or relevant nuances. A recent MIT study indicates that this phenomenon can have a significant cognitive cost and may suppress the critical thinking necessary to question the validity of the information presented.

AI is fine

A personal investigation into digital health trends revealed how responses generated by AI tools can mask the lack of credibility in their sources. When analyzing a statistical data point that was gaining relevance, it was discovered that the source was a blog without authority or proper credentials, even though the data had been correctly referenced. This type of misunderstanding can be dangerous in the health field, where misinterpretation of data can lead to harmful decisions for individuals’ well-being.

The excessive use of AI tools can also affect critical reading skills that are essential in healthcare. The lack of questioning about the origin and context of the information can result in a blind acceptance of what is presented as objective truth by AI. This raises questions about who benefits from the messages conveyed and what perspectives may be missing.

Both individuals and health organizations have the responsibility to promote critical consumption of information. To ensure that people access accurate and well-referenced content, it is essential to reinforce basic literacies and demand high standards of transparency in technological platforms. Collaboration between health brands, educators, and regulators is essential to ensure that AI does not replace critical thinking but rather complements access to quality information.