AI Slop Is Spurring Record Requests for Imaginary Journals
The International Committee of the Red Cross has issued a warning about the rise of artificial intelligence models generating fake research papers, journals, and archives. This phenomenon is causing confusion among users who are led to believe that non-existent sources such as the Journal of International Relief or the International Humanitarian Digital Repository are legitimate.
Popular AI models like OpenAI’s ChatGPT, Google’s Gemini, and Microsoft’s Copilot are responsible for creating these misleading references. The ICRC has raised concerns about the accuracy of information provided by these models, urging users to double-check the authenticity of the sources they are directed to.
According to the Library of Virginia’s chief of researcher engagement, Sarah Falls, approximately 15% of emailed reference questions received by the library are now generated by AI models like ChatGPT. These inquiries often contain citations for both published works and unique primary source documents that do not actually exist. Falls emphasizes the challenges faced by researchers and librarians in verifying the legitimacy of these requests and recommends that users exercise caution when relying on AI-generated citations.
This is not the first instance of AI being implicated in the creation of false information. The ICRC advises individuals to consult online catalogs and references in published scholarly works to verify the authenticity of sources provided by AI models. The Library of Virginia plans to implement measures to ensure that researchers disclose the use of AI-generated sources and limit the time spent verifying information.
As the issue of AI-generated misinformation continues to grow, it is crucial for users to prioritize the accuracy and credibility of sources when conducting research. By remaining vigilant and critical of information provided by AI models, individuals can mitigate the spread of false information and uphold the integrity of academic research.
Support Science Journalism
If you value accurate and reliable information, consider supporting organizations like Scientific American that are committed to delivering impactful stories and promoting scientific literacy. By subscribing to publications like Scientific American, you contribute to the preservation of quality journalism and the advancement of knowledge in various fields. Stand up for science and join the movement to uphold truth and integrity in research and reporting.
