Disinformation In The Age Of Artificial Intelligence Ai Implications

Bonisiwe Shabane

-Dec 4, 2025, 6:48 PM

disinformation in the age of artificial intelligence ai implications

Published online by Cambridge University Press: 25 November 2021 Artificial intelligence (AI) systems are playing an overarching role in the disinformation phenomenon our world is currently facing. Such systems boost the problem not only by increasing opportunities to create realistic AI-generated fake content, but also, and essentially, by facilitating the dissemination of disinformation to a targeted audience and at scale by... This situation entails multiple ethical and human rights concerns, in particular regarding human dignity, autonomy, democracy, and peace. In reaction, other AI systems are developed to detect and moderate disinformation online. Such systems do not escape from ethical and human rights concerns either, especially regarding freedom of expression and information.

Having originally started with ascending co-regulation, the European Union (EU) is now heading toward descending co-regulation of the phenomenon. In particular, the Digital Services Act proposal provides for transparency obligations and external audit for very large online platforms’ recommender systems and content moderation. While with this proposal, the Commission focusses on the regulation of content considered as problematic, the EU Parliament and the EU Council call for enhancing access to trustworthy content. In light of our study, we stress that the disinformation problem is mainly caused by the business model of the web that is based on advertising revenues, and that adapting this model would reduce... We also observe that while AI systems are inappropriate to moderate disinformation content online, and even to detect such content, they may be more appropriate to counter the manipulation of the digital ecosystem. This study aims at identifying the right approach to tackle the disinformation problem online with due consideration for ethical values, fundamental rights and freedoms, and democracy.

While moderating content as such and using AI systems to that end may be particularly problematic regarding freedom of expression and information, we recommend countering the malicious use of technologies online to manipulate individuals. As considering the main cause of the effective manipulation of individuals online is paramount, the business model of the web should be on the radar screen of public regulation more than content moderation. Furthermore, we do support a vibrant, independent, and pluralistic media landscape with investigative journalists following ethical rules. Manipulation of truth is a recurring phenomenon throughout history.Footnote 1 Damnatio memoriae, namely the attempted erasure of people from history, is an example of purposive distortion of reality that was already practiced in Ancient... Nevertheless, owing to the rapid advances in information and communication technologies (ICT) as well as their increasing pervasiveness, disingenuous information can now be produced easily and in a realistic format, and its dissemination to... The consequences are serious with far-reaching implications.

For instance, the media ecosystem has been leveraged to influence citizens’ opinion and voting decisions related to the 2016 US presidential electionFootnote 2 and the 2016 UK referendum on leaving the European Union (EU)... In Myanmar, Facebook has been a useful instrument for those seeking to spread hate against Rohingya Muslims (Human Rights Council, 2018, para 74).Footnote 3 In India, rumors on WhatsApp resulted in several murders (Dixit... In France, a virulent online campaign on social media against a professor ended up with him being murdered (Bindner and Gluck, Reference Bindner and Gluck2020). Conspiracy theories are currently prospering.Footnote 4 And presently in the context of the Covid-19, we are facing what has been called an infodemic Footnote 5 by the World Health Organization (WHO), with multiple adverse... As commonly understood, disinformation is false, inaccurate or misleading information that is shared with the intent to deceive the recipient,Footnote 6 as opposed to misinformation that refers to false, inaccurate, or misleading information that... Whereas new digital technology and social media have amplified the creation and spread of both mis- and disinformation, only disinformation has been considered by the EU institutions as a threat that must be tackled...

The disinformation problem is particular in the sense that, firstly, the shared information is intentionally deceptive to manipulate people and, secondly, for achieving his or her goal, its author takes benefit from the modern... For these reasons, our analysis stays on the beaten path, hence the title of this article referring solely to the disinformation problem. It is also worth specifying that unlike “fake news,” a term that has been used by politicians and their supporters to dismiss coverage that they find disagreeable, the disinformation problem encompasses various fabricated information... In the rapidly evolving digital age, the proliferation of disinformation and misinformation poses significant challenges to societal trust and information integrity. Recognizing the urgency of addressing this issue, this systematic review endeavors to explore the role of artificial intelligence (AI) in combating the spread of false information. This study aims to provide a comprehensive analysis of how AI technologies have been utilized from 2014 to 2024 to detect, analyze, and mitigate the impact of misinformation across various platforms.

This research utilized an exhaustive search across prominent databases such as ProQuest, IEEE Explore, Web of Science, and Scopus. Articles published within the specified timeframe were meticulously screened, resulting in the identification of 8103 studies. Through elimination of duplicates and screening based on title, abstract, and full-text review, we meticulously distilled this vast pool to 76 studies that met the study’s eligibility criteria. Key findings from the review emphasize the advancements and challenges in AI applications for combating misinformation. These findings highlight AI’s capacity to enhance information verification through sophisticated algorithms and natural language processing. They further emphasize the integration of human oversight and continual algorithm refinement emerges as pivotal in augmenting AI’s effectiveness in discerning and countering misinformation.

By fostering collaboration across sectors and leveraging the insights gleaned from this study, researchers can propel the development of ethical and effective AI solutions. This is a preview of subscription content, log in via an institution to check access. Price excludes VAT (USA) Tax calculation will be finalised during checkout. The data presented in this study are available on request from the corresponding author. Baptista JP, Gradim A (2022) A working definition of fake news. Encyclopedia 2(1):66

Edited by: Ludmilla Huntsman, Cognitive Security Alliance, United States Reviewed by: J. D. Opdyke, DataMineit, LLC, United States Hugh Lawson-Tancred, Birkbeck University of London, United Kingdom *Correspondence: Alexander Romanishyn, a.romanishyn@ise-group.org

Received 2025 Jan 31; Accepted 2025 Jun 30; Collection date 2025. López-Borrull, A.; Lopezosa, C. Mapping the Impact of Generative AI on Disinformation: Insights from a Scoping Review. Publications 2025, 13, 33. https://doi.org/10.3390/publications13030033 López-Borrull A, Lopezosa C.

Mapping the Impact of Generative AI on Disinformation: Insights from a Scoping Review. Publications. 2025; 13(3):33. https://doi.org/10.3390/publications13030033 López-Borrull, Alexandre, and Carlos Lopezosa. 2025.

"Mapping the Impact of Generative AI on Disinformation: Insights from a Scoping Review" Publications 13, no. 3: 33. https://doi.org/10.3390/publications13030033 López-Borrull, A., & Lopezosa, C. (2025). Mapping the Impact of Generative AI on Disinformation: Insights from a Scoping Review.

Publications, 13(3), 33. https://doi.org/10.3390/publications13030033 A new analysis published in Journalism & Mass Communication Quarterly warns the journalism and media sectors about the way artificial intelligence (AI) is reshaping the scale, speed and psychology of disinformation in ways that... The report argues that AI-powered falsehoods now pose risks that extend far beyond fabricated content, influencing public perception, undermining news legitimacy and altering the very way audiences interpret reality. The study, titled “Disinformation in the Age of Artificial Intelligence (AI): Implications for Journalism and Mass Communication”, offers one of the most comprehensive examinations to date of the evolving relationship between generative AI and... The authors argue that AI has transformed disinformation into a multidimensional problem that demands both technological and institutional responses.

The study finds that AI has drastically changed how disinformation is produced, amplified and consumed. Generative tools such as ChatGPT, Gemini, Midjourney, Stable Diffusion and voice-cloning systems enable the rapid creation of synthetic narratives, fabricated images and deepfake videos at a scale previously impossible. This shift lowers production barriers for malicious actors, providing low-cost tools capable of generating highly persuasive, context-tailored disinformation for political, financial or ideological purposes. The authors outline four interconnected layers that now drive AI-mediated disinformation: creation, dissemination, reception and perception. On the creation side, AI can fabricate text, audio and images that allow political operatives or foreign actors to mimic high-profile individuals, forge video evidence or produce targeted propaganda. The report highlights incidents such as AI-generated robocalls using cloned presidential voices and fabricated political scandals timed to influence election cycles.

Such cases show how synthetic content can interfere with democratic processes and complicate traditional fact-checking workflows. At the dissemination level, AI-powered bot networks, automated social accounts, and synthetic personas can amplify false messages at high velocity. These tools exploit algorithmic engagement patterns, bypass platform moderation and simulate authentic online behavior, making coordinated disinformation campaigns harder to detect. The study notes that generative AI also supports micro-targeted manipulation, allowing tailored propaganda to reach individuals based on ideology, identity, or psychological vulnerability. Our research integrity and auditing teams lead the rigorous process that protects the quality of the scientific record A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity.© Copyright 2025 IEEE - All rights reserved.

Disinformation In The Age Of Artificial Intelligence Ai Implications

People Also Search

Published Online By Cambridge University Press: 25 November 2021 Artificial

Having Originally Started With Ascending Co-regulation, The European Union (EU)

While Moderating Content As Such And Using AI Systems To

For Instance, The Media Ecosystem Has Been Leveraged To Influence

The Disinformation Problem Is Particular In The Sense That, Firstly,