OpenAI has recently banned multiple Russian and Iranian accounts for misusing its AI tools in influence operations across various nations. These operatives used OpenAI’s chatbot, ChatGPT, to craft false narratives that infiltrated mainstream news channels. On one occasion, this led to a reaction from a European Parliament member.
Impacts and Insights
Upon investigation, OpenAI discovered that false narratives reaching established media outlets had a broader audience than those spread through fake social media accounts. Russian operations mainly targeted Latin America, aiming to erode support for Ukraine and sway local politics. A significant campaign impersonated an educational authority, prompting Peruvian schools to hold events about Stepan Bandera, a controversial Ukrainian figure.
One such event in Peru was reported by the local outlet Extra, leading to a Polish news report. This triggered a response from a far-right Polish European Parliament member, who suggested banning entry to Bandera supporters. OpenAI noted that this Russian tactic fueled historical tensions between Ukrainians and Poles.
AI’s Role in Propaganda
Darren Linvill of Clemson University’s Media Forensics Hub highlighted how these Russian operatives engaged in ‘narrative laundering’ by creating fake stories and personas. An example of this was running a sham think tank in Latin America that unknowingly involved real researchers. This bore resemblance to past Russian operations linked to Yevgeny Prigozhin’s Internet Research Agency, tied to the 2016 U.S. election interference.
The use of AI in these operations was not the primary workload but served as a shortcut that eventually exposed the operatives. Iranian operatives, on the other hand, used AI to develop content in Persian and English, focusing on U.S.-Iran relations. These accounts created fake authors who published nearly 100 articles in small media outlets, including the Daily Kos and Middle East Monitor. Linvill stressed that AI enabled these campaigns to produce content that appeared authentic enough for reputable outlets.
