Advertisement

OpenAI says Iran, Russia used AI journalists, think tanks to influence Western media

The two campaigns were rated 4 and 5 out of 6 for severity, the first time OpenAI has reported what it considers a high-impact influence campaigns.
Listen to this article
0:00
Learn more. This feature uses an automated voice, which may result in occasional errors in pronunciation, tone, or sentiment.
U.S. intelligence officials have assessed that the Russian government’s efforts were largely in support of Trump while Iranian influence efforts were primarily targeted towards helping the electoral chances of Democratic candidate Kamala Harris. (Image Source: Getty Images)

OpenAI disclosed Thursday it shut down two influence operations from Russia and Iran that used ChatGPT and other AI tools to create fake journalist personas and covert think tanks that successfully planted stories and narratives in mainstream news publications.

One cluster of accounts, which OpenAI calls “Dark Clark,” is attributed to Russian actors. The network focused on influencing Latin American politics and culture. Its name comes from Mia Clark, a fake AI persona the group presented as the leader of the Social Research Center, a supposed Latin American think tank used to seed propaganda in news reporting.

The group’s content primarily focused on harming Ukraine’s reputation in Latin America, though it also became involved in hot-button political issues in Argentina and Bolivia.

Based on reports generated through ChatGPT, where operatives discussed wage scales for employees and hiring and firing decisions, OpenAI researchers said it’s likely the Russian group was actually in control of the Social Research Center, rather than being an employee or observer.  

Advertisement

OpenAI called it “the most complex attempt to run a front identity that we’ve disrupted over the past two and a half years.”

“The available evidence indicates that the SRC’s employees in Latin America were not aware that they were working for a Russian group,” OpenAI said. “Unlike another Russia-linked ‘think tank’ that we recently exposed, the SRC appears to have produced a majority of original content via its co-opted staff.”

OpenAI cites several fact-checks and official denials from major media organizations and government officials in Latin America that appear to be in response to Dark Clark’s propaganda.

In March, Lupa Media reported on a TikTok video falsely claiming that the Ecuadorian government was using shell companies to recruit citizens to fight for Ukraine against Russia. The actors also generated and spread fake audio clips of the Ukrainian consul in Ecuador insulting Ecuadorian citizens.

During anti-government protests in Bolivia in May, the group released another fake audio clip, this time of an employee at the state water company claiming that the government was on the verge of declaring a state of emergency and shutting off water to La Paz, prompting an official denial from the Bolivian government.

Advertisement

The report does not attribute the activity to any specific Russian government or intelligence agency. It does mention that its operators seemed particularly interested in Politology, a successor to the Wagner Group, the Russian mercenary force previously led by Yevgeny Prigozhin. According to OpenAI, the group prompted its model for information on Politology “far more” than any other Russian organization.

The Iranian campaign used many of the same AI tools to pitch written articles on the U.S.-Iran war. Operators created at least seven different fake journalist personas who managed to place dozens of stories online through legitimate media organizations. However, the stories themselves often failed to elicit many comments or social media reactions.

“We identified almost 100 articles published or syndicated under the operation’s bylines across roughly a dozen online outlets around the world,” OpenAI said. “These were small to medium outlets, generally focused on international affairs, geopolitics, and events in the Middle East.”

OpenAI said the activity resembled “a commercial actor running a for-hire influence campaign,” but did not attribute it to a specific actor or group.

Most influence campaigns tracked by OpenAI tend to be low-impact, garnering little organic engagement online and virtually no offline impact. Campaigns are rated on an impact scale of 1-6, with few rising above a 1 or 2.

Advertisement

OpenAI rated the Russian campaign a 5 and the Iranian campaign a 4, indicating they were significantly more successful in breaking through to mainstream audiences, eliciting fact checks and official denials that tend to happen when a narrative becomes so big that authorities must deny it.

Derek B. Johnson

Written by Derek B. Johnson

Derek B. Johnson is a reporter at CyberScoop, where his beat includes cybersecurity, elections and the federal government. Prior to that, he has provided award-winning coverage of cybersecurity news across the public and private sectors for various publications since 2017. Derek has a bachelor’s degree in print journalism from Hofstra University in New York and a master’s degree in public policy from George Mason University in Virginia.

Latest Podcasts