OpenAI, a leading artificial intelligence company, has released its first-ever report detailing how its AI tools have been exploited for covert influence operations aimed at spreading disinformation. The report discloses that OpenAI has successfully disrupted and shut down several disinformation campaigns originating from various actors in Israel – as well as Russia, China, and Iran – within the past three months.
According to the report, these malicious actors utilized OpenAI's generative AI models to create and disseminate propaganda content across multiple social media platforms. Additionally, they employed these models to translate their content into different languages, potentially targeting diverse audiences.
While OpenAI's researchers confirmed that none of the identified campaigns gained significant traction or reached large audiences, the report highlights the growing concern surrounding the potential misuse of generative AI technologies to amplify and enhance online disinformation efforts.
The 39-page report provides a detailed account of how OpenAI's AI software was utilized for propaganda purposes. The company claims to have identified and banned accounts associated with five separate covert influence operations, originating from a mix of state-affiliated and private actors.
Among the identified campaigns was an Israeli political firm called Stoic that ran a network of fake social media accounts that created various content, including posts criticizing the antisemitic campus protests across the US.
In addition, two Russian operations were identified that generated content critical of the United States, Ukraine, and several Baltic nations. One of these operations employed an OpenAI model to debug code and create a bot that posted on the Telegram messaging platform.
Similarly, a Chinese influence operation generated text in English, Chinese, Japanese, and Korean, which was then posted on Twitter and the blogging platform Medium.
Iranian actors exploited OpenAI's technology to generate full articles attacking the US and Israel, which were subsequently translated into English and French for dissemination.
