AI vs. Truth: OpenAI, Meta, and TikTok fight shady disinformation campaigns

Tomcat

Professional
Messages
2,379
Reputation
4
Reaction score
407
Points
83
Skillful digital fakes have become the main cyber weapon of the 21st century.

OpenAI, Meta, and TikTok are actively fighting covert influence campaigns, many of which use artificial intelligence to manipulate public opinion and political outcomes. The companies ' actions helped identify and stop several such operations, which we will discuss in more detail below.

OpenAI actions
OpenAI revealed five influence operations related to various countries, including China, Iran, Israel and Russia. These operations used AI models to create comments and articles, create fake social media profiles, conduct research, debug code, and translate texts.

The network, codenamed Bad Grammar, used Telegram to send out low-quality content aimed at audiences in different countries. The second network, Doppelganger, generated comments and translated articles for publication on fake news sites on social networks.

Other networks identified include the Spamouflage network, IUVM, and Zero Zeno, all of which used AI to create and distribute propaganda content.

Meta Efforts
Meta also actively opposes coordinated hidden influence campaigns. In its quarterly threat response report, the company announced the removal of nearly 500 fake and compromised Facebook and Instagram accounts associated with Operation STOIC.

Meta also removed hundreds of accounts from various countries for coordinated inauthentic behavior aimed at influencing public opinion and promoting political narratives.

In addition, Meta found that many hidden influence campaigns use modern digital tools, including AI, to create realistic text, images, and even videos. Despite this, the company stressed that it has not yet recorded a significant increase in the audience of these campaigns.

TikTok measures
The TikTok video platform also identified and suppressed several networks of hidden influence. These networks, originating in different countries, have attempted to manipulate public opinion and political outcomes using AI and other modern technologies.

In general, the TikTok platform, which is under the close attention of the US authorities, has recently become a very popular place for spreading misinformation. So, recently, a sophisticated influence campaign known as Emerald Divide was discovered on the site, using AI to create and distribute content aimed at destabilizing Israeli society.

What's in the bottom line?
The joint efforts of OpenAI, Meta, and TikTok demonstrate the importance of global collaboration in combating covert influence campaigns. The use of AI to create and spread disinformation is becoming increasingly common, and technology companies are playing a key role in countering these threats.

Researchers continue to monitor the situation closely and share information to prevent further spread of misinformation and manipulation on the web.
 
Top