TL;DR
Chinese government and actors are leveraging AI to conduct covert propaganda campaigns, tighten censorship, and influence foreign public opinion. These activities highlight AI’s potential as a tool for authoritarian control and information manipulation.
Chinese actors are using AI models such as ChatGPT to conduct covert propaganda campaigns and enhance domestic censorship, according to recent disclosures from OpenAI and independent research. This development underscores the growing role of AI in enabling authoritarian regimes to manipulate information and control narratives both domestically and internationally.
OpenAI reported that Chinese operatives used ChatGPT to generate and spread polarizing content aimed at slowing the development of U.S. AI infrastructure. These efforts involved creating fake social media accounts, amplifying pro-China messages, and discrediting critics, with activities linked to Chinese law enforcement. OpenAI also identified a separate campaign to influence Japanese public opinion by inciting criticism of a Japanese politician, using AI to plan and execute a large-scale disinformation effort involving thousands of fake accounts.
Research from the Australian Strategic Policy Institute indicates that China’s use of AI for censorship has become faster and more precise, allowing the government to erase or flag content at an increased rate. Additionally, studies show that Chinese state-sponsored news sources influence the training data of major American AI models, resulting in responses that are more favorable to China in Chinese-language queries. This bias is seen as a way to incorporate Beijing’s narratives into AI systems.
Experts like Kenton Thibaut from the Atlantic Council highlight that AI can improve the efficiency and scope of information campaigns, which can be utilized by regimes to extend their influence and control.
This development demonstrates the potential for AI to be used by authoritarian governments to influence public opinion, manage information, and suppress dissent. It raises questions about the integrity of information ecosystems and the importance of developing safeguards against disinformation and manipulation facilitated by AI.
As AI technology becomes more accessible, there is an increasing need for international cooperation to establish norms and regulations aimed at preventing misuse by regimes seeking to reinforce control and influence perceptions globally.
AI in Content Moderation: Automating Online Safety with Artificial Intelligence: Strategies and Tools for Ethical and Effective AI-Powered Online … (Tech Horizons: Your Gateway to Innovation)
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Rise of AI in State-Controlled Propaganda and Censorship
China has a history of adopting new technologies to support its political objectives, including mobile phones and digital media. Recent research indicates that AI enables the Chinese government to conduct more targeted censorship and influence operations, with state-sponsored sources contributing to shaping AI training data to favor Chinese perspectives. Past incidents involving efforts to discredit critics and influence foreign opinion suggest a strategic approach to using AI for information management.
“AI can assist in planning and executing information campaigns with greater efficiency, potentially extending the reach and impact of influence efforts.”
— Kenton Thibaut, Atlantic Council
Unclear Extent and Future of AI-Driven Influence Campaigns
The full scope and scale of these influence and censorship activities are not yet fully understood. It remains uncertain how widespread these tactics are across different regimes and what measures might be effective in counteracting them in the future.
Monitoring and Regulating AI for Preventing Abuse
Efforts by governments, technology companies, and international organizations are expected to focus on monitoring AI use, establishing safeguards, and developing regulations to address potential misuse. Ongoing research and disclosures will continue to inform understanding of these activities and their evolving nature.
Key Questions
How are Chinese actors using AI to influence foreign public opinion?
They utilize AI to generate and amplify content that supports Chinese narratives, create fake social media accounts, and organize disinformation campaigns targeting critics and foreign audiences, as indicated by recent reports from OpenAI and independent research.
AI can facilitate increased censorship, targeted disinformation, and surveillance, which may strengthen the capacity of authoritarian regimes to suppress dissent and shape narratives domestically and internationally.
Are Western AI models biased toward Chinese narratives?
Research suggests that AI models trained on Chinese state-sponsored sources may respond more favorably to questions about China in Chinese, indicating potential biases that could influence perceptions and responses.
Implementing international regulations, increasing transparency in AI training data, and developing detection and mitigation tools are important steps to reduce the risk of AI-facilitated influence campaigns.
Source: The Atlantic
