Social media platforms are moving to tighten mechanisms for identifying AI-generated content, amid the increasing use of these tools in producing images, videos, and texts, and the accompanying concerns about misinformation, fake accounts, and spam content.

In this context, TikTok announced the launch of a set of educational resources and new technologies to help users understand content created or modified by AI, along with developing systems to detect accounts that rely on these tools to post large amounts of content.

The platform intends to test enhanced systems aimed at detecting accounts dedicated to posting AI-generated content, with an initial focus on areas that could affect public trust or user safety.

These areas include politics, current events, financial advice, and medical information—topics where false or inaccurate content could cause harm beyond entertainment or creative uses.

According to the company, this step builds on existing enforcement systems that led to the removal of more than 86 million fake accounts in the first quarter of 2026.

TikTok did not clarify in its announcement the technical criteria it will use to distinguish between accounts that legitimately employ AI and those that use it to produce spam or misleading content.

This issue highlights a key challenge for platforms because using AI does not, in itself, mean the content is violative; rather, the problem lies in its nature, context, volume, and purpose of publication.

Transparency mechanisms rely on content credentials, creator disclosure, and invisible watermarks (Reuters)

Clarification labels

TikTok said it has placed clarification labels on more than three billion AI-generated videos, through a combination of content credentials, disclosure tools available to creators, and invisible watermarking techniques.

These tools aim to give the user an indication of whether the video was created with AI or underwent significant modifications using it, instead of leaving them to rely on personal judgment or visual inspection alone.

However, clarification labels do not guarantee that all AI-generated material will be detected, because their effectiveness depends on the commitment of content creators to disclosure, the presence of technical data attached to the file, and the platform's systems' ability to identify modifications that may be made externally.

The company also announced its joining the steering committee of the 'Coalition for Content Provenance and Authenticity,' known as 'C2PA,' an alliance working to develop technical standards that help document the origin of content and the modifications it has undergone.

The platform had started using the 'Content Credentials' standard about two years ago, aiming to read data showing whether content was created or modified using AI tools.

Educational resources

Alongside technical solutions, the company launched new educational resources, in collaboration with the National Association for Media Literacy Education and AI expert Henry Aider.

These resources focus on helping users recognize indicators of AI-generated content, understand the limits of these tools, and evaluate the material they watch before sharing or relying on it.

TikTok states that educational content it developed in partnership with entities, including 'No Filter' and 'Raspberry Pi,' has exceeded 200 million views since the program's launch in November 2025, while it allocated more than four million dollars to support these initiatives.

Viewership numbers alone do not measure the extent of improvement in users' ability to distinguish between real and fabricated content, but they reflect the growing interest in the topic of media literacy as generative tools become more widespread.

The steps reflect an attempt to balance supporting creative use of AI and limiting spam or misleading content (AFP)

Creative use

The tightening of detection tools coincides with the expansion of AI use in producing creative content, including scene design, video editing, idea summarization, and proposing initial structures for clips.

In the Middle East and North Africa region, some content creators use these tools in education, visual storytelling, and artistic experiments, while platforms work to balance supporting innovation and limiting uses that could undermine trust.

TikTok pointed to tools like 'Smart Split' and 'AI Outline,' in addition to the 'Manage Topics' feature, which allows users greater control over the amount of AI-generated content shown to them.

These measures reflect a broader shift in platforms' handling of AI, as the focus is no longer limited to providing production tools, but has extended to classifying content, clarifying its source, and reducing its spread when used in an automated or misleading manner.

The success of these efforts remains tied to the accuracy of detection systems, the clarity of enforcement criteria, and users' ability to understand clarification labels, especially in topics requiring a high level of precision and trust.