Meta considers imposing ‘sanctions’ on users who neglect to reveal the utilization of generative AI for images.

Facebook, Instagram, and Threads will implement new standards pertaining to AI-generated content in the near future, as stated in a blog post by Meta on January 6th.
Any content that is determined to be AI-generated, either through metadata or intentional watermarking, will be clearly labeled. Users on Meta platforms will also have the ability to report unlabeled content that they suspect is generated by artificial intelligence.
This may sound familiar, as it resembles Meta’s previous content moderation practices. In the past, when AI-generated content was not as prevalent, the company (then known as Facebook) created a system for users to report content that violated the platform’s terms of service.
Fast forward to 2024, and Meta is now empowering users across its social networks to flag content once again, tapping into what could potentially be the largest crowd-sourcing force of consumers in the world.
This also means that creators on Meta’s platforms will be required to label their own content as AI-generated, whenever applicable, or face potential consequences.
According to the blog post:
Detecting AI-generated content
Meta states that whenever its built-in tools are used to create AI-generated content, the content is given a watermark and label that clearly indicates its origin. However, not all generative AI systems have these safeguards in place.
The company is collaborating with other companies through consortium partnerships, including Google, OpenAI, Microsoft, Adobe, Midjourney, and Shutterstock, to develop methods for detecting invisible watermarks on a large scale.
Unfortunately, these methods currently only apply to AI-generated images. The blog post explains, “While companies are starting to include signals in their image generators, they haven’t started including them in AI tools that generate audio and video on the same scale.”
As a result, Meta is currently unable to detect AI-generated audio and video at a large scale, which includes deepfake technology.
In related news, Meta has reportedly unveiled the Artemis chip, which aims to enhance AI capabilities and reduce reliance on Nvidia, according to a recent report.