虎嗅

Silicon Valley companies are starting to clean up the AI "garbage"

原文:硅谷公司开始清理AI垃圾

Summary of Key Points

AI-generated “garbage content” – such as meaningless recipes, fake biographies, and bizarre images and videos – has become a pervasive problem on major platforms like Google, Amazon, and Facebook, polluting the online information environment. Now, tech companies in Silicon Valley (including Spotify, YouTube, and LinkedIn) are finally taking steps to address this issue on a large scale. However, the cleanup process is facing numerous challenges: many of these companies were once the driving forces behind the creation of such content using AI tools, making it difficult to distinguish between legitimate creators and spam. Moreover, defining and managing this type of content is a systemic problem that cannot be solved by simply deleting it.

1. How widespread is AI-generated garbage content?

  • Searching for recipes on Google often yields irrelevant results like “glue pizza.”
  • Biographies sold on Amazon may be AI-created fakes.
  • Facebook posts include meaningless images like “shrimp Jesus.”
  • Specific statistics are even more alarming:
  • Spotify removed 75 million duplicate and low-quality tracks last year, which accounted for a significant portion of its music library.
  • YouTube deleted 130,000 low-quality AI-generated channels within half a year.
  • Nearly half of the new songs uploaded to Deezer each day are AI-created, with many going unheard.
  • One-third of the content uploaded to Apple Music is generated by AI.
  • On X (formerly Twitter), nearly half of posts over 50 characters long were written by AI.
  • Even Merriam-Webster has selected “AI garbage” as its Word of the Year for 2025, highlighting the severity of the issue.

2. Why are Silicon Valley companies only now taking action?

  • Users are becoming increasingly frustrated with the amount of low-quality, click-bait content, and platforms are struggling to manage the situation:
  • Users can no longer find the information they want; for example, Meta’s AI-driven video feeds have been criticized as a “garbage showcase.”
  • The burden on platforms is increasing as garbage content crowds out high-quality content. For instance, 20% of new recommendations on YouTube are AI-generated, and some spam channels generate millions in revenue annually but are eventually banned.
  • Public opinion has shifted; experts warn that allowing this behavior to continue will suppress human creativity and corrode culture, while users complain about the inability to distinguish between authentic and fake content.

3. What measures are platforms taking to clean up the mess?

  • Platforms are using various methods:
  • Direct deletion: Spotify removes duplicate songs; YouTube deletes low-quality channels; TikTok deleted 377,000 AI-generated videos in the first three months of this year.
  • User participation: LinkedIn added a button for reporting AI-generated content; Pinterest and TikTok allow users to control the amount of AI-related content they see.
  • AI tools: YouTube uses AI to analyze upload speeds and repetitive templates to identify spam accounts; Substack uses AI to check if long posts are written by humans.
  • Revenue restrictions: X has banned apps that use robots to post garbage content, and YouTube has suspended the revenue generation of some spam channels.

4. Cleaning up is not easy:

  • There are several challenges, including:
  • Legitimate creator protection: YouTube’s criteria for identifying spam (fast upload speeds, repetitive templates) may mistakenly remove high-quality creators.
  • Vague definitions: Not all AI-generated content is considered garbage; for example, using AI to assist in writing articles is a controversial issue.
  • Platform hypocrisy: Many platforms that are cleaning up AI-generated content were once responsible for its proliferation. For instance, Meta promised to address the problem but later rolled out an image generator that abused user data before removing it.

5. Experts warn: This is a systemic issue

  • Experts from Columbia University point out that AI-generated garbage is not just a matter of bad content; it’s a systemic problem affecting the entire information ecosystem:
  • AI is a double-edged sword: platforms rely on it to increase user engagement, but it also produces problematic content.
  • A one-size-fits-all approach won’t work; legitimate AI-assisted creation should not be penalized.
  • If platforms fail to address this effectively, users will move to other services.

In short, cleaning up AI-generated garbage is more complex than simply deleting it. It requires addressing the underlying incentives of platform algorithms and balancing the benefits of AI with its negative impacts.

This news article highlights that while AI has brought convenience, it has also created new challenges. Platforms are beginning to recognize these issues, but there’s still a long way to go. Users should be cautious when using the internet to avoid being misled by low-quality AI content.