logo
welcome
Wired

Wired

The Race to Block OpenAI’s Scraping Bots Is Slowing Down

Wired
Summary
Nutrition label

81% Informative

The number of high-ranking media websites using robots.txt to “disallow’ OpenAI ’s GPTBot dramatically increased from its August 2023 launch until that fall , then steadily (but more gradually) rose from November 2023 to April 2024 .

At its peak, the high was just over a third of the websites; it has now dropped down closer to a quarter .

Onion CEO Ben Collins : "We are not doing any business with the Plagiarism Machine " While the first rush to block OpenAI 's bots appears to have ended, it’s unclear whether this lull will last.

Gillham suspects that there may be additional spikes in blocking in the future, if publishers see it as a bargaining tactic.

VR Score

80

Informative language

79

Neutral language

51

Article tone

informal

Language

English

Language complexity

50

Offensive language

not offensive

Hate speech

not hateful

Attention-grabbing headline

not detected

Known propaganda techniques

not detected

Time-value

short-lived

Affiliate links

no affiliate links