logo
welcome
Insider

Insider

Meta unleashes new web crawling bots with sneaky ways of avoiding a rule that blocks scraping of online content

Insider
Summary
Nutrition label

76% Informative

Meta recently rolled out new bots that crawl the web and suck up data for training AI models.

These bots have features that make it harder for website owners to block their content from being scraped and collected.

Only 1.5% of the top websites block the new Meta-ExternalAgent bot, according to Originality.ai .

VR Score

70

Informative language

63

Neutral language

78

Article tone

semi-formal

Language

English

Language complexity

54

Offensive language

not offensive

Hate speech

not hateful

Attention-grabbing headline

not detected

Known propaganda techniques

not detected

Time-value

short-lived

Affiliate links

no affiliate links