This is a news story, published by TechCrunch, that relates primarily to AI news.
For more Ai policy and regulations news, you can click here:
more Ai policy and regulations newsFor more news from TechCrunch, you can click here:
more news from TechCrunchOtherweb, Inc is a public benefit corporation, dedicated to improving the quality of news people consume. We are non-partisan, junk-free, and ad-free. We use artificial intelligence (AI) to remove junk from your news feed, and allow you to select the best tech news, business news, entertainment news, and much more. If you like this article about Ai policy and regulations, you might also like this article about
AI crawlers. We are dedicated to bringing you the highest-quality news, junk-free and ad-free, about your favorite topics. Please come every day to read the latest Robots Exclusion Protocol news, Public Content Policy news, news about Ai policy and regulations, and other high-quality news about any topic that interests you. We are working hard to create the best news aggregator on the web, and to put you in control of your news feed - whether you choose to read the latest news through our website, our news app, or our daily newsletter - all free!
web botsTechCrunch
•71% Informative
Reddit announced on Tuesday that it's updating its Robots Exclusion Protocol (robots.txt file), which tells automated web bots whether they are permitted to crawl a site.
The update is designed to deter AI companies from training their large language models on Reddit content.
The announcement comes a few days after a Wired investigation found that AI -powered search startup Perplexity has been stealing and scraping content.
VR Score
60
Informative language
50
Neutral language
79
Article tone
informal
Language
English
Language complexity
49
Offensive language
not offensive
Hate speech
not hateful
Attention-grabbing headline
not detected
Known propaganda techniques
not detected
Time-value
short-lived
External references
4
Source diversity
4
Affiliate links
no affiliate links