“Reddit has updated its robots.txt file to block all bots from scraping any part of the site.”
Google pays Reddit around $60 million for its data. Now Bing, DuckDuckGo, Mojeek and Qwant can’t show fresh Reddit results. Reddit says it believes in an open internet and that the block has nothing to do with the deal. The only search engine still invited in is the one writing checks.