And some AI companies like Perplexity just shout “YOLO” and try to stealth-crawl it anyway. [404 Media; Wired]
it’s fucking wild that automated scraping without permission used to be something you did as a last resort under strict restrictions and secrecy, cause whoever had the data you needed wasn’t exposing a usable API. but not in the AI industry, there it’s the fucking foundation of the entire company