@sandro AI scrapers are ignoring robots.txt files anyway so that particular problem is not solved by services bundling it, although I would definitely prefer not having to set up robots.txt manually for everything.
@sandro AI scrapers are ignoring robots.txt files anyway so that particular problem is not solved by services bundling it, although I would definitely prefer not having to set up robots.txt manually for everything.