hylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 7 days agoBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersimagemessage-square79linkfedilinkarrow-up1587arrow-down17file-text
arrow-up1580arrow-down1imageBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlershylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 7 days agomessage-square79linkfedilinkfile-text
minus-squareFreedomAdvocate@lemmy.net.aulinkfedilinkEnglisharrow-up1·edit-213 hours agoWhenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
minus-squarepoVoq@slrpnk.netlinkfedilinkEnglisharrow-up1·13 hours agoFor static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching. And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.
Whenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
For static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching.
And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.