ooli2@lemm.ee to Technology@lemmy.mlEnglish · 1 month agoOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square8linkfedilinkarrow-up193arrow-down10cross-posted to: [email protected][email protected]
arrow-up193arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comooli2@lemm.ee to Technology@lemmy.mlEnglish · 1 month agomessage-square8linkfedilinkcross-posted to: [email protected][email protected]
minus-squareOnno (VK6FLAB)@lemmy.radiolinkfedilinkarrow-up32·1 month agoIn my experience, the single biggest bully on the internet are the servers controlled by Meta which in my experience literally perform DDoS attacks whilst crawling, hitting sites several orders of magnitude more than all the others combined. Actively blocking them was the only option left.
In my experience, the single biggest bully on the internet are the servers controlled by Meta which in my experience literally perform DDoS attacks whilst crawling, hitting sites several orders of magnitude more than all the others combined.
Actively blocking them was the only option left.