Guarding My Git Forge Against AI Scrapers (vulpinecitrus.info)
from tofu@lemmy.nocturnal.garden to selfhosted@lemmy.world on 12 Dec 14:04
https://lemmy.nocturnal.garden/post/407948

Cross posted from: lemmy.nocturnal.garden/post/407947

#selfhosted

threaded - newest

[deleted] on 12 Dec 14:14 next collapse
.
magic_smoke@lemmy.blahaj.zone on 12 Dec 14:42 next collapse

I would like to know how well iocaines spanky new redirection module works compared to Anubis.

If nothing else, to see if throwing Anubis in front of iocaine is still a worthwhile idea.

xyro@lemmy.ca on 12 Dec 18:02 next collapse

Good read, I use crowdsec to block most of the traffic considered as malicious (which tend to overlap with scrappers), but I should look into Locaine to feed garbage to the remaining ones instead of throttling.

JustTesting@lemmy.hogru.ch on 13 Dec 07:23 collapse

it’s iocaine not Locaine, tripped me up at first as well.

possiblylinux127@lemmy.zip on 12 Dec 18:44 next collapse

Honesty we need a POW system built into http.

tofu@lemmy.nocturnal.garden on 12 Dec 21:08 next collapse

A what? Not prisoners of war I guess

billhead@sh.itjust.works on 12 Dec 21:56 collapse

I’m guessing Proof of Work.

tofu@lemmy.nocturnal.garden on 12 Dec 23:03 collapse

Oh right. The article author isn’t a fan of that. I guess it’s fine while it works but I’m not too optimistic about how long it does

DaGeek247@fedia.io on 13 Dec 02:45 collapse

Yeah. The corporations with money are always going to beat the casual users without in regards to processing capability.

There are smarter ways to discourage the big companies from taking pictures of your house than by adding speed bumps to your driveway.

DaGeek247@fedia.io on 13 Dec 02:43 collapse

POW built in to the web spec would be hell. Making every single device in the world do that extra bit of work would noticeably affect energy use across the planet.

IanTwenty@piefed.social on 12 Dec 18:45 next collapse

Self-hosting anything that is deemed “content” openly on the web in 2025 is a battle of attrition between you and forces who are able to buy tens of thousands of proxies to ruin your service for data they can resell.

This is depressing. Profoundly depressing.

Sigh

Selfhoster1728@infosec.pub on 13 Dec 11:08 collapse

Build your own captcha, there’s just no other way to be sure it’s human traffic with prebuilt solutions :(