photog.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A place for your photos and banter. Photog first is our motto Please refer to the site rules before posting.

Administered by:

Server stats:

274
active users

#anubis

2 posts2 participants0 posts today

Woke up this morning to yet more Linode alerts and another failed server as a result of AI bots relentlessly scraping my #Gitea instance.

I heard about #Anubis (anubis.techaro.lol) when Xe Iaso (xeiaso.net) was on a recent episode of the #SelfHostedShow podcast and so it seemed like a great opportunity to give it a try. I don't really need "SEO" or any discoverability on Gitea, so hopefully the only downside is that new visitors need to wait a few secs before things load

anubis.techaro.lolMaking sure you're not a bot!

Looking at most recent logs, there are still some scrapers that fall through the cracks, and reach my backend. They use residential IPs, and user agents I can't filter. Luckily, they don't put much pressure on my infra, but... I don't like them there.

The vast majority of them are interested in my forge, so I'm thinking about deploying #Anubis there, on some URLs that humans don't usually visit.

I don't like proof-of-work things, because they penalize the legit visitor too. But there's a point where the passive defenses do not scale anymore. I can still limit the damage, though. But I've got to do some serious log digging to figure out the patterns I can shove behind Anubis.

I will also have to figure out how often the same IP address is used. As in... can I set things up in a way that if the Anubis check fails, I temporarily route that IP into a maze?

👀 Esta mañana al comentar los problemas de Wikimedia con el scrapping, un amigo programador me han hablado del proyecto Anubis github.com/TecharoHQ/anubis/
"Es bastante sencillo y fácil de implementar en cualquier web medio seria, te cargas automáticamente cualquier scrapper (sea de IA sea de lo que sea). Además, no pueden inventar nada que haga que sea rentable el scrapping con eso puesto." #aiscraping #aiscrapers #wikimedia #anubis #iahastaenlaputasopa

Weighs the soul of incoming HTTP requests using proof-of-work to stop AI crawlers - TecharoHQ/anubis
GitHubGitHub - TecharoHQ/anubis: Weighs the soul of incoming HTTP requests using proof-of-work to stop AI crawlersWeighs the soul of incoming HTTP requests using proof-of-work to stop AI crawlers - TecharoHQ/anubis

It's the #DayOfHermes aka Mercurius Day aka #Wednesday! 🐏

For #BlackHistoryMonth, I'm introducing African deities in my daily god toots. #Anubis is the god of funerary rites, protector of graves, and guide of souls in #ancientEgyptian religion. He is commonly depicted with the head of a jackal as jackals had been strongly associated with cemeteries. The Greeks associated him with #Hermes because they both guided souls to the afterlife, resulting in the syncretic god #Hermanubis.