Gibt es #Anubis schon als Wordpress-Plugin?
Gibt es #Anubis schon als Wordpress-Plugin?
Very nice, #sourcehut is more using #anubis. For code forges, it really should not be skipped. So many crawlers just do not care of what you say can be used.
https://sourcehut.org/blog/2025-04-15-you-cannot-have-our-users-data/
Woke up this morning to yet more Linode alerts and another failed server as a result of AI bots relentlessly scraping my #Gitea instance.
I heard about #Anubis (https://anubis.techaro.lol) when Xe Iaso (https://xeiaso.net) was on a recent episode of the #SelfHostedShow podcast and so it seemed like a great opportunity to give it a try. I don't really need "SEO" or any discoverability on Gitea, so hopefully the only downside is that new visitors need to wait a few secs before things load
I was not particularly bothered by #Anubis at first, but having to wait upwards of 15 seconds to access some of the websites using it is uhhh...
bad. yeah I think I'd call that bad.
Looking at most recent logs, there are still some scrapers that fall through the cracks, and reach my backend. They use residential IPs, and user agents I can't filter. Luckily, they don't put much pressure on my infra, but... I don't like them there.
The vast majority of them are interested in my forge, so I'm thinking about deploying #Anubis there, on some URLs that humans don't usually visit.
I don't like proof-of-work things, because they penalize the legit visitor too. But there's a point where the passive defenses do not scale anymore. I can still limit the damage, though. But I've got to do some serious log digging to figure out the patterns I can shove behind Anubis.
I will also have to figure out how often the same IP address is used. As in... can I set things up in a way that if the Anubis check fails, I temporarily route that IP into a maze?
Esta mañana al comentar los problemas de Wikimedia con el scrapping, un amigo programador me han hablado del proyecto Anubis https://github.com/TecharoHQ/anubis/
"Es bastante sencillo y fácil de implementar en cualquier web medio seria, te cargas automáticamente cualquier scrapper (sea de IA sea de lo que sea). Además, no pueden inventar nada que haga que sea rentable el scrapping con eso puesto." #aiscraping #aiscrapers #wikimedia #anubis #iahastaenlaputasopa
Neues Tool namens Anubis schützt Open-Source-Entwickler vor KI-Scrapern! Programmierer Xe Iaso entwickelte eine clevere Lösung, um KI-Crawler auszusperren, ohne menschliche Nutzer zu beeinträchtigen. Erfahrt mehr über diesen innovativen Ansatz!
https://t3n.de/news/tool-open-source-entwickler-gegen-ki-scraper-1680507/ #OpenSource #KI #Security #Anubis #Entwickler #newz
Anubis: self hostable scraper defense software
Weigh the soul of incoming HTTP requests using proof-of-work to stop AI crawlers
Web scrapers run by LLM companies have become so aggressive that some website operators feel a need to use Anubis, a proof-of-work barrier using script in the browser. I'm told it's less bad than blocking entire countries or making your readers find all the traffic lights.
https://anubis.techaro.lol/
@fijxu Thank you so much for using a proof-of-work #captcha https://nadeko.net/announcements/invidious-and-the-bot-problem/ instead of centralised proprietary mass #surveillance aka Google/CloudFlare!
You're a hero.
well, my company network got blocked by GNOME GitLab's anubis...
well technically they are right, the company I am working in is an AI company lol
Antinous passes the Egyptian judgment of the weighing of the heart easily, whereupon #Anubis instructs newly deified #Antinous / #Osiris in the finer points of being a #psychopomp guide who leads seekers through the dark of night to the light of a new day. Art by kezza232022
DNA analysis show that the golden Jackel is actually a kind of wolf, so Anubis is actually a wolf.
It's the #DayOfHermes aka Mercurius Day aka #Wednesday!
For #BlackHistoryMonth, I'm introducing African deities in my daily god toots. #Anubis is the god of funerary rites, protector of graves, and guide of souls in #ancientEgyptian religion. He is commonly depicted with the head of a jackal as jackals had been strongly associated with cemeteries. The Greeks associated him with #Hermes because they both guided souls to the afterlife, resulting in the syncretic god #Hermanubis.