RetroFed Forums
Your home away from modern life.
Search Categories Forum list Register Log in
About RetroFed
RetroFed

Welcome to the nostalgia-filled piefed instance of yesteryear.

Open Registration with Application questionnaire.

If you have a question or comment you can post in !meta@retrofed.com or message @DosDude@retrofed.com or @Die4Ever@retrofed.com

In case of downtime and/or emergency, we will post updates on @DosDude@mastodon.social

Some rules we try to uphold:

  • Be civil. Bigotry is not welcome. This includes (but is not limited to): transphobia, queerphobia, racism, ageism and ableism. We do not promote hate.
  • Communities need to be Retro or Retro-adjacent.
  • Please don't upload pornographic content. (use an external image host for that)
72 registered users
Administrators: DosDude, Die4Ever
Visit retrofed.com
Anubis as possible proof-of-work AI scraping protection
Post Reply RetroFed Forums Forum Index » Reddthat Community and Support
AuthorMessage
AppleStrudel
reddthat.com
AppleStrudel@reddthat.com
Joined: 2025-08-14
Posted:   Subject: Anubis as possible proof-of-work AI scraping protection Quote
You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of Al companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone. Anubis is a compromise. Anubis uses a Proof- of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive. Ultimately, this is a hack whose real purpose is to give a "good enough" placeholder solution so

Hey ticoombs, I just saw this while trapezing around the fediverse. It's a proof of work challenge via hashing to make AI scrappers bleed resources when trying to crawl our servers.

Could this be a potential measure against DDOS from scrappers when the server load is high? Or even as general protection with a low difficulty setting? What do you think?

GitHub link.

Low difficulty challenge (appears for 1-3 seconds):

Difficulty 5 challenge (appears for 15-35 seconds):
1   Original
Post Reply
Back to top
Powered by RetroFed · PieBB frontend · All times are Europe/Amsterdam