RetroFed Forum
Your home away from modern life.
Search Categories Forum list Register Log in
About RetroFed
RetroFed

Welcome to the nostalgia-filled piefed instance of yesteryear.

Open Registration with Application questionnaire.

If you have a question or comment you can post in !meta@retrofed.com or message @DosDude@retrofed.com or @Die4Ever@retrofed.com

In case of downtime and/or emergency, we will post updates on @DosDude@mastodon.social

Some rules we try to uphold:

  • Be civil. Bigotry is not welcome. This includes (but is not limited to): transphobia, queerphobia, racism, ageism and ableism. We do not promote hate.
  • Communities need to be Retro or Retro-adjacent.
  • Please don't upload pornographic content. (use an external image host for that)
72 registered users
Administrators: DosDude, Die4Ever
Visit retrofed.com
Internet Archive to New York: Don’t Kill the Good Bots in the Fight Against Bad Bots | Internet Archive Blogs
Post Reply RetroFed Forum Forum Index » Open Source
AuthorMessage
Farooq realbitcoin.cash farooqkz@realbitcoin.cash
Joined: 2025-09-09
Quote
Link: https://blog.archive.org/2026/08/04/internet-archive-to-new-york-dont-kill-the-good-bots-in-the-fight-against-bad-bots

I guess Anubis also prevents "good" bots such as search engine bots to access a webpage...
51   Original
Krusty quokk.au Krusty@quokk.au
Joined: 2026-05-03
#2 · Quote Reply

Is there anything AI doesn't ruin?
6
lightrain forum.storstad.net lightrain@forum.storstad.net
Joined: 2026-02-04
#3 · Quote Reply
Krusty wrote:
Is there anything AI doesn't ruin?

Well, AI forces people to rethink a broken economy.
5
ferric_carcinization lemmy.ml ferric_carcinization@lemmy.ml
Joined: 2025-03-12
#4 · Quote Reply
lightrain wrote:
Well, AI forces people to rethink a broken economy.

Don't forget "intelligence"-as-a-service™®©!

Hi ChatGPT, I can't find a job due to the AI bubble. What should I do?
1
katy ✨ piefed.blahaj.zone cupcakezealot@piefed.blahaj.zone
Joined: 2025-06-06
#5 · Quote Reply

yes but you can configure anubis to allow specific bots with botPolicy.yaml; the allow-good include already whitelists internet archive.
10
MonkderVierte lemmy.zip MonkderVierte@lemmy.zip
Joined: 2025-05-30
#6 · Quote Reply
katy ✨ wrote:
yes but you can configure anubis to allow specific bots with botPolicy.yaml; the allow-good include already whitelists internet archive.

Can they please add "Dillo/3.2.0"?
1
katy ✨ piefed.blahaj.zone cupcakezealot@piefed.blahaj.zone
Joined: 2025-06-06
#7 · Quote Reply
MonkderVierte wrote:
Can they please add "Dillo/3.2.0"?

look in the crawlers directory and you can add any allows you want with the proper user agent. :)
1
MonkderVierte lemmy.zip MonkderVierte@lemmy.zip
Joined: 2025-05-30
#8 · (edited) Quote Reply
katy ✨ wrote:
look in the crawlers directory and you can add any allows you want with the proper user agent. :)

Nah, that was a joke; Dillo is basicslly a graphical Lynx (both have useragent-exceptions on some big "js-only" sites). And the Anubis dev is, for a while now, working on a static version, if you believe the error message. Though that would be hard to do, if at all possible.
1
katy ✨ piefed.blahaj.zone cupcakezealot@piefed.blahaj.zone
Joined: 2025-06-06
#9 · Quote Reply
MonkderVierte wrote:
Nah, that was a joke; Dillo is basicslly a graphical Lynx (both have useragent-exceptions on some big "js-only" sites). And the Anubis dev is, for a while now, working on a static version, if you believe the error message. Though that would be hard to do, if at all possible.

ooh i'm sorry i didn't catch that <3
2
Post Reply
Back to top
Powered by PieFed · PieBB frontend · All times are Europe/Amsterdam