RetroFed Forum
Your home away from modern life.
Wikipedia Blacklists Archive.today, Starts Removing 695,000 Archive Links
Post Reply
AuthorMessage
Innerworld lemmy.world Innerworld@lemmy.world
Joined: 2026-01-16
Quote

214   Original
ImgurRefugee114 reddthat.com ImgurRefugee114@reddthat.com
Joined: 2025-08-26
#2 · (edited) Quote Reply

Absolute dumbass. Truly a self-own for the ages.

Play stupid games, ...

49
Maeve kbin.earth Maeve@kbin.earth
Joined: 2024-06-16
#3 · Quote Reply

Absolute dumbass. Truly a self-own for the ages. Play stupid games, ...

Collect insurance?

7
🌞 Alexander Daychilde 🌞 lemmy.world daychilde@lemmy.world
Joined: 2023-06-13
#4 · Quote Reply

Dammit. Everyone's been using that site to get around paywalls because it works well. Now I have to go find another one that works as well. :|

21
betterdeadthanreddit lemmy.world betterdeadthanreddit@lemmy.world
Joined: 2023-06-06
#5 · Quote Reply

Dammit. Everyone's been using that site to get around paywalls because it works well. Now I have to go find another one that works as well. :|

There are others that don't DDoS blogs.

24
🌞 Alexander Daychilde 🌞 lemmy.world daychilde@lemmy.world
Joined: 2023-06-13
#6 · Quote Reply

There are others that don't DDoS blogs.

Well, yes, I'll be off looking for them next time I need to use an archival site. I'm bummed to learn this crap about archive.ph.

3
UnderpantsWeevil lemmy.world UnderpantsWeevil@lemmy.world
Joined: 2023-06-14
#7 · Quote Reply

Arguably the biggest problem with Wikipedia as it aged is the accumulation of dead links.

Brilliant move.

10
dan upvote.au dan@upvote.au
Joined: 2023-06-14
#8 · (edited) Quote Reply

Arguably the biggest problem with Wikipedia as it aged is the accumulation of dead links. Brilliant move.

Why do you need an archive of Wikipedia though? Each page retains its entire history, so you can easily go back to old versions without using a third-party site (especially one that DDoSes people)

Wikimedia also provide downloads of the whole of Wikipedia, including page history. You can easily have your own copy of the entirety of Wikipedia if you want to, as long as you've got enough disk space and patience to download it.

Edit: I'm an idiot but I'm leaving this comment here. I didn't realise you meant dead links on Wikipedia, not to Wikipedia.

3
solrize lemmy.ml solrize@lemmy.ml
Joined: 2023-06-22
#9 · Quote Reply

Why do you need an archive of Wikipedia though? Each page retains its entire history, so you can easily go back to old versions without using a third-party site (especially one that DDoSes people) Wikimedia also provide downloads of the whole of Wikipedia, including page history. You can easily have your own copy of the entirety of Wikipedia if you want to, as long as you've got enough disk spa...

Wikipedia was using archive.today to link to off-wiki articles such as news articles, where the links had stopped working. Similar to how it also uses the archive.org Wayback machine for the same purpose.

12
dan upvote.au dan@upvote.au
Joined: 2023-06-14
#10 · (edited) Quote Reply

Dammit. Everyone's been using that site to get around paywalls because it works well. Now I have to go find another one that works as well. :|

It works well because they use paid accounts to scrape a bunch of paywalled sites, which is why publishers are trying to figure out who runs it.

It's completely untrustworthy now that they've shown that they can (and do) edit archived pages.

13
SolacefromSilence fedia.io SolacefromSilence@fedia.io
Joined: 2024-04-22
#11 · Quote Reply

Arguably the biggest problem with Wikipedia as it aged is the accumulation of dead links. Brilliant move.

I used to find dead links annoying until I realized that many dead links are also saved in the wayback machine. This comment isn't only about Wikipedia.

4
dan upvote.au dan@upvote.au
Joined: 2023-06-14
#12 · Quote Reply

Wikipedia was using archive.today to link to off-wiki articles such as news articles, where the links had stopped working. Similar to how it also uses the archive.org Wayback machine for the same purpose.

I understand now. I completely missed the point.

10
SourDrink lemmy.world SourDrink@lemmy.world
Joined: 2023-06-12
#13 · Quote Reply

I half thought this was archive.org they were blacklisting. Two whole different sites.

27
AmbitiousProcess (they/them) piefed.social AmbitiousProcess@piefed.social
Joined: 2025-06-06
#14 · (edited) Quote Reply

Here's the relevant archive.today guidance page on Wikipedia for anyone curious:
https://en.wikipedia.org/wiki/Wikipedia:Archive.today_guidance

If you have a Wikipedia account, you can help replace these links!
Go to the How you can help section, then click on the search links for any of the given domains, and you can go and manually re-archive any links with Archive.org, Ghostarchive, or Megalodon.

34
Doug Holland lemmy.world DougHolland@lemmy.world
Joined: 2023-06-11
#15 · Quote Reply

Crap. Obviously, I'm gonna gotta stop using archive.today, but it's the only way around paywalls at numerous sites.

Removepaywalls.com (plural) inserts ads, often for shady operations.

Removepaywall.com (singular) usually works, but it's tricky sharing the links (i.e., "choose option 2" or "choose option 4").

Byebyepaywall.com has old, dead options.

Wayback Machine bombs out a lot.

And ghostarchive.org is successful so rarely it's really a last resort.

Anyone know of any others?

30
a Kendrick fan lemmy.ml greywolf0x1@lemmy.ml
Joined: 2023-07-15
#16 · Quote Reply

Crap. Obviously, I'm gonna gotta stop using archive.today, but it's the only way around paywalls at numerous sites. Removepaywalls.com (plural) inserts ads, often for shady operations. Removepaywall.com (singular) usually works, but it's tricky sharing the links (i.e., "choose option 2" or "choose option 4"). Byebyepaywall.com has old, dead options. Wayback Machine bombs out a lot. And ghostarc...

Ghostarchive is an archive.today revamp, I see no reason to not keep using either though...

-1
Trudge piefed.social Trudge@piefed.social
Joined: 2026-01-30
#17 · Quote Reply

Crap. Obviously, I'm gonna gotta stop using archive.today, but it's the only way around paywalls at numerous sites. Removepaywalls.com (plural) inserts ads, often for shady operations. Removepaywall.com (singular) usually works, but it's tricky sharing the links (i.e., "choose option 2" or "choose option 4"). Byebyepaywall.com has old, dead options. Wayback Machine bombs out a lot. And ghostarc...
[deleted]
26
Doug Holland lemmy.world DougHolland@lemmy.world
Joined: 2023-06-11
#18 · Quote Reply

[deleted]

Worth looking into, thanks.

5
paraphrand lemmy.world paraphrand@lemmy.world
Joined: 2023-07-12
#19 · Quote Reply

Is there a reason self hosted paywall bypass tools don’t exist? Is it because these services pay for access?

12
hemko lemmy.dbzer0.com hemko@lemmy.dbzer0.com
Joined: 2023-07-03
#20 · Quote Reply

Is there a reason self hosted paywall bypass tools don’t exist? Is it because these services pay for access?

I think a subscribed user of the news site has to upload the "unlocked" article to the archive website.

3
deceiver infosec.pub deceiver@infosec.pub
Joined: 2025-03-22
#21 · Quote Reply

I think a subscribed user of the news site has to upload the "unlocked" article to the archive website.

no, archive.today (and similar services like the Wayback Machine) work by fetching the page directly through their own servers, essentially acting as a headless browser that renders the page and saves a snapshot. the archive service itself makes the HTTP request, executes JavaScript, and captures the resulting document object model - no subscriber involvement required

8
deceiver infosec.pub deceiver@infosec.pub
Joined: 2025-03-22
#22 · Quote Reply

Is there a reason self hosted paywall bypass tools don’t exist? Is it because these services pay for access?

they do exist: http://archivebox.io/

13
VitoRobles lemmy.today VitoRobles@lemmy.today
Joined: 2025-01-26
#23 · Quote Reply

In emails sent to Patokallio after the DDoS began, “Nora” from Archive.today threatened to create a public association between Patokallio’s name and AI porn and to create a gay dating app with Patokallio’s name. These threats were discussed by Wikipedia editors in their deliberations over whether to blacklist Archive.today, and then editors noticed that Patokallio’s name had been inserted into some Archive.today captures of webpages.

“Honestly, I’m kind of in shock,” one editor wrote. “Just to make sure I’m understanding the implications of this: we have good reason to believe that the archive.today operator has tampered with the content of their archives, in a manner that suggests they were trying to further their position against the person they are in dispute with???”

That and their refusal to talk to any journalist who references information about Patokallio’s blog makes archive.today unreliable.

Fuck them.

21
paraphrand lemmy.world paraphrand@lemmy.world
Joined: 2023-07-12
#24 · Quote Reply

they do exist: http://archivebox.io/

At first glance, this does not bypass paywalls. It archives web pages.

People conflate the two services because some of them bypass paywalls as they archive.

I specifically asked for about paywall bypass on purpose.

8
paraphrand lemmy.world paraphrand@lemmy.world
Joined: 2023-07-12
#25 · (edited) Quote Reply

no, archive.today (and similar services like the Wayback Machine) work by fetching the page directly through their own servers, essentially acting as a headless browser that renders the page and saves a snapshot. the archive service itself makes the HTTP request, executes JavaScript, and captures the resulting document object model - no subscriber involvement required

So there is no subscriber at all? How do they get past the wall that requires the payment?

It’s fun how I got a few replies, and none of the answered my very precise question.

2
deceiver infosec.pub deceiver@infosec.pub
Joined: 2025-03-22
#26 · Quote Reply

At first glance, this does not bypass paywalls. It archives web pages. People conflate the two services because some of them bypass paywalls as they archive. I specifically asked for about paywall bypass on purpose.

the archiving mechanism itself is what bypasses paywalls. it archives by fetching pages server-side before client-side JavaScript enforces paywalls

7
deceiver infosec.pub deceiver@infosec.pub
Joined: 2025-03-22
#27 · Quote Reply

So there is no subscriber at all? How do they get past the wall that requires the payment? It’s fun how I got a few replies, and none of the answered my very precise question.

soft paywalls are enforced by JavaScript running in your browser - the server sends the full article content regardless, and then the JavaScript checks if you’re a subscriber and hides or blocks it if not. when archive.today or a self-hosted tool like ArchiveBox fetches the page, it gets the full content directly from the server before any of that JavaScript enforcement runs. the server doesn’t know or care whether you’re a subscriber, it just responds to the request

2
paraphrand lemmy.world paraphrand@lemmy.world
Joined: 2023-07-12
#28 · Quote Reply

soft paywalls are enforced by JavaScript running in your browser - the server sends the full article content regardless, and then the JavaScript checks if you’re a subscriber and hides or blocks it if not. when archive.today or a self-hosted tool like ArchiveBox fetches the page, it gets the full content directly from the server before any of that JavaScript enforcement runs. the server doesn’t...

Thanks!

I always assumed that wasn’t the case because Paywall bypass extensions are not linked in a reply when someone screams about paywalls in a thread on Reddit or Lemmy. Why is that possible, but not possible with a browser extension?

Are soft paywalls uncommon?

2
paraphrand lemmy.world paraphrand@lemmy.world
Joined: 2023-07-12
#29 · (edited) Quote Reply

the archiving mechanism itself is what bypasses paywalls. it archives by fetching pages server-side before client-side JavaScript enforces paywalls

Can this be done in a browser extension? I’m basically wondering why people don’t tell other people about Paywall bypass software on Lemmy. Is it because it sucks? Doesn’t exist?

Such software seems like it would be very Lemmy, and very Linux, and very piracy, and very anarchic. So why am I not already aware of any?

3
zqps sh.itjust.works zqps@sh.itjust.works
Joined: 2024-10-14
#30 · Quote Reply

[deleted]

F11 plus Esc stops script execution or something like that?

6
deceiver infosec.pub deceiver@infosec.pub
Joined: 2025-03-22
#31 · Quote Reply

Can this be done in a browser extension? I’m basically wondering why people don’t tell other people about Paywall bypass software on Lemmy. Is it because it sucks? Doesn’t exist? Such software seems like it would be very Lemmy, and very Linux, and very piracy, and very anarchic. So why am I not already aware of any?

it absolutely can! there’s Bypass Paywalls Clean developed by magnolia1234. the reason you don’t see them shared often is that they’re repeatedly taken down from official extension stores like the Chrome Web Store and Firefox Add-ons, and platforms like GitHub, due to legal and political pressure from publishers, which pushes them to increasingly obscure and/or questionable hosting platforms that most normal users wouldn’t touch - case in point, Bypass Paywalls Clean itself is currently hosted on GitFlic, a Russian code hosting platform, as it’s been pushed outside the reach of Western legal frameworks

6
CharlesDarwin lemmy.world CharlesDarwin@lemmy.world
Joined: 2023-06-22
#32 · Quote Reply

it absolutely can! there’s Bypass Paywalls Clean developed by magnolia1234. the reason you don’t see them shared often is that they’re repeatedly taken down from official extension stores like the Chrome Web Store and Firefox Add-ons, and platforms like GitHub, due to legal and political pressure from publishers, which pushes them to increasingly obscure and/or questionable hosting platforms th...

You'd think they would host on codeberg.

2
CharlesDarwin lemmy.world CharlesDarwin@lemmy.world
Joined: 2023-06-22
#33 · Quote Reply

Crap. Obviously, I'm gonna gotta stop using archive.today, but it's the only way around paywalls at numerous sites. Removepaywalls.com (plural) inserts ads, often for shady operations. Removepaywall.com (singular) usually works, but it's tricky sharing the links (i.e., "choose option 2" or "choose option 4"). Byebyepaywall.com has old, dead options. Wayback Machine bombs out a lot. And ghostarc...

The thing that has always annoyed me about archive.is is that using Firefox + VPN seems to result in endless Captcha. But works in Chrome, go figure. I'm very suspicious of sites that somehow only work properly under Chrome.

9
Fiery lemmy.dbzer0.com Fiery@lemmy.dbzer0.com
Joined: 2024-12-08
#34 · Quote Reply

Thanks! I always assumed that wasn’t the case because Paywall bypass extensions are not linked in a reply when someone screams about paywalls in a thread on Reddit or Lemmy. Why is that possible, but not possible with a browser extension? Are soft paywalls uncommon?

Soft paywalls only exist on badly made sites (which make up a large part of all sites so it's still more effective than it has any right to be).

Many news sites with paywalls have a proper hard paywall. The only way to get around those is with an account or with an exploit. Neither of those two are going to be published for use in an extension though (as it'd get deactivated very fast).

3
hemko lemmy.dbzer0.com hemko@lemmy.dbzer0.com
Joined: 2023-07-03
#35 · Quote Reply

no, archive.today (and similar services like the Wayback Machine) work by fetching the page directly through their own servers, essentially acting as a headless browser that renders the page and saves a snapshot. the archive service itself makes the HTTP request, executes JavaScript, and captures the resulting document object model - no subscriber involvement required

Ah I see, thanks for the correction!

3
Post Reply
Back to top