RetroFed Forum
Your home away from modern life.
Disruptions due to high bot/scraping activity
Post Reply
AuthorMessage
Sir. Haxalot nord.pub SirHaxalot@nord.pub
Joined: 2026-02-03
(edited) Quote

Hello,

Just a quick heads up that I am seeing a lot of traffic today, which seems to be mostly scrapers. This causes the site to be quite slow and may throw an occasional error.

I have increased the sensitivity of the CDN Shield to high in the hopes that it will block most of it. This means that you may see challenge screens from BunnyCDN.

If this is not resolved by tonight I will look at further mitigations.


Update: The service has been stable since yesterday around 14:15 CEST. Unfortunately the CDN Shield setting didn't appear to make much difference but the scraping storm eventually died off anyway.

I have also increased the amount of CPU each container can utilize which should make the site more resilient in case of repeats. The NUM_CPUS setting was left at 2, which is fine for the baseline load of ~5-10%, but prevented it from using more than ~150% CPU when under heavy load, while the VMs have 6 CPUs available.

image

3   Original
im_fine_sandy nord.pub im_fine_sandy@nord.pub
Joined: 2026-08-05
#2 · Quote Reply

Thanks. I was wondering. Real bad about 30 minutes ago.

1
Post Reply
Back to top