RetroFed Forum
Your home away from modern life.
POV: you just blocked 1 crawling bot
Post Reply
AuthorMessage
admin lemmit.online admin@lemmit.online
Joined: 2023-06-18
Quote

CPU graph from btop

Poor lemmy server went from constant 80-100% cpu load to gently coasting.

That thing must have been dragging things down for months, if not years.

15   Original
realcaseyrollins hilariouschaos.com realcaseyrollins@hilariouschaos.com
Joined: 2026-04-28
#2 · Quote Reply

Which bot did you block?

2
admin Moderator admin@lemmit.online
Joined: 2023-06-18
#3 · Quote Reply

Which bot did you block?

Unclear - it didn't have a useragent, but it was scraping all the posts: /api/v3/post/list?limit=50&sort=Old&page=56273 - it was on page 56273. The IP address is associated with a VPN, so I'm sure they'll try through some other way - but that won't help them :P

I don't know what they plan to gain from this anyway - they're better off scraping this content directly from Reddit themselves. I know a bot that shows how to do it ;)

3
Post Reply
Back to top