RetroFed Forum
Your home away from modern life.
book pipeline help
Post Reply
AuthorMessage
ogy fedia.io ogy@fedia.io
Joined: 2026-06-06
(edited) Quote

Has anyone here had much success with automated book downloads and a self-hosted library? I've been pulling my hair out trying to get shelfmark and calibre-web automated to work for me.

I'm trying to use them for engineering textbooks which I realise is not the intended use-case, so any more appropriate suggestions would be appreciated. I want something that handles creating a searchable text layer on top on the book so I can search the textbooks more easily.

ShelfMark is having the following issues:

  • not connecting to annas-archive.is. I can reach it from my browser
  • the sources I want aren't covered by the indexers via prowlarr

CWA is struggling to ingest my engineering textbooks at all. I've just increased the time-out so hopefully that helps.

edit: increasing the CWA timeout setting let it get through the textbooks. shelfmark is my only problem now, assuming adding a text layer with stirling-pdf goes well 🤞

edit 2: shelfmark is now working (thanks to TheFerventLion below)! OCR in stirling-pdf is the last step

39   Original
TheFerventLion sh.itjust.works TheFerventLion@sh.itjust.works
Joined: 2023-07-01
#2 · Quote Reply

I've had success with Shelfmark, but I don't use .is.

I leave primary mirror to auto then have the following as mirrors:

I'm not sure I follow what you're problem is regarding the indexers, so I can't help there.

2
ogy fedia.io ogy@fedia.io
Joined: 2026-06-06
#3 · Quote Reply

I've had success with Shelfmark, but I don't use .is. I leave primary mirror to auto then have the following as mirrors: https://annas-archive.gl/ https://annas-archive.pk/ https://annas-archive.vg/ https://annas-archive.gd/ I'm not sure I follow what you're problem is regarding the indexers, so I can't help there.

Thank you! I'm away today but I'll try these soon, hopefully they fix it!

2
ogy fedia.io ogy@fedia.io
Joined: 2026-06-06
#4 · Quote Reply

I've had success with Shelfmark, but I don't use .is. I leave primary mirror to auto then have the following as mirrors: https://annas-archive.gl/ https://annas-archive.pk/ https://annas-archive.vg/ https://annas-archive.gd/ I'm not sure I follow what you're problem is regarding the indexers, so I can't help there.

just want to update you I finally got it working - thanks so much for your help! 🙏

2
TheFerventLion sh.itjust.works TheFerventLion@sh.itjust.works
Joined: 2023-07-01
#5 · Quote Reply

just want to update you I finally got it working - thanks so much for your help! 🙏

Glad I could help! I also recommend looking into the IRC integration.

2
ogy fedia.io ogy@fedia.io
Joined: 2026-06-06
#6 · Quote Reply

Glad I could help! I also recommend looking into the IRC integration.

Thanks, will do!

2
Post Reply
Back to top