RetroFed Forum
Your home away from modern life.
llmfit - find best model that runs on your computer
Post Reply
AuthorMessage
vermaterc lemmy.ml vermaterc@lemmy.ml
Joined: 2025-03-17
Quote

"A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine."

31   Original
lime! feddit.nu lime@feddit.nu
Joined: 2024-08-21
#2 · Quote Reply

feels like this could be made a lot safer by just making it a website where you enter your specs

21
vermaterc lemmy.ml vermaterc@lemmy.ml
Joined: 2025-03-17
#3 · Quote Reply

feels like this could be made a lot safer by just making it a website where you enter your specs

true, I don't like the curl [something] | sh pattern for installation. Calling it is just like letting random guy from the internet control of your PC to download some binaries. I'm seeing this trend more and more in Github repos

15
lime! feddit.nu lime@feddit.nu
Joined: 2024-08-21
#4 · Quote Reply

true, I don't like the curl [something] | sh pattern for installation. Calling it is just like letting random guy from the internet control of your PC to download some binaries. I'm seeing this trend more and more in Github repos

it's just going to be more common with vibe coding taking over, since if you ask a model to write a readme with an installation section that's what you'll get.

5
toothbrush lemmy.blahaj.zone toothbrush@lemmy.blahaj.zone
Joined: 2023-06-15
#5 · Quote Reply

I would greatly prefer a simple calc software/website that you give a model to and it tells you how it would run, but I suppose in the era of vibecoding, making small, functional, well designed software has become a distant dream.

(and the readme tells you to curl and execute a shell script? no thanks)

10
Post Reply
Back to top