RetroFed Forum
Your home away from modern life.
Search Categories Forum list Register Log in
About RetroFed
RetroFed

Welcome to the nostalgia-filled piefed instance of yesteryear.

Open Registration with Application questionnaire.

If you have a question or comment you can post in !meta@retrofed.com or message @DosDude@retrofed.com or @Die4Ever@retrofed.com

In case of downtime and/or emergency, we will post updates on @DosDude@mastodon.social

Some rules we try to uphold:

  • Be civil. Bigotry is not welcome. This includes (but is not limited to): transphobia, queerphobia, racism, ageism and ableism. We do not promote hate.
  • Communities need to be Retro or Retro-adjacent.
  • Please don't upload pornographic content. (use an external image host for that)
73 registered users
Administrators: DosDude, Die4Ever
Visit retrofed.com
I wrote about running LLMs locally on the Intel Arc Pro B60 GPU previously, where I used Intel's official software stack (llm-scaler / vLLM).
Post Reply RetroFed Forum Forum Index » LocalLLaMA
AuthorMessage
Marvin Damschen mastodon.nu marvin@mastodon.nu
Joined: 2023-07-02
Quote

I wrote about running LLMs locally on the Intel Arc Pro B60 GPU previously, where I used Intel's official software stack (llm-scaler / vLLM).

This time I focus on the impactful open-source project llama.cpp:
https://marvin.damschen.net/post/intel-arc-llama.cpp/

Taking this opportunity to test federation with lemmy 😊:
@localllama

#llm #selfhosting #privacy #intel #llamacpp
2   Original
Post Reply
Back to top
Powered by PieFed · PieBB frontend · All times are Europe/Amsterdam