Run LLM Models Locally On Any Device

Why this stack?

Run LLMs privately on your own machine, Windows or MAC with the software of choice. All of these use Llama.cpp under the hood so use it if you can. If it is too technical you might use Lmstudio or Ollama