- Putting Open WebUI in front of vLLM or Ollama: an internal chat UI with sign-in, roles and no open signupAI & GenAI · 12 Nov 2026
- vLLM tool calling not working: fix auto tool choice errors, parsers and tool calls returned as textAI & GenAI · 7 Nov 2026
- Sev1: self-hosted LLM returns gibberish, never stops or leaks special tokens after a deploy — chat template and tokenizer fixesAI & GenAI · 31 Oct 2026
- Ollama cheat sheet: models, the REST API, Modelfiles and server settingsAI & GenAI · 30 Oct 2026
- Ollama is slow or running on CPU instead of GPU: model placement, context size and reloadsAI & GenAI · 26 Oct 2026
- Kill switches for self-hosted models on Kubernetes: ingress, network policy, scale to zeroAI & GenAI · 25 Oct 2026
- Transformation: moving self-hosted LLM inference from FP16 to FP8 or INT4 quantized modelsAI & GenAI · 25 Oct 2026
- Transformation: when and how to move from a hosted LLM API to self-hosted open-weight modelsAI & GenAI · 25 Oct 2026