AI & Machine Learning
Sep 13, 2026 · 882 words
Running LLMs Locally With Ollama: A Practical Field Guide
A hands-on guide to running open-weight LLMs locally with Ollama, from GGUF and quantization to memory math and real-world caveats.
Technical news, guides and deep-dives across AI, programming and the open-source world
Models, machine learning, applied agents, and the fast-moving world of AI.
2 articlesA hands-on guide to running open-weight LLMs locally with Ollama, from GGUF and quantization to memory math and real-world caveats.
A grounded field report on production RAG: the pipeline, pgvector vs. dedicated vector stores, and the chunking mistakes that break retrieval.