Start deepseek-r1 model locally using
ollama run deepseek-r1Compare model performance
ollama-grid-search is a tool to compare the output of different models with the goal of finding the best model for your use-case. Alternatively, I have developed a minimal tool called llm-model-comparison. More information on this tool can be found in 🤖 LLM Experimenting Tool.
Maximum model size
Certain models are too big to run locally on my laptop. At least gemma3:27b reached the threshold (17GB).