Tools
Small calculators I use when I plan a run. They work in your browser; nothing is sent anywhere. For a quick answer per model, see how much memory each popular model needs.
Will this model fit in memory?
Estimate how much memory a local model needs: weights for each GGUF quantization, the KV cache for your context length, and which Mac memory size can run it.
Which models fit on my Mac?
Every popular open model on one chart: pick your Mac memory, quantization and context, and see which ones fit and which is the largest you can run.
What does 20 tokens per second feel like?
Watch text stream at any generation speed and compare it with how fast you read.
How long until the answer is done?
Split the wait into reading the prompt and writing the answer, from prompt length, answer length and your two speeds.