Ollama
One command to download and run a language model on your own machine. The easiest honest answer to "how do I do this without a cloud".
- Self-hosted
- Allowed
- No GPU needed
A large open-weights model strong at multilingual work, widely used as a fine-tuning base.
Notably better than the Llama line at languages other than English, which matters if the conversation you want is not in English. As with every instruct release, the refusals are in the tune rather than the architecture.
One command to download and run a language model on your own machine. The easiest honest answer to "how do I do this without a cloud".
One API key for a great many hosted models, including ones with looser content policies than their originals.
The C++ engine most local language model software is built on. Runs large models on ordinary hardware, including with no GPU at all.
A serious inference server for serving a model to many people at once. Not a chatbot — the thing a chatbot runs on.