8 Ollama
Ollama is a powerful open source library that allows you to run a very large number of open-weight models directly on your own system. Some popular models available through Ollama include:
- Alibaba’s Qwen series
- DeepSeek’s R1 and V3
- Google’s Gemma
- IBM’s Granite
- Mistral’s open models
- Open AI’s gpt-oss
…and a lot more.
8.1 Ollama APIs
Ollama provides both its own API as well as an OpenAI-compatible API, making it easy to integrate into existing applications that use OpenAI’s API. However, the OpenAI-compatible API does not yet support all of the features of the native Ollama API. It is expected to continue to add more features over time.
Many agentic AI frameworks support Ollama through its OpenAI-compatible API, which means that not all native Ollama functionality is available to them. They may or may not make up for this using workarounds.