4  OpenAI-Compatible APIs

OpenAI’s Application Programming Interface (API) has become a widely adopted standard for accessing large language models (LLMs). Many companies provide APIs that are compatible with OpenAI’s API, allowing developers to easily switch between different LLM providers.

Some popular cloud-based OpenAI-compatible APIs include:

• OpenRouter: An open platform for accessing various open-source LLMs via an OpenAI-compatible API.
• Azure OpenAI Service: Microsoft’s cloud service that provides access to OpenAI models through an OpenAI-compatible API.
• Anthropic’s Claude API: Provides access to Anthropic’s Claude models via an OpenAI-compatible API.
• Cohere: Offers access to their language models through an OpenAI-compatible API.
• Groq: Provides access to their language models via an OpenAI-compatible API.
• Hugging Face: A platform for accessing a wide range of pre-trained models, including LLMs, via an OpenAI-compatible API.
• AI21 Studio: Provides access to their language models via an OpenAI-compatible API.
• Mistral: Offers access to their models through an OpenAI-compatible API.

Some popular local LLMs that provide OpenAI-compatible APIs include:

• Ollama: A platform for running local LLMs with an OpenAI-compatible API.
• vLLM: A high-performance inference engine for large language models that supports an OpenAI-compatible API.
• LocalAI: A platform for running local LLMs with an OpenAI-compatible API.
• LM Studio: A desktop application for running local LLMs with an OpenAI-compatible API.