Supported providers
List of all providers
| Provider name | Extra for installation | Guide |
|---|---|---|
| Anthropic | anthropic |
Guide for Anthropic |
| Cohere | cohere |
Guide for Cohere |
| Google Gemini | google-generativeai |
Guide for Google Gemini |
| Hugging Face Hub | huggingface-hub |
Guide for Hugging Face Hub |
| LiteLLM | litellm |
Guide for LiteLLM |
| Mistral AI | mistralai |
Guide for Mistral AI |
| OpenAI | openai |
Guide for OpenAI |
Chat Completions
| Provider | Completions | Completions (stream) | Completions (async) | Completions (async + stream) |
|---|---|---|---|---|
| Anthropic | ||||
| Cohere | ||||
| Google Gemini | ||||
| HuggingFace Hub | ||||
| LiteLLM | ||||
| Mistral AI | ||||
| OpenAI |
Partial support for Anthropic streams, see full documentation: Anthropic provider.