Supported providers
List of all providers
| Provider name | Extra for installation | Guide |
|---|---|---|
| Anthropic | anthropic |
Guide for Anthropic |
| ByteDance | - | Guide for ByteDance |
| Cohere | cohere |
Guide for Cohere |
| Google Gemini | google-genai |
Guide for Google Gemini |
| Hugging Face Hub | huggingface-hub |
Guide for Hugging Face Hub |
| Kling AI | - | Guide for Kling AI |
| LiteLLM | litellm |
Guide for LiteLLM |
| Mistral AI | mistralai |
Guide for Mistral AI |
| OpenAI | openai |
Guide for OpenAI |
| Runway | - | Guide for Runway |
| Azure OpenAI | openai |
Guide for Azure OpenAI |
Chat Completions
| Provider | Completions | Completions (stream) | Completions (async) | Completions (async + stream) |
|---|---|---|---|---|
| Anthropic | ||||
| Cohere | ||||
| Google Gemini | ||||
| HuggingFace Hub | ||||
| LiteLLM | ||||
| Mistral AI | ||||
| OpenAI | ||||
| Azure OpenAI |
Partial support for Anthropic streams, see full documentation: Anthropic provider.
Video Generation
Video generation impact estimation uses the video_impacts function. It does not require installing provider-specific SDK extras.
| Provider | Video impact estimation | Guide |
|---|---|---|
| ByteDance | ByteDance | |
| Google Gemini | ||
| Kling AI | Kling AI | |
| OpenAI | OpenAI | |
| Runway | Runway |