anyscale
Inference provider
- Endpoints
- 12
- Models
- 12
Models served
12 shown
| Model | Creator | Type | In $/1M | Out $/1M | Context | Max output | Tools | Region |
|---|---|---|---|---|---|---|---|---|
| codellama-34b-instruct-hf codellama/CodeLlama-34b-Instruct-hf | Meta | Chat | $1.00 | $1.00 | 4.1K | 4.1K | Region not stated | |
| codellama-70b-instruct-hf codellama/CodeLlama-70b-Instruct-hf | Meta | Chat | $1.00 | $1.00 | 4.1K | 4.1K | Region not stated | |
| gemma-7b-it google/gemma-7b-it | Chat | $0.15 | $0.15 | 8.2K | 8.2K | Region not stated | ||
| Llama 3 70B Instruct meta-llama/Meta-Llama-3-70B-Instruct | Meta | Chat | $1.00 | $1.00 | 8.2K | 8.2K | Region not stated | |
| Llama 3.1 Instruct (8B) meta-llama/Meta-Llama-3-8B-Instruct | Meta | Chat | $0.15 | $0.15 | 8.2K | 8.2K | Region not stated | |
| llama-2-13b-chat-hf meta-llama/Llama-2-13b-chat-hf | Meta | Chat | $0.25 | $0.25 | 4.1K | 4.1K | Region not stated | |
| llama-2-70b-chat-hf meta-llama/Llama-2-70b-chat-hf | Meta | Chat | $1.00 | $1.00 | 4.1K | 4.1K | Region not stated | |
| llama-2-7b-chat-hf meta-llama/Llama-2-7b-chat-hf | Meta | Chat | $0.15 | $0.15 | 4.1K | 4.1K | Region not stated | |
| mistral-7b-instruct-v0-1 mistralai/Mistral-7B-Instruct-v0.1 | Mistral AI | Chat | $0.15 | $0.15 | 16.4K | 16.4K | Region not stated | |
| Mixtral 8x22B mistralai/Mixtral-8x22B-Instruct-v0.1 | Mistral AI | Chat | $0.90 | $0.90 | 65.5K | 65.5K | Region not stated | |
| Mixtral 8x7B Instruct v0.1 mistralai/Mixtral-8x7B-Instruct-v0.1 | Mistral AI | Chat | $0.15 | $0.15 | 16.4K | 16.4K | Region not stated | |
| zephyr-7b-beta HuggingFaceH4/zephyr-7b-beta | Hugging Face H4 | Chat | $0.15 | $0.15 | 16.4K | 16.4K | Region not stated |
One row per model and variant. Dated pins appear on the model page, not as separate rows. Prices are indicative; verify with the provider.