Token API
Metered access to a shared fleet.
- Best for
- Content to follow
- Capacity
- Content to follow
- Isolation
- Content to follow
- Model flexibility
- Content to follow
- Pricing approach
- Content to follow
- Support
- Content to follow
Inference services.
Start with metered tokens, reserve capacity for production, or choose physically private infrastructure. A familiar API at every stage.
Compare services.
Dedicated Endpoints
Capacity reserved for your workload.
- Best for
- Content to follow
- Capacity
- Content to follow
- Isolation
- Content to follow
- Model flexibility
- Content to follow
- Pricing approach
- Content to follow
- Support
- Content to follow
Private Nodes
Physically dedicated infrastructure.
- Best for
- Content to follow
- Capacity
- Content to follow
- Isolation
- Content to follow
- Model flexibility
- Content to follow
- Pricing approach
- Content to follow
- Support
- Content to follow
How capacity is allocated.
Explore how each deployment changes the capacity and isolation around your workload.
Shared fleet
Private node
Single tenantA shared fleet. Each request uses the model capacity it needs.
Explore Token API