Skip to main content
Together AI hosts hundreds of open-source models with fast inference. It’s a good choice when you need specific open-source models without running them locally.

Supported Models

Any model on the Together AI catalog can be referenced by its full ID.

Setup

1

Get an API key

Sign up at api.together.xyz. Free credits on signup.
2

Set the environment variable

3

Verify

Environment Variables

string
required
Your Together AI API key.

Configuration Example

Model Aliases

Usage Examples

Notes

  • API endpoint: https://api.together.xyz/v1 (OpenAI-compatible)
  • Status: Beta
  • Together AI offers serverless and dedicated inference options.
  • Great for accessing models not available on other providers (e.g., specific fine-tuned variants).