Together AI - profClaw

Together AI hosts hundreds of open-source models with fast inference. It’s a good choice when you need specific open-source models without running them locally.

Supported Models

Model	ID	Context	Tools	Notes
Llama 3.3 70B Turbo	`meta-llama/Llama-3.3-70B-Instruct-Turbo`	128K	Yes	Best general-purpose
Qwen 2.5 72B Turbo	`Qwen/Qwen2.5-72B-Instruct-Turbo`	32K	Yes	Multilingual
DeepSeek R1	`deepseek-ai/DeepSeek-R1`	128K	No	Reasoning model
Mixtral 8x22B	`mistralai/Mixtral-8x22B-Instruct-v0.1`	65K	Yes	Large MoE model

Any model on the Together AI catalog can be referenced by its full ID.

Setup

Get an API key

Set the environment variable

export TOGETHER_API_KEY=...

Verify

profclaw doctor --provider together

Environment Variables

TOGETHER_API_KEY

string

required

Your Together AI API key.

Configuration Example

.env
settings.yml

TOGETHER_API_KEY=...

providers:
  together:
    api_key: "${TOGETHER_API_KEY}"

Model Aliases

Alias	Model
`together`	meta-llama/Llama-3.3-70B-Instruct-Turbo
`together-qwen`	Qwen/Qwen2.5-72B-Instruct-Turbo

Usage Examples

profclaw chat --model together "Explain this algorithm"
profclaw chat --model together-qwen "Translate this to Chinese"

# Use any Together AI model directly
profclaw chat --model together/deepseek-ai/DeepSeek-R1 "Solve this math problem"

Notes

API endpoint: https://api.together.xyz/v1 (OpenAI-compatible)
Status: Beta
Together AI offers serverless and dedicated inference options.
Great for accessing models not available on other providers (e.g., specific fine-tuned variants).

AI Providers Overview - Compare all 37 supported providers
Fireworks AI - Similar open-source model hosting with fast inference
OpenRouter - Access 200+ models from a single API key
profclaw provider - Add and test providers from the CLI

AI Providers

​Supported Models

​Setup

​Environment Variables

​Configuration Example

​Model Aliases

​Usage Examples

​Notes

​Related