Home / Providers / Together AI

Together AI

Wide open-source model catalog with serverless + dedicated

TL;DR

Together AI — Wide open-source model catalog with serverless + dedicated. Free tier: $1 free credit on signup. A few "free" tagged endpoints (Llama-3.3-70B-Instruct-Turbo-Free) with strict 60/min rate limit. API is OpenAI-compatible — point your SDK at https://api.together.xyz/v1.

Latency now
Uptime 24h
60
Free RPM
Free TPM
Get free API key → Read docs ↗ Pricing ↗

Free tier limits

  • 60 requests/min
  • $1 credit on signup
No credit card required.

Models on free tier

  • meta-llama/Llama-3.3-70B-Instruct-Turbo
  • meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo
  • mistralai/Mixtral-8x7B-Instruct-v0.1
  • deepseek-ai/DeepSeek-V3

Upgrade path

Pay-per-token; 70B Turbo $0.88/1M tokens, 405B $3.50/1M, smaller models cheaper. Together fine-tuning + dedicated endpoints available.

Reserved instances, BYO infra, and SOC 2 / HIPAA tiers.

Endpoint

https://api.together.xyz/v1

OpenAI-compatible — works with the OpenAI SDK by overriding base_url.

Quick start
curl https://api.together.xyz/v1/chat/completions \
  -H "Authorization: Bearer $TOGETHER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.3-70B-Instruct-Turbo-Free",
    "messages": [{"role": "user", "content": "Hello in 5 words"}]
  }'
When Together AI is the right pick

Stay on free tier when

Open-source-first stacks. Use when you want Llama 3.1 405B, DeepSeek V3, or to fine-tune.

Pick something else when

Closed-model needs (GPT-4, Claude). Use OpenRouter or direct provider.

FAQ
Is Together AI's API really free?

$1 free credit on signup. A few "free" tagged endpoints (Llama-3.3-70B-Instruct-Turbo-Free) with strict 60/min rate limit. No credit card is required to sign up.

What models can I call on Together AI's free tier?

Most commonly used: meta-llama/Llama-3.3-70B-Instruct-Turbo, meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo, mistralai/Mixtral-8x7B-Instruct-v0.1, deepseek-ai/DeepSeek-V3. The full current list is on Together AI's docs page.

Is Together AI OpenAI-compatible?

Yes — point the OpenAI SDK's base URL at `https://api.together.xyz/v1` and pass your Together AI API key.

When should I upgrade from Together AI's free tier?

Pay-per-token; 70B Turbo $0.88/1M tokens, 405B $3.50/1M, smaller models cheaper. Together fine-tuning + dedicated endpoints available. If your traffic is bursty or seasonal, the free tier may be enough; if you need a guaranteed SLA, upgrade.

See also
Together AI vs Groq

Side-by-side comparison.

Together AI vs OpenRouter

Side-by-side comparison.

Together AI vs Hugging Face Inference

Side-by-side comparison.