Groq

Custom LPU silicon serving open-weight models at extreme speed

groq.com console.groq.com/docs

Overall in llm apis

16of 18 · score 58

Data coverage

93%

25 of 27 fields sourced

Best for

•Voice agents and any interface where perceived latency is the feature
•High-volume cheap inference on well-known open-weight models
•Fast transcription alongside text generation on one key

Strong on

+Zero retention Yes 1/18
+$/M input $0.05/M tok 1/13
+$/M output $0.08/M tok 2/13

Weak on

−Context window 131,072 tokens 12/14
Better: Anthropic: 1,000,000 tokens
−Max output 8,192 tokens 10/10
Better: xAI: Unlimited
−API since 2024 16/18
Better: OpenAI: 2020
−Effort control No 12/18
Better: Anthropic: Yes

vs Fireworks AI

•Ahead on $/M input: $0.05/M tok vs $0.1/M tok
•Behind on Schema output: Partial vs Yes
•Behind on Pinnable versions: Partial vs Yes

How Groq scores among 18 llm apis25 of 27 fields known

Capability7

Flagship model

Curated open-weight models (Kimi K2, Llama 4, Qwen3, GPT-OSS)

console.groq.com · 2026-01-15

Context window

131,072 tokens

12/14

Leader: Anthropic · 1,000,000 tokens

console.groq.com · 2026-11-07

Max output

8,192 tokens

10/10

Leader: xAI · Unlimited

console.groq.com · 2026-11-07

Image input

Partial

10/18

Leader: Anthropic · Yes

· 2026-01-15

Audio in/out1st

Partial

1/18

· 2026-01-15

Open weights1st

Yes

1/18

· 2026-01-15

OpenAI-compat API1st

Yes

1/18

console.groq.com · 2026-01-15

Performance2

TTFT p50

250ms

2/2

Leader: Cerebras · 200ms

· 2026-01-15

Output tok/s

400 tok/s

2/2

Leader: Cerebras · 2,000 tok/s

· 2026-01-15

Pricing4

$/M input1st

$0.05/M tok

1/13

console.groq.com · 2026-11-07

$/M output2nd

$0.08/M tok

2/13

Leader: Fireworks AI · $0.05/M tok

console.groq.com · 2026-11-07

$/M cache read

—

Batch discount1st

50%

1/14

console.groq.com · 2026-11-07

Agentic6

Tool use

Partial

13/18

Leader: Anthropic · Yes

· 2026-01-15

Schema output

Partial

11/18

Leader: Anthropic · Yes

· 2026-01-15

Effort control

12/18

Leader: Anthropic · Yes

· 2026-01-15

Computer use

5/18

Leader: Anthropic · Yes

· 2026-01-15

MCP support

6/18

Leader: Anthropic · Yes

· 2026-01-15

Cache TTL

Automatic, no code changes; cached prefixes expire after 2 hours without use

console.groq.com · 2026-11-07

Governance & continuity6

Continuity policy

The weakest continuity of any host here. Models are added and removed from the console on a short cycle as Groq re-allocates LPU capacity, deprecations are announced with weeks rather than months of notice, and there is no dedicated-endpoint escape hatch for a model that gets pulled. Design for substitution: keep two model IDs configured and an eval you can rerun.

· 2026-01-15

Notice period

—

Pinnable versions

Partial

14/18

Leader: OpenAI · Yes

· 2026-01-15

Zero retention1st

Yes

1/18

console.groq.com · 2026-11-07