Groq API
Groq 接口
Ultra-fast inference API for open-source LLMs using LPU inference engine.
基于 LPU 推理引擎的开源大模型极速推理接口。
Website
Documentation
Pricing
free tier available, pay-as-you-go
Authentication
- API Key
Rate Limit
30 req/min (free tier)
Typical Latency
<200ms (ultra-fast)
Max Context
128K
Popularity
72/100
Endpoints
https://api.groq.com/openai/v1/chat/completions
SDKs
PythoncurlOpenAI-compatible SDKs
Key Features
- ◆LPU inference engine for blazing speed
- ◆Open-source models: Llama, Mixtral, Gemma
- ◆Free tier for experimentation
- ◆OpenAI-compatible API
- ◆Ideal for real-time applications
Code Examples
Chat Completionbash
curl https://api.groq.com/openai/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $GROQ_API_KEY" \
-d '{
"model": "llama3-70b-8192",
"messages": [{"role": "user", "content": "Hello!"}]
}'Tags
llminferencespeed
Last updated: 2026-07-27
Similar APIs
OpenAI API
★100Access GPT-4o, GPT-4, GPT-3.5, embeddings, DALL-E, Whisper, and TTS models via REST API.
Hugging Face Hub API
★92Access 500K+ models, datasets, and Spaces. Inference API for instant model deployment.
LangChain Platform
★91Framework and platform for building LLM applications. LangSmith for observability, LangServe for deployment.
Anthropic Claude API
★87Access Claude 3.5 Sonnet, Haiku, and Opus models for chat, analysis, and code generation.
Something wrong or missing? Open an issue on GitHub →
Pricing Comparison
| API | Pricing | Auth | Popularity |
|---|---|---|---|
| OpenAI API | pay-as-you-go (per token) | API Key (Bearer Token) | 100 |
| Anthropic Claude API | pay-as-you-go (per token) | API Key (x-api-key header) | 87 |
| Google Gemini API | free tier available, pay-as-you-go | API Key | 85 |
| OpenAI Assistants API | pay-as-you-go (per token + per tool use) | API Key (Bearer Token) | 84 |
Get Started with Groq API
Click below to visit the official website and start using this API.
Visit Groq API →Discussion
Questions, feedback, or suggestions? Start a discussion.
Discuss on GitHub