> ## Documentation Index
> Fetch the complete documentation index at: https://lava.so/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

> Ultra-fast LLM inference using custom LPU hardware.

Groq offers 6 models through Lava's AI Gateway, supporting Chat Completions, Transcription. Authentication uses `Authorization: Bearer`. See the [Groq API docs](https://console.groq.com/docs/api-reference) for provider-specific parameters.

> [!NOTE]
>
> Supports both **managed** (Lava's API keys) and **unmanaged** (bring your own credentials) mode.

## Quick Start

```typescript theme={null}
const response = await fetch('https://api.lava.so/v1/forward?u=https%3A%2F%2Fapi.groq.com%2Fopenai%2Fv1%2Fchat%2Fcompletions', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json',
    Authorization: `Bearer ${forwardToken}`,
  },
  body: JSON.stringify({
    model: 'qwen/qwen3.8-27b',
    messages: [{ role: "user", content: "Hello!" }],
  }),
});
```

## Chat Completions

**Target URL:** `https://api.groq.com/openai/v1/chat/completions`

| | |
| - | - |
| **Content Type** | `application/json` |
| **Streaming** | Yes (set `stream: true` in request body) |

| Model | Input / 1M tokens | Output / 1M tokens |
| - | - | - |
| qwen/qwen3.8-27b | \$0.80 | \$4.00 |
| openai/gpt-oss-120b | \$0.15 | \$0.60 |
| openai/gpt-oss-safeguard-20b | \$0.075 | \$0.30 |
| openai/gpt-oss-20b | \$0.075 | \$0.30 |

## Transcription

**Target URL:** `https://api.groq.com/openai/v1/audio/transcriptions`

| | |
| - | - |
| **Content Type** | `multipart/form-data` |
| **Streaming** | No |

| Model | Input / minute | Output / minute |
| - | - | - |
| whisper-large-v3 | \$0.00185 | Free |
| whisper-large-v3-turbo | \$0.001 | Free |

## Next Steps

> [card] [All Providers](https://lava.so/docs/gateway/supported-providers.md)
>
> Browse all supported AI providers

> [card] [Forward Proxy](https://lava.so/docs/gateway/forward-proxy.md)
>
> Learn how to construct proxy URLs and authenticate requests


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.