Llama 3.1 8b Instant

Name: Llama 3.1 8b Instant
Brand: Meta
Price: 0.05 USD
Availability: InStock

Llama 3.1 8b Instant is a large language model by Meta with support for function calling. It supports a 128K token context window with up to 8K tokens of output. Priced at $0.05 per million input tokens and $0.08 per million output tokens, it is one of the most cost-efficient options in its class. Access Llama 3.1 8b Instant through Inworld Router with OpenAI SDK compatibility, built-in failover, and intelligent routing across providers.

→Function Calling

Use This Model

Step 1 — Create Router

curl --location 'https://api.inworld.ai/router/v1/routers' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "name": "compare-frontier-models",
  "defaultRoute": {
    "route_id": "default",
    "variants": [
      {
        "variant": {
          "variant_id": "groq/llama-3.1-8b-instant-a",
          "model_id": "groq/llama-3.1-8b-instant"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "groq/llama-3.3-70b-versatile-b",
          "model_id": "groq/llama-3.3-70b-versatile"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct-c",
          "model_id": "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct"
        },
        "weight": 34
      }
    ]
  }
}'

import requests

response = requests.post(
    "https://api.inworld.ai/router/v1/routers",
    headers={
        "Authorization": "Basic <your-api-key>",
        "Content-Type": "application/json",
    },
    json={
        "name": "compare-frontier-models",
        "defaultRoute": {
            "route_id": "default",
            "variants": [
                {
                    "variant": {
                        "variant_id": "groq/llama-3.1-8b-instant-a",
                        "model_id": "groq/llama-3.1-8b-instant"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "groq/llama-3.3-70b-versatile-b",
                        "model_id": "groq/llama-3.3-70b-versatile"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct-c",
                        "model_id": "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct"
                    },
                    "weight": 34
                }
            ]
        }
    },
)
print(response.json())

const response = await fetch(
  "https://api.inworld.ai/router/v1/routers",
  {
    method: "POST",
    headers: {
      Authorization: "Basic <your-api-key>",
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      name: "compare-frontier-models",
      defaultRoute: {
        route_id: "default",
        variants: [
          {
            variant: {
              variant_id: "groq/llama-3.1-8b-instant-a",
              model_id: "groq/llama-3.1-8b-instant",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "groq/llama-3.3-70b-versatile-b",
              model_id: "groq/llama-3.3-70b-versatile",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct-c",
              model_id: "deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct",
            },
            weight: 34,
          },
        ],
      },
    }),
  }
);
const data = await response.json();
console.log(data);

Step 2 — Chat Completion

curl --location 'https://api.inworld.ai/v1/chat/completions' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "model": "inworld/compare-frontier-models",
  "messages": [{"role": "user", "content": "Hello!"}]
}'

Llama 3.1 8b Instant pricing and providers

Access Llama 3.1 8b Instant through Groq via Inworld Router or Realtime API. By using the AI provider(s) below you acknowledge you reviewed and agree to their terms listed in the Legal section under the AI provider's name.

					Capabilities	Input modalities	Output modalities
Groq	128K	8.2K	$0.05	$0.08

Other Meta models available through Inworld

Compare Llama 3.1 8b Instant with other Meta models available through Inworld Router or Realtime API.

					Capabilities
Llama 3.3 70b Versatile	128K	32.8K	$0.59	$0.79
Meta Llama/Llama 3.2 11B Vision Instruct	131.1K	131.1K	$0.245	$0.245	—
Meta Llama/Llama 3.3 70B Instruct Turbo	131.1K	131.1K	$0.10	$0.32
Meta Llama/Llama 4 Maverick 17B 128E Instruct FP8	1M	1M	$0.15	$0.60
Meta Llama/llama 4 Scout 17b 16e Instruct	131.1K	8.2K	$0.11	$0.34
Meta Llama/Llama 4 Scout 17B 16E Instruct	327.7K	327.7K	$0.08	$0.30
Meta Llama/Llama Guard 4 12B	163.8K	163.8K	$0.18	$0.18	—
Meta Llama/Meta Llama 3.1 8B Instruct Turbo	131.1K	131.1K	$0.02	$0.03

Start building with Llama 3.1 8b Instant

Access Llama 3.1 8b Instant and every other model through Inworld Router or Realtime API. Create your free account and start routing in minutes.

Get Started Free Contact Sales