Cerebras

Llama3.1 8b

Name: Llama3.1 8b
Brand: Cerebras
Price: 0.1 USD
Availability: InStock

Llama3.1 8b is a large language model by Cerebras. Priced at $0.1 per million input tokens and $0.1 per million output tokens, it is one of the most cost-efficient options in its class. Access Llama3.1 8b through Inworld Router with OpenAI SDK compatibility, built-in failover, and intelligent routing across providers.

→

Use This Model

Step 1 — Create Router

curl --location 'https://api.inworld.ai/router/v1/routers' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "name": "compare-frontier-models",
  "defaultRoute": {
    "route_id": "default",
    "variants": [
      {
        "variant": {
          "variant_id": "cerebras/llama3.1-8b-a",
          "model_id": "cerebras/llama3.1-8b"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "cerebras/llama3.1-8b-b",
          "model_id": "cerebras/llama3.1-8b"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "cerebras/llama3.1-8b-c",
          "model_id": "cerebras/llama3.1-8b"
        },
        "weight": 34
      }
    ]
  }
}'

import requests

response = requests.post(
    "https://api.inworld.ai/router/v1/routers",
    headers={
        "Authorization": "Basic <your-api-key>",
        "Content-Type": "application/json",
    },
    json={
        "name": "compare-frontier-models",
        "defaultRoute": {
            "route_id": "default",
            "variants": [
                {
                    "variant": {
                        "variant_id": "cerebras/llama3.1-8b-a",
                        "model_id": "cerebras/llama3.1-8b"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "cerebras/llama3.1-8b-b",
                        "model_id": "cerebras/llama3.1-8b"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "cerebras/llama3.1-8b-c",
                        "model_id": "cerebras/llama3.1-8b"
                    },
                    "weight": 34
                }
            ]
        }
    },
)
print(response.json())

const response = await fetch(
  "https://api.inworld.ai/router/v1/routers",
  {
    method: "POST",
    headers: {
      Authorization: "Basic <your-api-key>",
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      name: "compare-frontier-models",
      defaultRoute: {
        route_id: "default",
        variants: [
          {
            variant: {
              variant_id: "cerebras/llama3.1-8b-a",
              model_id: "cerebras/llama3.1-8b",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "cerebras/llama3.1-8b-b",
              model_id: "cerebras/llama3.1-8b",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "cerebras/llama3.1-8b-c",
              model_id: "cerebras/llama3.1-8b",
            },
            weight: 34,
          },
        ],
      },
    }),
  }
);
const data = await response.json();
console.log(data);

Step 2 — Chat Completion

curl --location 'https://api.inworld.ai/v1/chat/completions' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "model": "inworld/compare-frontier-models",
  "messages": [{"role": "user", "content": "Hello!"}]
}'

Llama3.1 8b pricing and providers

Access Llama3.1 8b through Cerebras via Inworld Router or Realtime API. By using the AI provider(s) below you acknowledge you reviewed and agree to their terms listed in the Legal section under the AI provider's name.