Nous Research

Hermes 3 Llama 3.1 70b

Name: Hermes 3 Llama 3.1 70b
Brand: Nous Research
Price: 0.3 USD
Availability: InStock

Hermes 3 Llama 3.1 70b is a large language model by Nous Research. It supports a 131K token context window with up to 131K tokens of output. Priced at $0.3 per million input tokens and $0.3 per million output tokens, it is one of the most cost-efficient options in its class. Access Hermes 3 Llama 3.1 70b through Inworld Router with OpenAI SDK compatibility, built-in failover, and intelligent routing across providers.

→

Use This Model

Step 1 — Create Router

curl --location 'https://api.inworld.ai/router/v1/routers' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "name": "compare-frontier-models",
  "defaultRoute": {
    "route_id": "default",
    "variants": [
      {
        "variant": {
          "variant_id": "deepinfra/hermes-3-llama-3-1-70b-a",
          "model_id": "deepinfra/hermes-3-llama-3-1-70b"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B-b",
          "model_id": "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B"
        },
        "weight": 33
      },
      {
        "variant": {
          "variant_id": "deepinfra/hermes-3-llama-3-1-70b-c",
          "model_id": "deepinfra/hermes-3-llama-3-1-70b"
        },
        "weight": 34
      }
    ]
  }
}'

import requests

response = requests.post(
    "https://api.inworld.ai/router/v1/routers",
    headers={
        "Authorization": "Basic <your-api-key>",
        "Content-Type": "application/json",
    },
    json={
        "name": "compare-frontier-models",
        "defaultRoute": {
            "route_id": "default",
            "variants": [
                {
                    "variant": {
                        "variant_id": "deepinfra/hermes-3-llama-3-1-70b-a",
                        "model_id": "deepinfra/hermes-3-llama-3-1-70b"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B-b",
                        "model_id": "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B"
                    },
                    "weight": 33
                },
                {
                    "variant": {
                        "variant_id": "deepinfra/hermes-3-llama-3-1-70b-c",
                        "model_id": "deepinfra/hermes-3-llama-3-1-70b"
                    },
                    "weight": 34
                }
            ]
        }
    },
)
print(response.json())

const response = await fetch(
  "https://api.inworld.ai/router/v1/routers",
  {
    method: "POST",
    headers: {
      Authorization: "Basic <your-api-key>",
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      name: "compare-frontier-models",
      defaultRoute: {
        route_id: "default",
        variants: [
          {
            variant: {
              variant_id: "deepinfra/hermes-3-llama-3-1-70b-a",
              model_id: "deepinfra/hermes-3-llama-3-1-70b",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B-b",
              model_id: "deepinfra/NousResearch/Hermes-3-Llama-3.1-405B",
            },
            weight: 33,
          },
          {
            variant: {
              variant_id: "deepinfra/hermes-3-llama-3-1-70b-c",
              model_id: "deepinfra/hermes-3-llama-3-1-70b",
            },
            weight: 34,
          },
        ],
      },
    }),
  }
);
const data = await response.json();
console.log(data);

Step 2 — Chat Completion

curl --location 'https://api.inworld.ai/v1/chat/completions' \
--header 'Authorization: Basic <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{
  "model": "inworld/compare-frontier-models",
  "messages": [{"role": "user", "content": "Hello!"}]
}'

Hermes 3 Llama 3.1 70b pricing and providers

Access Hermes 3 Llama 3.1 70b through DeepInfra via Inworld Router or Realtime API. By using the AI provider(s) below you acknowledge you reviewed and agree to their terms listed in the Legal section under the AI provider's name.