SambaNova Cloud

The SambaNova Cloud is a cloud platform for running large AI models with the world record Llama 3.1 70B/405B performance. You can follow the instructions in this blog post to configure your setup.

YAML

Package or config.yaml

models:
  - name: SambaNova Llama 3.1 405B
    provider: sambanova
    model: llama3.1-405b
    apiKey: <YOUR_SAMBANOVA_API_KEY>

JSON

config.json

{
  "models": [
    {
      "title": "SambaNova Llama 3.1 405B",
      "provider": "sambanova",
      "model": "llama3.1-405b",
      "apiKey": "<YOUR_SAMBANOVA_API_KEY>"
    }
  ]
}

View the source