OpenRouter

OpenRouter is a unified interface for commercial and open-source models, giving you access to the best models at the best prices. You can sign up here, create your API key on the keys page, and then choose a model from the list of supported models.

Change ~/.continue/config.json to look like the following.

YAML

Package or config.yaml

models:
  - name: OpenRouter LLaMA 70 8B
    provider: openrouter
    model: meta-llama/llama-3-70b-instruct
    apiBase: https://openrouter.ai/api/v1
    apiKey: <YOUR_OPEN_ROUTER_API_KEY>

JSON

config.json

{
  "models": [
    {
      "title": "OpenRouter LLaMA 70 8B",
      "provider": "openrouter",
      "model": "meta-llama/llama-3-70b-instruct",
      "apiBase": "https://openrouter.ai/api/v1",
      "apiKey": "<YOUR_OPEN_ROUTER_API_KEY>"
    }
  ]
}

To utilize features such as provider preferences or model routing configuration, include these parameters inside the models[].requestsOptions.extraBodyProperties field of your plugin config.

For example, to prevent extra long prompts from being compressed, you can explicitly turn off the feature like so:

YAML

Package or config.yaml

models:
  - name: Example Model
    provider: exampleProvider
    model: example-model
    requestOptions:
      extraBodyProperties:
        transforms: []

JSON

config.json

{
  "models": [
    {
      "title": "Example Model",
      "provider": "exampleProvider",
      "model": "example-model",
      "requestOptions": {
        "extraBodyProperties": {
          "transforms": []
        }
      }
    }
  ]
}

Learn more about available settings here.