OpenRouter
OpenRouter is a unified interface for commercial and open-source models, giving you access to the best models at the best prices. You can sign up here, create your API key on the keys page, and then choose a model from the list of supported models.
Change ~/.continue/config.json
to look like the following.
config.json
{
"models": [
{
"title": "OpenRouter LLaMA 70 8B",
"provider": "openrouter",
"model": "meta-llama/llama-3-70b-instruct",
"apiBase": "https://openrouter.ai/api/v1",
"apiKey": "..."
}
]
}
To utilize features such as provider preferences or model routing configuration, include these parameters inside the models[].requestsOptions.extraBodyProperties
field of your plugin config.
For example, to prevent extra long prompts from being compressed, you can explicitly turn off the feature like so:
config.json
{
"models": [
{
...
"requestOptions": {
"extraBodyProperties": {
"transforms": []
}
}
}
]
}
Learn more about available settings here.