Cloudflare Workers AI
Cloudflare Workers AI can be used for both chat and tab autocompletion in Continue. To setup Cloudflare Workers AI, add the following to your config.json file:
config.json
{
"models": [
{
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"contextLength": 2400,
"completionOptions": {
"maxTokens": 500
},
"model": "@cf/meta/llama-3-8b-instruct", // This can be the name of any model supported by Workers AI
"provider": "cloudflare",
"title": "Llama 3 8B"
},
{
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"contextLength": 2400,
"completionOptions": {
"maxTokens": 500
},
"model": "@hf/thebloke/deepseek-coder-6.7b-instruct-awq",
"provider": "cloudflare",
"title": "DeepSeek Coder 6.7b Instruct"
}
...
"tabAutocompleteModel": {
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"model": "@hf/thebloke/deepseek-coder-6.7b-base-awq",
"provider": "cloudflare",
"title": "DeepSeek 7b"
},
]
}
Visit the Cloudflare dashboard to create an API key.
Review available models on Workers AI