Skip to main content

Cloudflare Workers AI

Cloudflare Workers AI can be used for both chat and tab autocompletion in Continue. Here is an example of Cloudflare Workers AI configuration:

config.yaml
models:
- name: Llama 3 8B
provider: cloudflare
accountId: YOUR CLOUDFLARE ACCOUNT ID
apiKey: <YOUR_CLOUDFARE_API_KEY>
model: "@cf/meta/llama-3-8b-instruct"
contextLength: 2400
defaultCompletionOptions:
maxTokens: 500
roles:
- chat
- name: DeepSeek Coder 6.7b Instruct
provider: cloudflare
accountId: YOUR CLOUDFLARE ACCOUNT ID
apiKey: <YOUR_CLOUDFARE_API_KEY>
model: "@hf/thebloke/deepseek-coder-6.7b-instruct-awq"
contextLength: 2400
defaultCompletionOptions:
maxTokens: 500
roles:
- chat
- name: DeepSeek 7b
provider: cloudflare
accountId: YOUR CLOUDFLARE ACCOUNT ID
apiKey: <YOUR_CLOUDFARE_API_KEY>
model: "@hf/thebloke/deepseek-coder-6.7b-base-awq"
roles:
- autocomplete

Visit the Cloudflare dashboard to create an API key.

Review available models on Workers AI

View the source