SiliconFlow

info

You can get an API key from the Silicon Cloud.

Chat model

We recommend configuring Qwen/Qwen2.5-Coder-32B-Instruct as your chat model.

YAML

config.yaml

models:
  - name: Qwen
    provider: siliconflow
    model: Qwen/Qwen2.5-Coder-32B-Instruct
    apiKey: <YOUR_SILICONFLOW_API_KEY>
    roles:
      - chat

JSON

config.json

{
  "models": [
    {
      "title": "Qwen",
      "provider": "siliconflow",
      "model": "Qwen/Qwen2.5-Coder-32B-Instruct",
      "apiKey": "<YOUR_SILICONFLOW_API_KEY>"
    }
  ]
}

Autocomplete model

We recommend configuring Qwen/Qwen2.5-Coder-7B-Instruct as your autocomplete model.

YAML

config.yaml

models:
  - name: Qwen
    provider: siliconflow
    model: Qwen/Qwen2.5-Coder-32B-Instruct
    apiKey: <YOUR_SILICONFLOW_API_KEY>
    roles: 
      - autocomplete

JSON

config.json

{
  "models": [
    {
      "title": "Qwen",
      "provider": "siliconflow",
      "model": "Qwen/Qwen2.5-Coder-32B-Instruct",
      "apiKey": "<YOUR_SILICONFLOW_API_KEY>"
    }
  ]
  "tabAutocompleteModel": {
    "title": "Qwen",
    "provider": "siliconflow",
    "model": "Qwen/Qwen2.5-Coder-7B-Instruct",
    "apiKey": "<YOUR_SILICONFLOW_API_KEY>"
  }
}

Embeddings model

SiliconFlow provide some embeddings models, Click here to see a list of embeddings models.

Reranking model

SiliconFlow provide some reranking models, Click here to see a list of reranking models.