Ollama
Chat model
We recommend configuring Llama3.1 8B as your chat model.
config.json
{
"models": [
{
"title": "Llama3.1 8B",
"provider": "ollama",
"model": "llama3.1:8b"
}
]
}
Autocomplete model
We recommend configuring StarCoder2 3B as your autocomplete model.
config.json
{
"tabAutocompleteModel": {
"title": "StarCoder2 3B",
"provider": "ollama",
"model": "starcoder2:3b"
}
}
Embeddings model
We recommend configuring Nomic Embed Text as your embeddings model.
config.json
{
"embeddingsProvider": {
"provider": "ollama",
"model": "nomic-embed-text"
}
}
Reranking model
Ollama currently does not offer any reranking models.
Click here to see a list of reranking model providers.