Anthropic
info
You can get an API key from the Anthropic console.
Chat model
We recommend configuring Claude 3.5 Sonnet as your chat model.
config.json
{
"models": [
{
"title": "Claude 3.5 Sonnet",
"provider": "anthropic",
"model": "claude-3-5-sonnet-20240620",
"apiKey": "[API_KEY]"
}
]
}
Autocomplete model
Anthropic currently does not offer any autocomplete models.
Click here to see a list of autocomplete model providers.
Embeddings model
Anthropic currently does not offer any embeddings models.
Click here to see a list of embeddings model providers.
Reranking model
Anthropic currently does not offer any reranking models.
Click here to see a list of reranking model providers.
Prompt caching
Anthropic supports prompt caching with Claude.
Currently, we only allow caching of the system message. To enable this feature, update your your model configuration with "cacheSystemMessage": true
:
{
"models": [
{
// Enable prompt caching
"cacheSystemMessage": true,
"title": "Anthropic",
"provider": "anthropic",
"model": "claude-3-5-sonnet-20240620",
"apiKey": "[API_KEY]"
}
]
}