Skip to main content

Amazon Bedrock

Chat model

We recommend configuring Claude 3.5 Sonnet as your chat model.

config.json
{
"models": [
{
"title": "Claude 3.5 Sonnet",
"provider": "bedrock",
"model": "anthropic.claude-3-5-sonnet-20240620-v1:0",
"region": "us-east-1",
"profile": "bedrock"
}
]
}

Autocomplete model

Bedrock currently does not offer any autocomplete models.

Click here to see a list of autocomplete model providers.

Embeddings model

We recommend configuring amazon.titan-embed-text-v2:0 as your embeddings model.

~/.continue/config.json
{
"embeddingsProvider": {
"title": "Embeddings Model",
"provider": "bedrock",
"model": "amazon.titan-embed-text-v2:0",
"region": "us-west-2"
}
}

Reranking model

Bedrock currently does not offer any reranking models.

Click here to see a list of reranking model providers.

Authentication

Authentication will be through temporary or long-term credentials in ~/.aws/credentials under a configured profile (e.g. "bedrock").

[bedrock]
aws_access_key_id = abcdefg
aws_secret_access_key = hijklmno
aws_session_token = pqrstuvwxyz # Optional: means short term creds.

Custom Imported Models

To setup Bedrock using custom imported models, add the following to your config.json file:

config.json
{
"models": [
{
"title": "AWS Bedrock deepseek-coder-6.7b-instruct",
"provider": "bedrockimport",
"model": "deepseek-coder-6.7b-instruct",
"modelArn": "arn:aws:bedrock:us-west-2:XXXXX:imported-model/XXXXXX",
"region": "us-west-2",
"profile": "bedrock"
}
]
}

Authentication will be through temporary or long-term credentials in ~/.aws/credentials under a configured profile (e.g. "bedrock").

[bedrock]
aws_access_key_id = abcdefg
aws_secret_access_key = hijklmno
aws_session_token = pqrstuvwxyz # Optional: means short term creds.