Llamafile
A llamafile is a self-contained binary that can run an open-source LLM. You can configure this provider in your config.json as follows:
config.json
{
"models": [
{
"title": "Llamafile",
"provider": "llamafile",
"model": "mistral-7b"
}
]
}