merlyn/server/utils/AiProviders
Timothy Carambat e80492606a
Automatic Context window detection (#3817)
* Add context window finder from litellm maintained list
apply to all cloud providers, have client cache for 3 days

* linting
2025-05-14 11:03:19 -07:00
..
anthropic Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
apipie Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
azureOpenAi patch Azure image reading regressions 2025-05-12 11:10:35 -07:00
bedrock feat: support for iam roles for bedrock client (#2632) 2025-05-06 13:48:15 -07:00
cohere Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
deepseek Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
fireworksAi LLM performance metric tracking (#2825) 2024-12-16 14:31:17 -08:00
gemini Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
genericOpenAi Add handling to reasoning models for Generic OpenAI connector (#3183) 2025-02-12 10:28:44 -08:00
groq Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
huggingface LLM performance metric tracking (#2825) 2024-12-16 14:31:17 -08:00
koboldCPP Add option to control KoboldCPP max response tokens (#3746) 2025-05-02 14:12:06 -07:00
liteLLM Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
lmStudio Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
localAi Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
mistral Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
modelMap Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
novita feat: update novita AI logo and default model (#3037) 2025-01-27 08:41:12 -08:00
nvidiaNim Update NVIDIA branding 2025-01-28 10:27:31 -08:00
ollama lint 2025-02-18 20:49:40 -08:00
openAi Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00
openRouter linting 2025-04-15 12:51:08 -07:00
perplexity handling of citations in openRouter provider #3581 (#3620) 2025-04-15 10:57:09 -07:00
ppio Add new model provider PPIO (#3211) 2025-02-27 10:53:00 -08:00
textGenWebUI Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
togetherAi Dynamic fetching of TogetherAI models (#3017) 2025-01-24 11:06:59 -08:00
xai Automatic Context window detection (#3817) 2025-05-14 11:03:19 -07:00