merlyn/server/utils/helpers
Tristan Stahnke b64a77f29f
Refactor AWS Bedrock Provider for Multi-modal Support & Correct Token Limits (#3714)
* Fixed two primary issues discovered while using AWS Bedrock with Anthropic Claude Sonnet models:
- Context Window defaults to 8192 maximum, which isn't correct
- Multimodal stopped working when removing langchain, which was transparently handling image_url to a format sonnet expects.

* Ran `yarn lint`

* Updated .env.example to have aws bedrock examples too

* Refactor for readability
move utils for AWS specific functionality to subfile
add token output max to ENV so setting persits

---------

Co-authored-by: Tristan Stahnke <tristan.stahnke+gpsec@guidepointsecurity.com>
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-05-06 12:55:24 -07:00
..
admin patch admin pwd update 2024-02-06 14:39:56 -08:00
chat Support historical message image inputs/attachments for n+1 queries (#2919) 2025-01-16 13:49:06 -08:00
camelcase.js Add support for Weaviate VectorDB (#181) 2023-08-08 18:02:30 -07:00
customModels.js openai filter other niche models 2025-05-05 12:07:48 -07:00
index.js Add new model provider PPIO (#3211) 2025-02-27 10:53:00 -08:00
portAvailabilityChecker.js [FEAT] Check port access in docker before showing a default error (#961) 2024-04-02 10:34:50 -07:00
tiktoken.js Add tokenizer improvments via Singleton class and estimation (#3072) 2025-01-30 17:55:03 -08:00
updateENV.js Refactor AWS Bedrock Provider for Multi-modal Support & Correct Token Limits (#3714) 2025-05-06 12:55:24 -07:00