merlyn/server
Timothy Carambat 2c19dd09ed
Native Embedder model selection (incl: Multilingual support) (#3835)
* WIP on embedder selection
TODO: apply splitting and query prefixes (if applicable)

* wip on upsert

* Support base model
support nomic-text-embed-v1
support multilingual-e5-small
Add prefixing for both embedding and query for RAG tasks
Add chunking prefix to all vector dbs to apply prefix when possible
Show dropdown and auto-pull on new selection

* norm translations

* move supported models to constants
handle null seelction or invalid selection on dropdown
update comments

* dev

* patch text splitter maximums for now

* normalize translations

* add tests for splitter functionality

* normalize

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-07-22 10:07:20 -07:00
..
__tests__/utils Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
endpoints Fix multimodal chats via openai compat api (#4135) 2025-07-22 09:57:32 -07:00
jobs Feature/drupalwiki collector (#3693) 2025-04-21 09:17:24 -07:00
models Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
prisma Configurable message limit for embed chat widget (#4114) 2025-07-10 12:45:53 -07:00
storage Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
swagger Allow custom headers in upload-link endpoint (#3695) 2025-04-22 12:47:12 -07:00
utils Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
.env.example Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
.flowconfig devcontainer v1 (#297) 2024-01-08 15:31:06 -08:00
.gitignore JSON Parser from agent flow blocks (#3863) 2025-06-05 07:18:00 -07:00
.nvmrc Implement Chroma Support (#1) 2023-06-07 21:31:35 -07:00
index.js ModelContextProtocol (MCP) Full Compatibility (#3547) 2025-03-31 16:15:19 -05:00
jsconfig.json devcontainer v1 (#297) 2024-01-08 15:31:06 -08:00
nodemon.json Full developer api (#221) 2023-08-23 19:15:07 -07:00
package.json 1.8.4 tag update 2025-07-16 10:40:39 -07:00
yarn.lock Add ability to search workspace and threads (#4120) 2025-07-10 16:42:10 -07:00