merlyn/server/models
Timothy Carambat 2c19dd09ed
Native Embedder model selection (incl: Multilingual support) (#3835)
* WIP on embedder selection
TODO: apply splitting and query prefixes (if applicable)

* wip on upsert

* Support base model
support nomic-text-embed-v1
support multilingual-e5-small
Add prefixing for both embedding and query for RAG tasks
Add chunking prefix to all vector dbs to apply prefix when possible
Show dropdown and auto-pull on new selection

* norm translations

* move supported models to constants
handle null seelction or invalid selection on dropdown
update comments

* dev

* patch text splitter maximums for now

* normalize translations

* add tests for splitter functionality

* normalize

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-07-22 10:07:20 -07:00
..
apiKeys.js [FEAT] Automated audit logging (#667) 2024-02-06 15:21:40 -08:00
browserExtensionApiKey.js Patch path traversal in move-files that can be used by administrator level attacker only 2024-08-27 16:19:12 -07:00
cacheData.js Infinite prompt input and compression implementation (#332) 2023-11-06 13:13:53 -08:00
communityHub.js Publish slash commands to hub (#4019) 2025-06-24 16:19:50 -07:00
documents.js Prune telemetry events 2025-04-29 13:54:00 -07:00
documentSyncQueue.js fix issue with files loading with watching enabled (#3930) 2025-06-01 14:53:48 -05:00
documentSyncRun.js [BETA] Live document sync (#1719) 2024-06-21 13:38:50 -07:00
embedChats.js Add backfilling on query for chat widget to improve UX (#2482) 2024-10-15 14:37:44 -07:00
embedConfig.js Configurable message limit for embed chat widget (#4114) 2025-07-10 12:45:53 -07:00
eventLogs.js [FEAT] Automated audit logging (#667) 2024-02-06 15:21:40 -08:00
invite.js Add ability to add invitee to workspaces automatically (#975) 2024-03-26 16:38:32 -07:00
passwordRecovery.js [FEAT] Implement new login screen UI & multi-user password reset (#1074) 2024-04-25 16:52:30 -07:00
promptHistory.js fix null entry on new workspace 2025-05-08 08:34:37 -07:00
slashCommandsPresets.js Community hub integration (#2555) 2024-11-26 09:59:43 -08:00
systemPromptVariables.js Allow static defined prompt variables to be accessed by any authorized user (#4086) 2025-07-02 08:09:42 -07:00
systemSettings.js Native Embedder model selection (incl: Multilingual support) (#3835) 2025-07-22 10:07:20 -07:00
telemetry.js Prune telemetry events 2025-04-29 13:54:00 -07:00
temporaryAuthToken.js Simple SSO feature for login flows from external services (#2553) 2024-10-29 15:30:53 -07:00
user.js Allow period in username (#3592) 2025-04-03 16:42:39 -07:00
vectors.js Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes (#2819) 2024-12-16 12:16:20 -08:00
welcomeMessages.js [FIX] User messages not saving due to empty message check (#978) 2024-03-27 10:45:20 -07:00
workspace.js fix null entry on new workspace 2025-05-08 08:34:37 -07:00
workspaceAgentInvocation.js patch agent invocation regression 2024-04-27 12:39:45 -07:00
workspaceChats.js Handle BigInt in message response (#4110) 2025-07-10 12:33:34 -07:00
workspacesSuggestedMessages.js [FEAT] create custom prompt suggestions per workspace (#664) 2024-02-06 11:24:33 -08:00
workspaceThread.js Add ability to search workspace and threads (#4120) 2025-07-10 16:42:10 -07:00
workspaceUsers.js Add new workspace user management endpoint (#2842) 2024-12-16 11:50:34 -08:00