michael/merlyn
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
d1ca16f7f8
merlyn/server/utils
History
Timothy Carambat d1ca16f7f8
Add tokenizer improvments via Singleton class and estimation (#3072) 
* Add tokenizer improvments via Singleton class
linting

* dev build

* Estimation fallback when string exceeds a fixed byte size

* Add notice to tiktoken on backend
2025-01-30 17:55:03 -08:00
..
agents Update NVIDIA branding 2025-01-28 10:27:31 -08:00
AiProviders Add tokenizer improvments via Singleton class and estimation (#3072) 2025-01-30 17:55:03 -08:00
BackgroundWorkers Add winston logging for production (#1811) 2024-07-03 16:39:33 -07:00
boot Add RAG agent plugin to API agent (#2171) 2024-08-23 09:32:19 -07:00
chats wip agent ui animation (#2999) 2025-01-22 11:10:02 -08:00
collectorApi [BETA] Live document sync (#1719) 2024-06-21 13:38:50 -07:00
comKey [BETA] Live document sync (#1719) 2024-06-21 13:38:50 -07:00
database Full developer api (#221) 2023-08-23 19:15:07 -07:00
DocumentManager Enable ability to do full-text query on documents (#758) 2024-02-21 13:15:45 -08:00
EmbeddingEngines patch gemini embedding key preference 2025-01-14 08:20:57 -08:00
EmbeddingRerankers/native Add fallback URL for reranking model 2025-01-07 15:09:54 -08:00
EncryptionManager [BETA] Live document sync (#1719) 2024-06-21 13:38:50 -07:00
files Normalize paths on files uploaded to prevent arbitrary file writes (#2905) 2024-12-30 14:29:10 -08:00
helpers Add tokenizer improvments via Singleton class and estimation (#3072) 2025-01-30 17:55:03 -08:00
http Add support for custom agent skills via plugins (#2202) 2024-09-10 17:06:02 -07:00
logger patch logger for full logs 2024-07-19 18:35:41 -07:00
middleware Patch custom models endpoint (#2903) 2024-12-30 14:58:26 -08:00
PasswordRecovery Strengthen field validations on user Updates (#1201) 2024-04-26 16:46:04 -07:00
prisma Remove unused deps (#1938) 2024-07-25 10:21:03 -07:00
telemetry Replace custom sqlite dbms with prisma (#239) 2023-09-28 14:00:03 -07:00
TextSplitter Add header static class for metadata assembly (#2567) 2024-11-04 11:47:46 -08:00
TextToSpeech Tts open ai compatible endpoints (#2487) 2024-10-15 21:39:31 -07:00
vectorDbProviders Fix similarity score bug in lance/chroma dbs (#2986) 2025-01-17 18:27:54 -08:00
vectorStore Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes (#2819) 2024-12-16 12:16:20 -08:00