michael/merlyn
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,273 Commits 1 Branch 0 Tags 51 MiB
f3ea21bcd1
Commit Graph

635 Commits

Author SHA1 Message Date
Sean Hatfield
f3ea21bcd1
Prompt variables (#3359) 
* wip prompt variables

* refactor backend + add popup suggestions menu to frontend

* use processString to replace all variables in system prompts

* update translations

* fix translations

* wip highlight variables

* revert accidental name change

* rename everything, remove translations

* Update prompt var UI and backend logic

* Update form handler
linting

* linting

* normalize all translation files for prompt variables

* prompt vars dev image

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-03-25 12:44:19 -07:00
Sean Hatfield
f0b7919a8f
Protected slash command check (#3524) 
* protected slash command check

* fix error handling on frontend

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-24 17:09:36 -07:00
Sean Hatfield
5785a705cf
Enable use of @agent in slash commands (#3508) 
* allow @agent in slash commands

* make prompt input focused on slash command click

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-24 11:35:48 -07:00
Sean Hatfield
19ba6bcc15
Enable slash commands in dev API chat/stream-chat (#3514) 
* enable slash commands in dev api

* lint

* Remove ability to use default slash commands in API request
Add `reset` param to body that can reset chats according to the api chat execution parameters
Allow null `message` if `reset` is set in request.
Added early return for if message is null and reset is true
Enable chat to reset chat history and continue `message` execution
Added generic WorkspaceChat history reset function. Deprecated others

* update grep function comment
remove debug

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-24 11:29:36 -07:00
timothycarambat
0d1a2f06aa remove dupe key 2025-03-20 11:16:40 -07:00
Sean Hatfield
688ade6d96
Bump LanceDB (#3015) 
* bump lancedb

* dev build

* normalize build

* wtf is going on with build now

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-20 10:00:38 -07:00
Timothy Carambat
b54ab7be05
CHORE: debounce telems to prevent spamming (#3505) 
debounce telems to prevent spamming
 2025-03-20 08:40:28 -07:00
Sean Hatfield
e01c0dff04
Fix embedding endpoint for OpenAI compatible API (#3467) 
* fix embedding endpoint for openai compatible api

* remove unused imports

* add backwards compat for embedding

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-17 18:10:24 -07:00
Sean Hatfield
f6239a39f8
fix chroma db + add similarity offset (#3458) 
* fix chroma db + add similarity offset

* patch chroma scoring

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-17 17:48:23 -07:00
timothycarambat
0d5e869f5c Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-03-17 17:47:55 -07:00
timothycarambat
0c34d62342 fix pkg order 2025-03-17 17:47:48 -07:00
Sean Hatfield
5658aac25c
Add remove folder developer API endpoint (#3489) 
* add remove folder api endpoint

* update purgeFolder function comment

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-03-17 17:05:21 -07:00
timothycarambat
0b1a0e0a1f Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-03-04 09:08:21 -08:00
timothycarambat
b4afb995d4 Show default deepseek models on wrong API key 
connect #3390
 2025-03-04 09:07:49 -08:00
Timothy Carambat
66b4bf2679
Add support for Anthropics /model endpoint (finally) (#3376) 
* Add support for Anthropics /model endpoint (finally)

* dev
 2025-02-28 13:29:43 -08:00
AbelDuan
df166eb64e
feat: Add multilingual support for ocr module (#3325) 
* Add multilingual support for ocr mudule

* Add OCR langauge as server var that is passed into Collector
Support all valid tesseract language codes
Filter and parse only valid codes with fallbacks'

* persist TARGET_OCR_LANG

* update docker example env

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-02-27 12:31:17 -08:00
cnJasonZ
2aeb4c2961
Add new model provider PPIO (#3211) 
* feat: add new model provider PPIO

* fix: fix ppio model fetching

* fix: code lint

* reorder LLM
update interface for streaming and chats to use valid keys
linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-27 10:53:00 -08:00
Kristofer Bourro
b07240deee
Windows development environment variables support (#3354) 
* Windows development environment variables support

* moved cross-env to dev dependencies

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-02-27 10:43:31 -08:00
Sean Hatfield
6dd1fdc546
Add bio field to user (#3346) 
* add bio to users table

* lint

* add bio field to edit user admin page

* fix bio saving on new user

* simplify updating localstorage user

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-26 15:23:24 -08:00
timothycarambat
fa454aa6ca patch openapi swagger docs 2025-02-26 12:30:26 -08:00
Shanmukeshwar
d005107e24
feat: Add endpoint to upload documents to a specified folder (#3276) 
* feat: Add endpoint to retrieve documents by folder name

* isWithin Check on path to prevent path traversal

* feat: Add endpoint to upload documents to a specified folder

* refactor upload to folder endpoint + update jsdoc for swagger

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
 2025-02-26 12:26:24 -08:00
Timothy Carambat
2f5ed6c705
fix: bug where in single user mode deletion of an api key deletes all (#3358) 
* fix: bug where in single user mode deletion of an api key deletes all
resolves #3352

* linting
 2025-02-26 12:17:00 -08:00
Skanda Kaashyap
d1354caccb
[FEAT] Add claude-3-7 (#3337) 
* add claude 3-7 sonnet

* made all the changes everywhere

* add 3-7-sonnet-latest model

* lint

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
 2025-02-25 12:52:17 -08:00
Sean Hatfield
c36df2c364
Fix garbled non English chars on document upload (#3301) 
update handleAPIFileUpload middleware to handle non english chars + update jsdoc
 2025-02-20 23:09:34 -08:00
Timothy Carambat
dec13beb6e
Update null-check function for aibitat runners (#3283) 
* Update nullcheck function for aibitat runners

resolves #3273
closes #3277

* lint
 2025-02-19 10:21:31 -08:00
Sean Hatfield
e53ec1474e
Normalize chat sorting defaults in developer API (#3270) 
* normalize sorting for workspace and workspace thread chats in dev api

* lint

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-02-18 20:50:22 -08:00
timothycarambat
12b43256a0 lint 2025-02-18 20:49:40 -08:00
timothycarambat
defeb96c38 patch swagger 2025-02-18 16:02:55 -08:00
Sushanth Srivatsa
3fd0fe8fc5
2749 ollama client auth token (#3005) 
* ollama auth token provision

* auth token provision

* ollama auth provision

* ollama auth token

* ollama auth provision

* token input field css fix

* Fix provider handler not using key
sensible fallback to not break existing installs
re-order of input fields
null-check for API key and header optional insert on request
linting

* apply header and auth to agent invocations

* upgrading to ollama 5.10 for passing headers to constructor

* rename Auth systemSetting key to be more descriptive
linting and copy

* remove untracked files + update gitignore

* remove debug

* patch lockfile

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-18 16:00:17 -08:00
Shanmukeshwar
eeaa6b0151
feat: Add endpoint to retrieve documents by folder name (#3258) 
* feat: Add endpoint to retrieve documents by folder name

* isWithin Check on path to prevent path traversal

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-18 14:01:19 -08:00
Sean Hatfield
354b66e09e
Add additional embed API endpoints (#3264) 
* wip embed dev api endpoints

* fix /v1/embed/new endpoint

* add delete endpoint to embeds

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-18 13:56:56 -08:00
Timothy Carambat
c6ff3a7765
fix: Patch agent flow to honor agent handler established provider (#3251) 
resolves #3248
 2025-02-17 14:44:23 -08:00
Hakeem Abbas
ca60ba827b
fix: sanitizeNamespace (#3246) 
bug fixes for sanitizing Namespaces and handling chunk size limit of astradb collections in each doc

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-02-17 13:54:32 -08:00
timothycarambat
e978c90ea0 Revert "disable PH people props" 
This reverts commit 6fd34e5476.
 2025-02-17 09:56:14 -08:00
timothycarambat
6fd34e5476 disable PH people props 2025-02-17 09:43:18 -08:00
Timothy Carambat
2a9066e83a
OCR PDFs as fallback during upload (#3204) 
* OCR PDFs as fallback in spawn thread

* wip

* build our own worker fanout and wrapper

* norm pkgs

* bump dev
 2025-02-14 11:57:31 -08:00
Timothy Carambat
b6d3a411b1
Add querySelectorAll capability to web-scraping block (#3186) 
* Add `querySelectorAll` capability to web-scraping block

* patches and fallbacks

* fix styles of text in web scraping block

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
 2025-02-13 16:11:15 -08:00
Adam Setch
ea8454ea79
chore: rename Gitlab to GitLab (#3200) 
* chore: rename `Gitlab` to `GitLab`

Signed-off-by: Adam Setch <adam.setch@outlook.com>

* undo code changes - breaks refs

---------

Signed-off-by: Adam Setch <adam.setch@outlook.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-13 12:13:37 -08:00
Adam Setch
d63438fa61
chore: rename Github to GitHub (#3199) 
* chore: rename Github to GitHub

Signed-off-by: Adam Setch <adam.setch@outlook.com>

* chore: rename Github to GitHub

Signed-off-by: Adam Setch <adam.setch@outlook.com>

* Undo some code changes for references

---------

Signed-off-by: Adam Setch <adam.setch@outlook.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
 2025-02-13 10:45:43 -08:00
Sean Hatfield
e5f3fb0892
Agent flow builder (#3077) 
* wip agent builder

* refactor structure for agent builder

* improve ui for add block menu and sidebar

* lint

* node ui improvement

* handle deleting variable in all nodes

* add headers and body to apiCall node

* lint

* Agent flow builder backend (#3078)

* wip agent builder backend

* save/load agent tasks

* lint

* refactor agent task to use uuids instead of names

* placeholder for run task

* update frontend sidebar + seperate backend to agent-tasks utils

* lint

* add deleting of agent tasks

* create AgentTasks class + wip load agent tasks into aibitat

* lint

* inject + call agent tasks

* wip call agent tasks

* add llm instruction + fix api calling blocks

* add ui + backend for editing/toggling agent tasks

* lint

* add back middlewares

* disable run task + add navigate to home on logo click

* implement normalizePath to prevent path traversal

* wip make api calling more consistent

* lint

* rename all references from task to flow

* patch load flow bug when on editing page

* remove unneeded files/comments

* lint

* fix delete endpoint + rename load flows

* add move block to ui + fix api-call backend + add telemetry

* lint

* add web scraping block

* only allow admin for agent builder

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* Move AgentFlowManager flows to static
simplify UI states
Handle LLM prompt flow when provided non-string

* delete/edit menu for agent flow panel + update flow icon

* lint

* fix open builder button hidden bug

* add tooltips to move up/down block buttons

* add tooltip to delete block

* truncate block description to fit on blocklist component

* light mode agent builder sidebar

* light mode api call block

* fix light mode styles for agent builder blocks

* agent flow fetch in UI

* sync delete flow

* agent flow ui/ux improvements

* remove unused AgentSidebar component

* comment out /run

* UI changes and updates for flow builder

* format flow panel info

* update link handling

* ui tweaks to header menu

* remove unused import

* update doc links
update block icons

* bump readme

* Patch code block header oddity
resolves #3117

* bump dev image

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2025-02-12 16:50:43 -08:00
Timothy Carambat
cc3d619061
Add handling to reasoning models for Generic OpenAI connector (#3183) 
* Add handling to resoning models for Generic OpenAI connector
resolves #3177

* linting
 2025-02-12 10:28:44 -08:00
Timothy Carambat
d90571fa33
Add improved logging and introspection to web-browsing (#3140) 2025-02-06 09:23:05 -08:00
Timothy Carambat
1bfd461719
Patch PPLX streaming for timeouts (#3130) 
Add in-text citations as well for PPLX token streaming
handle timeouts for stream/buffer hanging
 2025-02-05 16:35:22 -08:00
Timothy Carambat
df8d34d31e
Enable num_ctx to match defined chunk length in ollama embedder (#3129) 
* Enable `num_ctx` to match defined chunk length in ollama embedder

* remove console
 2025-02-05 15:46:39 -08:00
Timothy Carambat
e76baacec4
Add reasoning flag for azure models with "default" fallback (#3128) 2025-02-05 15:22:45 -08:00
timothycarambat
a5ee6121e2 Add patch for o# models on Azure 
connect #3023
Note: depends on user naming the deployment correctly.
 2025-02-05 11:34:03 -08:00
timothycarambat
c2c4f63643 bump cdn 2025-02-05 10:30:43 -08:00
timothycarambat
a4d5b2588f o3 model patch 2025-02-03 14:19:21 -08:00
Timothy Carambat
d1ca16f7f8
Add tokenizer improvments via Singleton class and estimation (#3072) 
* Add tokenizer improvments via Singleton class
linting

* dev build

* Estimation fallback when string exceeds a fixed byte size

* Add notice to tiktoken on backend
 2025-01-30 17:55:03 -08:00
Timothy Carambat
e1af72daa7
parse streams from reasoning_content from DeepSeek API (#3068) 2025-01-30 14:55:20 -08:00