Shanmukeshwar
eeaa6b0151
feat: Add endpoint to retrieve documents by folder name ( #3258 )
...
* feat: Add endpoint to retrieve documents by folder name
* isWithin Check on path to prevent path traversal
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-02-18 14:01:19 -08:00
Sean Hatfield
354b66e09e
Add additional embed API endpoints ( #3264 )
...
* wip embed dev api endpoints
* fix /v1/embed/new endpoint
* add delete endpoint to embeds
* linting
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-02-18 13:56:56 -08:00
Timothy Carambat
c6ff3a7765
fix: Patch agent flow to honor agent handler established provider ( #3251 )
...
resolves #3248
2025-02-17 14:44:23 -08:00
Hakeem Abbas
ca60ba827b
fix: sanitizeNamespace ( #3246 )
...
bug fixes for sanitizing Namespaces and handling chunk size limit of astradb collections in each doc
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-02-17 13:54:32 -08:00
timothycarambat
e978c90ea0
Revert "disable PH people props"
...
This reverts commit 6fd34e5476
2025-02-17 09:56:14 -08:00
timothycarambat
6fd34e5476
disable PH people props
2025-02-17 09:43:18 -08:00
Timothy Carambat
2a9066e83a
OCR PDFs as fallback during upload ( #3204 )
...
* OCR PDFs as fallback in spawn thread
* wip
* build our own worker fanout and wrapper
* norm pkgs
* bump dev
2025-02-14 11:57:31 -08:00
Timothy Carambat
b6d3a411b1
Add querySelectorAll capability to web-scraping block ( #3186 )
...
* Add `querySelectorAll` capability to web-scraping block
* patches and fallbacks
* fix styles of text in web scraping block
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-02-13 16:11:15 -08:00
Adam Setch
ea8454ea79
chore: rename Gitlab to GitLab ( #3200 )
...
* chore: rename `Gitlab` to `GitLab`
Signed-off-by: Adam Setch <adam.setch@outlook.com>
* undo code changes - breaks refs
---------
Signed-off-by: Adam Setch <adam.setch@outlook.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-02-13 12:13:37 -08:00
Adam Setch
d63438fa61
chore: rename Github to GitHub ( #3199 )
...
* chore: rename Github to GitHub
Signed-off-by: Adam Setch <adam.setch@outlook.com>
* chore: rename Github to GitHub
Signed-off-by: Adam Setch <adam.setch@outlook.com>
* Undo some code changes for references
---------
Signed-off-by: Adam Setch <adam.setch@outlook.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-02-13 10:45:43 -08:00
Sean Hatfield
e5f3fb0892
Agent flow builder ( #3077 )
...
* wip agent builder
* refactor structure for agent builder
* improve ui for add block menu and sidebar
* lint
* node ui improvement
* handle deleting variable in all nodes
* add headers and body to apiCall node
* lint
* Agent flow builder backend (#3078 )
* wip agent builder backend
* save/load agent tasks
* lint
* refactor agent task to use uuids instead of names
* placeholder for run task
* update frontend sidebar + seperate backend to agent-tasks utils
* lint
* add deleting of agent tasks
* create AgentTasks class + wip load agent tasks into aibitat
* lint
* inject + call agent tasks
* wip call agent tasks
* add llm instruction + fix api calling blocks
* add ui + backend for editing/toggling agent tasks
* lint
* add back middlewares
* disable run task + add navigate to home on logo click
* implement normalizePath to prevent path traversal
* wip make api calling more consistent
* lint
* rename all references from task to flow
* patch load flow bug when on editing page
* remove unneeded files/comments
* lint
* fix delete endpoint + rename load flows
* add move block to ui + fix api-call backend + add telemetry
* lint
* add web scraping block
* only allow admin for agent builder
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* Move AgentFlowManager flows to static
simplify UI states
Handle LLM prompt flow when provided non-string
* delete/edit menu for agent flow panel + update flow icon
* lint
* fix open builder button hidden bug
* add tooltips to move up/down block buttons
* add tooltip to delete block
* truncate block description to fit on blocklist component
* light mode agent builder sidebar
* light mode api call block
* fix light mode styles for agent builder blocks
* agent flow fetch in UI
* sync delete flow
* agent flow ui/ux improvements
* remove unused AgentSidebar component
* comment out /run
* UI changes and updates for flow builder
* format flow panel info
* update link handling
* ui tweaks to header menu
* remove unused import
* update doc links
update block icons
* bump readme
* Patch code block header oddity
resolves #3117
* bump dev image
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-02-12 16:50:43 -08:00
Timothy Carambat
cc3d619061
Add handling to reasoning models for Generic OpenAI connector ( #3183 )
...
* Add handling to resoning models for Generic OpenAI connector
resolves #3177
* linting
2025-02-12 10:28:44 -08:00
Timothy Carambat
d90571fa33
Add improved logging and introspection to web-browsing ( #3140 )
2025-02-06 09:23:05 -08:00
Timothy Carambat
1bfd461719
Patch PPLX streaming for timeouts ( #3130 )
...
Add in-text citations as well for PPLX token streaming
handle timeouts for stream/buffer hanging
2025-02-05 16:35:22 -08:00
Timothy Carambat
df8d34d31e
Enable num_ctx to match defined chunk length in ollama embedder ( #3129 )
...
* Enable `num_ctx` to match defined chunk length in ollama embedder
* remove console
2025-02-05 15:46:39 -08:00
Timothy Carambat
e76baacec4
Add reasoning flag for azure models with "default" fallback ( #3128 )
2025-02-05 15:22:45 -08:00
timothycarambat
a5ee6121e2
Add patch for o# models on Azure
...
connect #3023
Note: depends on user naming the deployment correctly.
2025-02-05 11:34:03 -08:00
timothycarambat
c2c4f63643
bump cdn
2025-02-05 10:30:43 -08:00
timothycarambat
a4d5b2588f
o3 model patch
2025-02-03 14:19:21 -08:00
Timothy Carambat
d1ca16f7f8
Add tokenizer improvments via Singleton class and estimation ( #3072 )
...
* Add tokenizer improvments via Singleton class
linting
* dev build
* Estimation fallback when string exceeds a fixed byte size
* Add notice to tiktoken on backend
2025-01-30 17:55:03 -08:00
Timothy Carambat
e1af72daa7
parse streams from reasoning_content from DeepSeek API ( #3068 )
2025-01-30 14:55:20 -08:00
Timothy Carambat
8eac83bb82
Enable include_reasoning in request ( #3067 )
2025-01-30 14:32:38 -08:00
timothycarambat
6192080635
Update NVIDIA branding
2025-01-28 10:27:31 -08:00
Timothy Carambat
6aa1854155
Add ability to disable default agent skills ( #3041 )
...
* Add ability to disable default agent skills
* debug build
2025-01-27 16:52:43 -08:00
Sean Hatfield
75790e7e90
Remove native LLM option ( #3024 )
...
* remove native llm
* remove node-llama-cpp from dockerfile
* remove unneeded items from dockerfile
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-01-27 13:42:52 -08:00
Jason
c757c3fb5f
feat: update novita AI logo and default model ( #3037 )
2025-01-27 08:41:12 -08:00
Timothy Carambat
2ca22abc9c
Add Version to AzureOpenAI ( #3023 )
2025-01-24 13:41:37 -08:00
Sean Hatfield
48dcb22b25
Dynamic fetching of TogetherAI models ( #3017 )
...
* implement dynamic fetching of togetherai models
* implement caching for togetherai models
* update gitignore for togetherai model caching
* Remove models.json from git tracking
* Remove .cached_at from git tracking
* lint
* revert unneeded change
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-01-24 11:06:59 -08:00
timothycarambat
273d116586
linting
2025-01-23 16:43:18 -08:00
Sean Hatfield
57f4f46a39
Bump perplexity models ( #3014 )
...
* bump perplexity models
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-01-23 16:35:38 -08:00
Timothy Carambat
d35b37b6ec
wip agent ui animation ( #2999 )
...
* wip agent ui animation
* WIP agent ui revision
* linting
* simplify css
* memoize agent responses
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-01-22 11:10:02 -08:00
Sean Hatfield
f8c72786df
Fix similarity score bug in lance/chroma dbs ( #2986 )
...
* fix similarity score bug in lance/chroma dbs
* batch lower bound case
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-01-17 18:27:54 -08:00
Timothy Carambat
c4f75feb08
Support historical message image inputs/attachments for n+1 queries ( #2919 )
...
* Support historical message image inputs/attachments for n+1 queries
* patch gemini
* OpenRouter vision support cleanup
* xai vision history support
* Mistral logging
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-01-16 13:49:06 -08:00
timothycarambat
a2264f46ff
add index to response object for marshalling
...
resolves #2956
2025-01-14 14:43:00 -08:00
timothycarambat
4d5d8d4dec
patch gemini embedding key preference
...
resolves #2972
2025-01-14 08:20:57 -08:00
Timothy Carambat
21af81085a
Add caching to Gemini /models ( #2969 )
...
rename file typo
2025-01-13 13:12:03 -08:00
ReindeerFlotilla
be886f7d61
feat: add support for voyage-3-large and voyage-code-3 embedding models ( #2955 )
...
* feat: add support for voyage-3-large and voyage-code-3 embedding models
- Add voyage-3-large and voyage-code-3 to VoyageAiOptions dropdown
- Update getMaxEmbeddingLength to support 32k context for new models
- Update .env.example with new model options
* unset env example
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-01-08 17:21:30 -08:00
timothycarambat
6134c15ca4
Add fallback URL for reranking model
2025-01-07 15:09:54 -08:00
timothycarambat
e192364d8d
Migrate CDN download URL from S3 bucket
2025-01-07 12:09:14 -08:00
Sean Hatfield
c6547ec04d
Update example ENV files ( #2931 )
...
update example env files
2025-01-02 20:09:42 -08:00
Timothy Carambat
ad01df8790
Reranker option for RAG ( #2929 )
...
* Reranker WIP
* add cacheing and singleton loading
* Add field to workspaces for vectorSearchMode
Add UI for lancedb to change mode
update all search endpoints to pass in reranker prop if provider can use it
* update hint text
* When reranking, swap score to rerank score
* update optchain
2025-01-02 14:27:52 -08:00
Timothy Carambat
bb5c3b7e0d
make similarityResponse object arguments and not positional ( #2930 )
...
* make `similarityResponse` object arguments and not positional
* reuse client for qdrant
2025-01-02 12:03:26 -08:00
timothycarambat
f417ffd5e0
resolves #2926
...
floor ms value
2025-01-01 15:54:44 -08:00
timothycarambat
d52249aff8
support attachments via thread API chat/stream-chat endpoints
2024-12-31 09:52:21 -08:00
Timothy Carambat
ef71b95cf9
Return timestamps in OpenAI compat endpoints in proper format ( #2921 )
2024-12-31 09:35:52 -08:00
Chaiwat Saithongcum
fa3079bbbf
Add support for Google Generative AI (Gemini) embedder ( #2895 )
...
* Add support for Google Generative AI (Gemini) embedder
* Add missing example in docker
Fix UI key elements in options
Add Gemini to data handling section
Patch issues with chunk handling during embedding
* remove dupe in env
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-31 09:29:38 -08:00
Sean Hatfield
8d302c3f67
Patch custom models endpoint ( #2903 )
...
* prevent non admin users from changing llm settings via custom-models endpoint
* permission middleware to JSDOC
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-30 14:58:26 -08:00
Sean Hatfield
696af19c45
Patch unauthorized access to other user's pfps ( #2904 )
...
* patch unauthorized viewing of other user's pfps
* inline return responses
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-30 14:36:51 -08:00
Sean Hatfield
0b7bf68f2c
Normalize paths on files uploaded to prevent arbitrary file writes ( #2905 )
...
* normalize paths on files uploaded to prevent arbitrary file writes
* force normalize path in string parse
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-30 14:29:10 -08:00
Sean Hatfield
99b6dedc8b
Fix typo in frontend for SearXNG agent setup ( #2917 )
...
fix typo in frontend for SearXNG agent setup
2024-12-30 14:11:20 -08:00
