Commit Graph

1718 Commits

Author SHA1 Message Date
Neha Prasad
a230a44f5c
feat: Add Exa as a Search Provider (#4258)
* Added exa-search case to the search provider switch in web-browsing.js

* Added ExaSearchOptions component for API key input

* update

* Patch missing image crashing UI
Fix issue where ENV key did not exist or was saved on click
Update copy for provider
Add Docs for ENV keys for manual placements
update systemssettings for returning key saved to UI

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-08-11 09:46:50 -07:00
Timothy Carambat
0fb33736da
Workspace Chat with documents overhaul (#4261)
* Create parse endpoint in collector (#4212)

* create parse endpoint in collector

* revert cleanup temp util call

* lint

* remove unused cleanupTempDocuments function

* revert slug change
minor change for destinations

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* Add parsed files table and parse server endpoints (#4222)

* add workspace_parsed_files table + parse endpoints/models

* remove dev api parse endpoint

* remove unneeded imports

* iterate over all files + remove unneeded update function + update telemetry debounce

* Upload UI/UX context window check + frontend alert (#4230)

* prompt user to embed if exceeds prompt window + handle embed + handle cancel

* add tokenCountEstimate to workspace_parsed_files + optimizations

* use util for path locations + use safeJsonParse

* add modal for user decision on overflow of context window

* lint

* dynamic fetching of provider/model combo + inject parsed documents

* remove unneeded comments

* popup ui for attaching/removing files + warning to embed + wip fetching states on update

* remove prop drilling, fetch files/limits directly in attach files popup

* rework ux of FE + BE optimizations

* fix ux of FE + BE optimizations

* Implement bidirectional sync for parsed file states
linting
small changes and comments

* move parse support to another endpoint file
simplify calls and loading of records

* button borders

* enable default users to upload parsed files but NOT embed

* delete cascade on user/workspace/thread deletion to remove parsedFileRecord

* enable bgworker with "always" jobs and optional document sync jobs
orphan document job: Will find any broken reference files to prevent overpollution of the storage folder. This will run 10s after boot and every 12hr after

* change run timeout for orphan job to 1m to allow settling before spawning a worker

* linting and cleanup pr

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* dev build

* fix tooltip hiding during embedding overflow files

* prevent crash log from ERRNO on parse files

* unused import

* update docs link

* Migrate parsed-files to GET endpoint
patch logic for grabbing models names from utils
better handling for undetermined context windows (null instead of Pos_INIFI)
UI placeholder for null context windows

* patch URL

---------

Co-authored-by: Sean Hatfield <seanhatfield5@gmail.com>
2025-08-11 09:26:19 -07:00
dp
9451cd596f
feat: add Romanian translation (#4247)
* feat: add Romanian translation

* Update resources.js

Add Romanian

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-08-11 08:17:37 -07:00
Timothy Carambat
585308c2e5
docs(i18n): Complete missing Spanish translations (#4263)
* Update all null values for Spanish language

* linting

---------

Co-authored-by: Jesús Verduzco <3856266+jeverduzco@users.noreply.github.com>
2025-08-08 11:37:43 -07:00
start-life
20468d7053
Update common.js Hebrew language update (#4241)
* Update common.js

Hebrew language update

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-08-05 09:55:08 -07:00
Timothy Carambat
fe26312082
Fix password hint text (#4235) 2025-08-01 10:45:27 -07:00
Timothy Carambat
a9d9f9cdfd
Add custom JWT TTL (#4234)
resolves #4224
2025-08-01 10:39:38 -07:00
Timothy Carambat
c218a0dfe3
Mobile sync support (#4173)
* WIP on mobile connections
todo: register devices
todo: data sync or connection

* improve connection flow and registration
add streaming from service
TODO: user scoping

* dev build mobile support

* fix path

* handle relative URLs

* handle localhost access in product

* add device de-register

* sync styles

* move UI to be out of the normal path since beta only

* Add user scoping to mobile connection requests
Remigrate DB for user associations
Implement temp token registration to prevent unauthorized device registration requests
cleanup middlewares
2025-07-31 12:28:03 -07:00
Timothy Carambat
755ef4bb80
STT append spoken text (#4216)
* STT append spoken text

* remove default args from calls

* fix bug where message and input were out of sync

* update diffs
2025-07-31 12:23:36 -07:00
timothycarambat
4b7932f9e1 Fix agent iam_role implied agentic tool calling
resolves #4193
contrib: @bechir2000
2025-07-31 09:56:08 -07:00
Neha Prasad
ea5f66978b
fix: API export-chats endpoint function import error (#4220)
fix: resolve prepareWorkspaceChatsForExport function not found error in API export-chats endpoint
2025-07-30 12:19:27 -07:00
Timothy Carambat
a0af24624d
Update check for validFuncCall to only check required args and for undefined options (#4214)
* Update check for `validFuncCall` to only check required args and for undefined options

* update

* remove unused helper class func
2025-07-30 11:59:23 -07:00
timothycarambat
f1486c03f7 patch microphone tooltip id mismatch 2025-07-30 11:39:06 -07:00
Timothy Carambat
24f176c049
[Chore]: sendCommand non positional call signature (#4218)
Chore: `sendCommand` non positional call signature
2025-07-30 11:28:02 -07:00
Timothy Carambat
70a07b743b
Update writeToServerDocuments to take config object (#4213) 2025-07-29 17:53:05 -07:00
timothycarambat
7692775942 minor change to XLSX parse and upload output folder 2025-07-29 17:44:47 -07:00
Sean Hatfield
8c7923a283
Fix app version metrics endpoint (#4209)
fix app version metrics endpoint
2025-07-28 15:37:06 -07:00
Roman Wu
78cbb06c57
Modify the PostgreSQL SQL connector to support querying tables from schemas other than the default public schema. (#4202)
* Add PostgreSQL schema support to SQL connector

- Add schema configuration option to PostgreSQL connector
- Update SQL queries to filter by specified schema
- Add schema input field to frontend connection modal (PostgreSQL only)
- Default to 'public' schema when no custom schema specified
- Add getQualifiedTableName() method for schema.table format

* Fix code formatting after linting

* Update Postgresql.js

* add back removal of ending curly brace

* Update Postgresql.js

* add back removal of ending curly brace (again?)

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-07-28 08:43:15 -07:00
Anton Harder
89724169dc
fix: correct some typos and grammatical errors in translation strings and index.jsx (#4195)
fix(locales): correct some typos and grammatical errors in translation strings and index.jsx
2025-07-23 11:10:18 -07:00
Timothy Carambat
2c19dd09ed
Native Embedder model selection (incl: Multilingual support) (#3835)
* WIP on embedder selection
TODO: apply splitting and query prefixes (if applicable)

* wip on upsert

* Support base model
support nomic-text-embed-v1
support multilingual-e5-small
Add prefixing for both embedding and query for RAG tasks
Add chunking prefix to all vector dbs to apply prefix when possible
Show dropdown and auto-pull on new selection

* norm translations

* move supported models to constants
handle null seelction or invalid selection on dropdown
update comments

* dev

* patch text splitter maximums for now

* normalize translations

* add tests for splitter functionality

* normalize

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2025-07-22 10:07:20 -07:00
Sean Hatfield
31a8ead823
Fix multimodal chats via openai compat api (#4135)
* fix multimodal chats via openai compat api

* lint

* add tests for multi-modal content in openai compat endpoint

* refactor to normalize how openai attachments are handled

* uncheck file

* rewrite tests, autodetect mime from dataurl, and spread attachments from prompt

* lint

* revert and fix tests

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-07-22 09:57:32 -07:00
Sean Hatfield
6d6bd14622
Moonshot AI LLM & agent provider (#4178)
* add moonshot ai LLM & agent provider

* fix moonshot agent calling

* handle attachments/fix moonshot llm provider

* update docs/example env

* add moonshot to onboarding privacy

* add moonshot to onboarding llm preference

* update privacy for moonshot ai

* update logo higher res

* remove caching and use modelmap
2025-07-22 09:56:51 -07:00
Timothy Carambat
1112ba75c9
run jest (#4177)
* run jest

* wip

* wip

* wip

* wip

* skip frontend

* rename

* force failure

* fix forced error
try layer caching for speed

* test cache

* revert forced failure

* remove branch test
2025-07-18 14:20:07 -07:00
Burak Topal
4999837d74
Update BARE_METAL.md (#4175)
Pull Request Type
[ ]  feat

[x] 🐛 fix

[ ] ♻️ refactor

[ ] 💄 style

[ ] 🔨 chore

[ ] 📝 docs

Relevant Issues
N/A (No issue exists for this typo fix)

What is in this change?
This PR corrects a minor typo in an output message within a script.

Before:
echo "Copying to Sever Public"

After:
echo "Copying to Server Public"

Additional Information
This is a minor correction to improve the clarity and professionalism of the script's output. No functional changes are introduced.

Developer Validations
[ ] I ran yarn lint from the root of the repo & committed changes

[ ] Relevant documentation has been updated

[ ] I have tested my code functionality

[ ] Docker build succeeds locally
2025-07-18 09:01:51 -07:00
Sean Hatfield
ea8ba2f7f2
Clear cached docs on text splitter changes (#4163)
* clear cached docs on text splitter changes

* update warning message and title

* remove unsused translation keys

* wrap trycatch

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-07-17 11:03:18 -07:00
Timothy Carambat
043cb1d085
Add model field parameter for generic OpenAI TTS (#4171)
resolves #4165
2025-07-17 10:28:51 -07:00
timothycarambat
ff34c8cefc use documentsFolder path for simplification 2025-07-16 11:14:18 -07:00
timothycarambat
c535c69345 1.8.4 tag update 2025-07-16 10:40:39 -07:00
timothycarambat
a04b9c9d60 clear errors on submit for DB validations 2025-07-16 09:30:04 -07:00
Sean Hatfield
49ea545d7f
SQL preflight connection validation (#4150)
* wip sql connection string validation

* handle failed sql connections in frontend

* sql preflight connection validation on modal save

* revert unneeded be/fe changes

* linting, form updates

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-07-16 09:02:39 -07:00
Timothy Carambat
9bd77b0c2d
set max codeblock width to prevent overflows (#4157) 2025-07-15 15:59:45 -07:00
Sean Hatfield
b0407a6bf2
Migrate text size menu to embedded tooltip (#4147)
* migrate font size menu to embedded tooltip modal

* lint

* fix text size menu ui

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-07-15 15:29:30 -07:00
Sean Hatfield
fe1dfb1fde
Add option to enable encryption on MSSQL Server db (#4134)
* add option to enable encryption on mssql server dbs

* add tests for ConnectionStringParser
2025-07-15 15:26:38 -07:00
Sean Hatfield
5485c58b44
Sanitize youtube transcription file paths (#4148)
sanitize youtube transcription file paths
2025-07-14 13:53:34 -07:00
wannabe_
6111a1660f
docs(zh-cn): Update and improve Simplified Chinese translations (#4137) 2025-07-14 08:33:47 -07:00
Sean Hatfield
cc38edeb58
Sticky code block header (#4130)
sticky code block header

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-07-11 11:16:04 -07:00
Sean Hatfield
1cd0cc32b8
Fix chunking/snippet logs for clarity (#4129)
update chunking/snippet logs for clarity
2025-07-11 10:54:54 -07:00
Chek
3b00020577
docs(i18n): Complete missing Chinese translations (#4123)
* docs(zh-tw, zh-cn): Complete missing Traditional and Simplified Chinese translations

This commit aims to complete all previously 'null' Traditional Chinese and Simplified Chinese translation keys in the project.

**Traditional Chinese (zh-tw):**
- Completed all 'null' descriptions in `/frontend/src/locales/zh_TW/common.js`.

**Simplified Chinese (zh-cn):**
- Completed all 'null' descriptions in `/frontend/src/locales/zh/common.js`.

---

此提交旨在補齊專案中所有原為 'null' 的繁體中文和簡體中文翻譯鍵值。

**繁體中文翻譯 (Traditional Chinese - zh-tw):**
- 完善了 `/frontend/src/locales/zh_TW/common.js` 裡所有 'null' 的說明。

**簡體中文翻譯 (Simplified Chinese - zh-cn):**
- 完善了 `/frontend/src/locales/zh/common.js` 裡所有 'null' 的說明。

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-07-11 09:27:49 -07:00
Timothy Carambat
ea956f4d77
Add ability to search workspace and threads (#4120)
* Add ability to search workspace and threads

* fix height

* styling

* update placeholder

* Translations PR (#4122)
2025-07-10 16:42:10 -07:00
timothycarambat
ae2fa8805c resolves #4040 2025-07-10 13:20:39 -07:00
Sean Hatfield
49293e7dd7
Configurable message limit for embed chat widget (#4114)
* configurable message limit for embed widget

* remove console log

* make field optional + add fallback

* rework validation logic

* lint

* remove field specific guard, it cannot be lte 0 like all other fields

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-07-10 12:45:53 -07:00
Sean Hatfield
5d60047dc7
Handle BigInt in message response (#4110)
* wip handle bigints in message response

* extend bigint protoype to handle bigint stringification + add test

* unset unrelated file

* update tests, simplify implementation;

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-07-10 12:33:34 -07:00
Timothy Carambat
8001d9ddeb
update 1.8.3 tags for release (#4109)
* update 1.8.3 tags for release

* whoops, botched news
2025-07-09 12:17:56 -07:00
timothycarambat
58f8607094 update i18n key 2025-07-08 14:54:40 -07:00
timothycarambat
885b55fb88 force borders for desktop integration 2025-07-08 14:46:38 -07:00
timothycarambat
8ea3c71b5e Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-07-08 14:29:54 -07:00
timothycarambat
db2466e179 persistence of the GENERIC_OPENAI_STREAMING_DISABLED setting 2025-07-08 14:29:47 -07:00
Sean Hatfield
4c16e7f7ab
Fix score reporting for Milvus, Zilliz, and Pinecone vector databases (#4106)
* normalize milvus score reporting

* normalize pinecone score reporting

* normalize score reporting for zilliz
2025-07-08 13:47:11 -07:00
timothycarambat
2570b817a8 update README 2025-07-08 10:17:04 -07:00
timothycarambat
87ee164594 add Contributing guidelines 2025-07-08 10:16:36 -07:00