* feat(dataconnectors): support confluence personal access token
* fix: change select option
* linting
change name on accesstype field
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* Add `querySelectorAll` capability to web-scraping block
* patches and fallbacks
* fix styles of text in web scraping block
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
* chore: rename Github to GitHub
Signed-off-by: Adam Setch <adam.setch@outlook.com>
* chore: rename Github to GitHub
Signed-off-by: Adam Setch <adam.setch@outlook.com>
* Undo some code changes for references
---------
Signed-off-by: Adam Setch <adam.setch@outlook.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* fix stop generation button ui
* keep action color theme and match rest of the UI
rescale button to be consistent with UI
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* feat: add support for voyage-3-large and voyage-code-3 embedding models
- Add voyage-3-large and voyage-code-3 to VoyageAiOptions dropdown
- Update getMaxEmbeddingLength to support 32k context for new models
- Update .env.example with new model options
* unset env example
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* Reranker WIP
* add cacheing and singleton loading
* Add field to workspaces for vectorSearchMode
Add UI for lancedb to change mode
update all search endpoints to pass in reranker prop if provider can use it
* update hint text
* When reranking, swap score to rerank score
* update optchain
* Add support for Google Generative AI (Gemini) embedder
* Add missing example in docker
Fix UI key elements in options
Add Gemini to data handling section
Patch issues with chunk handling during embedding
* remove dupe in env
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* fix light mode table colors
* fix table styles from being overwritten in other sections that are not chat messages
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* Add support for gemini authenticated models endpoint
add customModels entry
add un-authed fallback to default listing
separate models by expiermental status
resolves#2866
* add back improved logic for apiVersion decision making
* wip remove all docs clear vector db on embedder/vector db change
* purge all cached docs and remove docs from workspaces on vectordb/embedder change
* lint
* remove unneeded console log
* remove reset vector stores endpoint and move to server side updateENV with postUpdate check
* reset embed module
* remove unused import
* simplify deletion process
rescoped document deletion to be more general for speed, everything needs to be reset anyway
fixed issue where unembedded docs not in any workspaces, but cached, were not removed
* add back missing readme file
update warning text modals
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* redirect to default thread on thread deletion
* reset submodule
* handle redirect on bulk delete thread
* redirect on bulk thread delete only if deleted thread is selected
* redirect only on single delete of active thread
* lint
* patch threadSlug for clarity
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* add empty states to your account hub page + disconnect button for api key
* lint
* lint
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* wip hub connection page fe + backend
* lint
* implement backend for local hub items + placeholder endpoints to fetch hub app data
* fix hebrew translations
* revamp community integration flow
* change sidebar
* Auto import if id in URL param
remove preview in card screen and instead go to import flow
* get user's items + team items from hub + ui improvements to hub settings
* lint
* fix merge conflict
* refresh hook for community items
* add fallback for user items
* Disable bundle items by default on all instances
* remove translations (will complete later)
* loading skeleton
* Make community hub endpoints admin only
show visibility on items
combine import/apply for items to they are event logged for review
* improve middleware and import flow
* community hub ui updates
* Adjust importing process
* community hub to dev
* Add webscraper preload into imported plugins
* add runtime property to plugins
* Fix button status on imported skill change
show alert on skill change
Update markdown type and theme on import of agent skill
* update documentaion paths
* remove unused import
* linting
* review loading state
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* exposes `maxConcurrentChunks` parameter for the generic openai embedder through configuration. This allows setting a batch size for endpoints which don't support the default of 500
* Update new field to new UI
make getting to ensure proper type and format
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* initial work - undo works except typed keys
* working but clunky code
* single letter and paste with no selection working
* add comments and keep the previous selection
* optimizations + add redo feature
* linting
---------
Co-authored-by: Mr Simon C <iamontheinternet@yahoo.com>
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
* feat: add new model provider: Novita AI
* feat: finished novita AI
* fix: code lint
* remove unneeded logging
* add back log for novita stream not self closing
* Clarify ENV vars for LLM/embedder seperation for future
Patch ENV check for workspace/agent provider
---------
Co-authored-by: Jason <ggbbddjm@gmail.com>
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
* Update OpenAI TTS config to allow a custom BaseURL
* uncheck config file
* break openai generic TTS into its own provider
* add space
* hide TTS on user msg
---------
Co-authored-by: Adam <phazei@gmail.com>
* support generic openai workspace model
* Update UI for free form input for some providers
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* set message limit per user
* remove old limit user messages + unused admin page
* fix daily message validation
* refactor message limit input
refactor canSendChat on user to a method on user model
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* Added an option to fetch issues from gitlab. Made the file fetching asynchornous to improve performance. #2334
* Fixed a typo in loadGitlabRepo.
* Convert issues to markdown.
* Fixed an issue with time estimate field names in issueToMarkdown.
* handle rate limits more gracefully + update checkbox to toggle switch
* lint
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
* support more confluence url formats
* use pattern matching for confluence urls and manual splitting as fallback
* rework entire Confluence flow to prevent issues with custom, local, and cloud spaces
* remove dep
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* implement appearance setting for show/hide scrollbar
* put back comments
* revert backend for show_scrollbar
* show scrollbar save to localstorage
* old model function
* lint
* edit
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* Issue #1943: Add support for LLM provider - Fireworks AI
* Update UI selection boxes
Update base AI keys for future embedder support if needed
Add agent capabilites for FireworksAI
* class only return
---------
Co-authored-by: Aaron Van Doren <vandoren96+1@gmail.com>
* Add ability to use Esc keypress to close modal for documents
* move escape close to hook
---------
Co-authored-by: Mr Simon C <iamontheinternet@yahoo.com>
* initial commit for chrome extension
* wip browser extension backend
* wip frontend browser extension settings
* fix typo for browserExtension route
* implement verification codes + frontend panel for browser extension keys
* reorganize + state management for all connection states
* implement embed to workspace
* add send page to anythingllm extension option + refactor
* refactor connection string auth + update context menus + organize background.js into models
* popup extension from main app and save if successful
* fix hebrew translation misspelling
* fetch custom logo inside chrome extension
* delete api keys on disconnect of extension
* use correct apiUrl constant in frontend + remove unneeded comments
* remove upload-link endpoint and send inner text html to raw text collector endpoint
* update readme
* fix readme link
* fix readme typo
* update readme
* handle deletion of browser keys with key id and DELETE endpoint
* move event string to constant
* remove tablename and writable fields from BrowserExtensionApiKey backend model
* add border-none to all buttons and inputs for desktop compatibility
* patch prisma injections
* update delete endpoints to delete keys by id
* remove unused prop
* add button to attempt browser extension connection + remove max active keys
* wip multi user mode support
* multi user mode support
* clean up backend + show created by in frotend browser extension page
* show multi user warning message on key creation + hide context menus when no workspaces
* show browser extension options to managers
* small backend changes and refactors
* extension cleanup
* rename submodule
* extension updates & docs
* dev docker build
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
Allows for the reflowing of text and not breaking the parent box due of display flex container. Does not change any pre-existing classes only specifies further that it should stay inside.
* Added ctrl + enter hotkeys to init speach to text
* Ran linter
* Fixed speech transcript from being submitted twice when the user clicks the send button. Updated speech hotkeys.
* Added pulse animation to mic
* Fixed prompt double-send when clicking the send button or ending the TTS session.
* Fixed comment grammar
* Update mic hotkeys
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* force lowercase and no space for new and
edit user modals
* edit account modal validations
* use pattern for form validation + remove validations from edit user
* revert comment deletions
* comment fix
* update validation message
* update regex
allow updating by block name changes to invalid names
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* Revert "Patch ODBC support from missing binary/headers for node-odbc"
This reverts commit 9de6b1cc26.
* Revert "OBDC Support (#1933)"
This reverts commit cd597a361e.
* add possibility to connect to SQL Base by ODBC
---------
Co-authored-by: suchaudn <nicolas.suchaud@legrand.fr>
Co-authored-by: nicho2 <nicho2@laposte.net>
* Add support for GitLab repo collection as well as Github Repo collection
* Refactor for repo collectors to be more compact
---------
Co-authored-by: Emil Rofors <emirof@gmail.com>
* bump base image
* Bump mysql
* attestations
* attestations perms
* attestations perms
* fix permissions for attestetions for master push
* test cleanup
* repin base image
* revert base
* patch frontend-clean
* force resolve braces to fixed version
* rebump
* give generic error messages for embed chat widget
* give generic errors on embed chat errors but log to console
* lint
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* fix indentation of citations
* fix outlines of input fields to be consistent
* remove red from trash icons
* fix margin from input title
* remove unused component and remove borders on provider search inputs
* make back arrow less opacity in onboarding to highlight next arrow
* fix spacing on all provider options (llm, vectordb, embedder
* patch llm providers that have manual inputs for model pref
* refactor agent model fallback
update UI to show disabled providers to stop questions about provider limitations
* patch log on startup
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* implement new settings sidebar v2
* store state of settings menu in localstorage to improve ux
* add tailwind color
* add missed admin translation
* fix admin pages showing on single user
* perms fix for manager role
* refactor permissions for options on sidebar
* minor refactor of menuoption
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* implement new chat tools ui + bump phosphor icons package for new icons
* move TTS button below user image/fix styling
* Show tools on hover
update package deps
* patch styles for desktop
* fix more actions tooltip and disable hide/show on hover for mobile
* z-index on mobile patch
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* implement delete message feature
* add new delete chat endpoint that just hides messages from ui and fix perms
* refactor: add delete-event hooks for delete so we dont need to pass so much
refactor: implmentation of delete endpoint PUT
* update animation
linting
remove element on animiation to prevent popin
* linting and cleanup imports
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* implement thread forking feature
* rename thread based on forked message
* refactor bulk message create for thread fork + bump prisma version
* revert prisma version bump
* add todo to bulkCreate function in workspace chats
* cast user input to expected type to prevent prisma injection
* refactor: update order of ops for thread fork
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
* add ollama automatic url detection in llm and embedder prefrences
* implement auto detection for lmstudio llm and embedder/improve performance of checking common urls
* fix modal not clearing
* fix lmstudio url check
* improve ux for ollama llm provider option
* improve ux for lm studio llm provider option
* improve ux for ollama embedder option
* improve ux for lmstudio embedder option
* ux improvement lmstudio embedder options
* refactor implementation to hook and use native timeout
Swap to promise.any for resolving of available endpoints
* implement useProviderEndpointAutoDiscovery hook for lmstudio and ollama provider options
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* wip bg workers for live document sync
* Add ability to re-embed specific documents across many workspaces via background queue
bgworkser is gated behind expieremental system setting flag that needs to be explictly enabled
UI for watching/unwatching docments that are embedded.
TODO: UI to easily manage all bg tasks and see run results
TODO: UI to enable this feature and background endpoints to manage it
* create frontend views and paths
Move elements to correct experimental scope
* update migration to delete runs on removal of watched document
* Add watch support to YouTube transcripts (#1716)
* Add watch support to YouTube transcripts
refactor how sync is done for supported types
* Watch specific files in Confluence space (#1718)
Add failure-prune check for runs
* create tmp workflow modifications for beta image
* create tmp workflow modifications for beta image
* create tmp workflow modifications for beta image
* dual build
update copy of alert modals
* update job interval
* Add support for live-sync of Github files
* update copy for document sync feature
* hide Experimental features from UI
* update docs links
* [FEAT] Implement new settings menu for experimental features (#1735)
* implement new settings menu for experimental features
* remove unused context save bar
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* dont run job on boot
* unset workflow changes
* Add persistent encryption service
Relay key to collector so persistent encryption can be used
Encrypt any private data in chunkSources used for replay during resync jobs
* update jsDOC
* Linting and organization
* update modal copy for feature
---------
Co-authored-by: Sean Hatfield <seanhatfield5@gmail.com>
* ru language added
* uncheck bad changes
Use chatGPT to create new dictionary for RU translation
turn off debug mode in produ for i18n
patch issue with null comparison in verifyTranslation.js
---------
Co-authored-by: UUSR <konstantik@gmail.com>
* rework document picker ui
* refactor tooltips to use react-tooltip lib with custom elements
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* implement mobile styles for new agent settings ui
* fix on off label not updating for generate & save files to browser
* update sql connector modal for mobile
* small changes for UI normalization
* breakout layout from forms for mobile/desktop
* add back no-borders
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
