merlyn/server/utils/agents
Sean Hatfield 0b18ac6577
Model context limit auto-detection for LM Studio and Ollama LLM Providers (#4468)
* auto model context limit detection for ollama llm provider

* auto model context limit detection for lmstudio llm provider

* Patch Ollama to function and sync context windows like Foundry

* normalize how model context windows are cached from endpoint service
todo: move this into global utility class with MODEL_MAP
eager load models on boot to pre-cache them
add performance model improvements into ollama agent as well as apply n_ctx

* remove debug log

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-10-02 11:54:19 -07:00
..
aibitat Model context limit auto-detection for LM Studio and Ollama LLM Providers (#4468) 2025-10-02 11:54:19 -07:00
defaults.js ModelContextProtocol (MCP) Full Compatibility (#3547) 2025-03-31 16:15:19 -05:00
ephemeral.js Fix typos (#3826) 2025-05-14 09:30:28 -07:00
imported-manifest.schema.json Dont overwrite content in input on paste 2024-09-23 11:07:56 -05:00
imported.js Agent flow builder (#3077) 2025-02-12 16:50:43 -08:00
index.js Microsoft Foundry Local LLM provider & agent provider (#4435) 2025-10-01 20:04:13 -07:00