michael/merlyn
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Patch 2: Increase context limit fallback via AGENT_CONTEXT_WINDOW_FALLBACK env var

Browse Source 
Default fallback increased from 8,000 to 2,000,000 tokens.
When provider doesn't declare promptWindowLimit (e.g. Grok via OpenRouter),
the fallback was far too small causing severe truncation.
Configure via AGENT_CONTEXT_WINDOW_FALLBACK in .env to override.
This commit is contained in:
PQ32 Developer 2026-05-10 15:10:11 -07:00
parent a4d14e12b8
commit ea9187472f
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
server/utils/agents/aibitat/providers/ai-provider.js
View File

@ -420,7 +420,7 @@ class Provider {
*/
static contextLimit(provider = "openai", modelName) {
const llm = getLLMProviderClass({ provider });
if (!llm || !llm.hasOwnProperty("promptWindowLimit")) return 8_000;
if (!llm || !llm.hasOwnProperty("promptWindowLimit")) return Number(process.env.AGENT_CONTEXT_WINDOW_FALLBACK) || 2_000_000;
return llm.promptWindowLimit(modelName);
}