2 Commits

Author	SHA1	Message	Date
Timothy Carambat	d1ca16f7f8	Add tokenizer improvments via Singleton class and estimation (#3072) ... * Add tokenizer improvments via Singleton class linting * dev build * Estimation fallback when string exceeds a fixed byte size * Add notice to tiktoken on backend	2025-01-30 17:55:03 -08:00
Sean Hatfield	b658f5012d	Support XLSX files (#2403) ... * support xlsx files * lint * create seperate docs for each xlsx sheet * lint * use node-xlsx pkg for parsing xslx files * lint * update error handling --------- Co-authored-by: timothycarambat <rambat1010@gmail.com>	2024-10-03 13:45:23 -07:00