llm_optimizer 0.1.1
llm_optimizer reduces LLM API costs by up to 80% through semantic caching, intelligent model routing, token pruning, and conversation history summarization. Strictly opt-in and non-invasive.
llm_optimizer reduces LLM API costs by up to 80% through semantic caching, intelligent model routing, token pruning, and conversation history summarization. Strictly opt-in and non-invasive.