llm_cost_tracker v0.14.0: per-tag LLM budgets and a batch of cost-accuracy fixes
llm_cost_tracker is a Rails engine that records what your app spends on LLM APIs - per call, per model, per tag - into your own database, with a mounted dashboard.
0.14.0 adds per-tag budgets: one limit applied to every distinct value of a tag, for as many tags as you declare.
config.budgets.per_tag = {
tenant_id: { monthly: 1000 },
user_id: { daily: 25, behavior: :block_requests }
}
Post a comment