"llm_cost_tracker offers a privacy-first approach by not storing prompts or responses, allowing teams to track LLM API costs without compromising user data."
"The gem includes automatic instrumentation for official OpenAI and Anthropic SDKs, as well as support for Faraday middleware, enhancing compatibility with various clients."
"Version 0.5.3 significantly improves streaming support, ensuring that official SDK streaming works reliably, which is crucial for real-time applications."
"With flexible tagging options and simple budget guardrails, llm_cost_tracker allows developers to manage costs effectively by breaking down usage by user, tenant, or feature."
llm_cost_tracker is a lightweight gem designed for Ruby and Rails applications to track LLM API costs. It stores cost data in the user's database, ensuring privacy by not storing prompts or responses. The gem supports automatic instrumentation for official OpenAI and Anthropic SDKs, along with Faraday middleware for various clients. Version 0.5.3 includes improved streaming support and flexible tagging options. It also features simple budget guardrails and a minimalist dashboard. Feedback from the Ruby community is encouraged as the gem is still in early-stage development.
Read at Rubyflow
Unable to calculate read time
Collection
[
|
...
]