Metrics

​

Metrics

Metrics can be broken down by user, model, latency, status, etc. and filtered within a specific time period. The primary metrics we track are:

• Cost: Discover how expensive your LLM’s are for your business.
• Latency: Accurately measure how quick your LLM requests respond.
• Tokens: Count tokens used on input, output, and total.
• Models: View the breakdown of your model usage
• Users: Visualize how many users are active on your application

​

User Metrics

User metrics are a way to easily track and analyze user behavior in your prompts.