Capture LLM conversations
LLM analytics gives you x-ray vision into your LLM applications. You can track:
- 🗣️ Every conversation (inputs, outputs, and tokens)
- 🤖 Model performance (cost, latency and error rates)
- 🔍 Full traces for when you need to go detective mode
- 💰 How much each chat/user/organization is costing you
The first step is to install a PostHog SDK to capture conversations, requests, and responses from an LLM provider.
Platforms
Track AI generations
Once you've installed the SDK, every LLM call automatically becomes a generation – a detailed record of what went in and what came out. Each generation captures:
- Complete conversation context (inputs and outputs)
- Token counts and usage metrics
- Response latency and performance data
- Automatic cost calculation based on model pricing
- Trace IDs to group related LLM calls together
PostHog's SDK wrappers handle all the heavy lifting. Use your LLM provider as normal and we'll capture everything automatically.
Evaluate model usage
PostHog's LLM analytics dashboard provides a comprehensive overview of your LLM performance. Break usage metrics down by model, latency, cost, and more.
Integrate customer data
Take advantage of PostHog's platform to integrate your customer data with LLM analytics.
Product analytics
All LLM analytics are captured as standard PostHog events, which means you can create dashboards, trends, funnels, custom SQL queries, alerts, and more.
Error tracking
LLM generated errors are automatically captured in PostHog's error tracking for you to monitor, debug, and resolve.
Session replay
Watch session replays to see exactly how users interact with your LLM features.
Use for free
PostHog LLM analytics is designed to be cost-effective with a generous free tier and transparent usage-based pricing. Since we don't charge per seat, more than 90% of companies use PostHog for free.
TL;DR 💸
- No credit card required to start
- First 100K LLM events per month are free with 30-day retention
- Above 100k we have usage-based pricing starting at $0.00006/event with discounts as volume increases
- Set billing limits to avoid surprise charges
- See our pricing page for more up-to-date details
That's it! You're ready to start integrating.