Anthropic LLM analytics installation

Setting up analytics starts with installing the PostHog SDK for your language. LLM analytics works best with our Python and Node SDKs.

pip install posthog

Install the Anthropic SDK:

pip install anthropic

Initialize PostHog with your project API key and host from your project settings, then pass it to our Anthropic wrapper.

from posthog.ai.anthropic import Anthropic
from posthog import Posthog

posthog = Posthog(
    "<ph_project_api_key>",
    host="https://us.i.posthog.com"
)

client = Anthropic(
    api_key="sk-ant-api...", # Replace with your Anthropic API key
    posthog_client=posthog # This is an optional parameter. If it is not provided, a default client will be used.
)

Note: This also works with the AsyncAnthropic client as well as AnthropicBedrock, AnthropicVertex, and the async versions of those.

Now, when you use the Anthropic SDK to call LLMs, PostHog automatically captures an $ai_generation event.

You can enrich the event with additional data such as the trace ID, distinct ID, custom properties, groups, and privacy mode options.

response = client.messages.create(
    model="claude-3-opus-20240229",
    messages=[
        {
            "role": "user",
            "content": "Tell me a fun fact about hedgehogs"
        }
    ],
    posthog_distinct_id="user_123", # optional
    posthog_trace_id="trace_123", # optional
    posthog_properties={"conversation_id": "abc123", "paid": True}, # optional
    posthog_groups={"company": "company_id_in_your_db"},  # optional 
    posthog_privacy_mode=False # optional
)

print(response.content[0].text)

Notes:

• This also works when message streams are used (e.g. stream=True or client.messages.stream(...)).
• If you want to capture LLM events anonymously, don't pass a distinct ID to the request. See our docs on anonymous vs identified events to learn more.

You can expect captured $ai_generation events to have the following properties:

Let's make sure LLM events are being captured and sent to PostHog. Under LLM analytics, you should see rows of data appear in the Traces and Generations tabs.