Linking Clarifai as a source
Let AI connect your sources for you
Skip the manual setup — run this in your project and the wizard auto-detects your databases and APIs and connects them to PostHog.
This source is currently in alpha. The interface and available tables may change.
The Clarifai connector syncs your models, workflows, datasets, and concepts into the PostHog data warehouse, so you can analyze your AI/ML infrastructure alongside your product data.
Prerequisites
- A Clarifai account with at least one app
- A personal access token (PAT) with read access to the resources you want to sync
Adding a data source
- In PostHog, go to the Sources tab of the data pipeline section.
- Click + New source and click Link next to this source.
- Enter your credentials (see Configuration below) and click Next.
- Select the tables you want to sync, choose a sync method and frequency, then click Import.
Once the syncs are complete, you can start querying this data in PostHog.
Create a personal access token in Clarifai under Settings > Secrets. Grant read access for models, workflows, datasets, and concepts. Allow the ListModels, ListWorkflows, ListDatasets, and ListConcepts endpoints. Enter the user ID and app ID of the app owner.
You'll be asked for:
- Personal access token - your Clarifai PAT with read access to the resources you want to sync
- User ID - the user ID of the app owner (e.g.,
example-user) - App ID - the app ID for the data you want to sync (e.g.,
example-app) - API host (optional) - custom API host if you're using a private Clarifai installation. Defaults to
https://api.clarifai.com
Sync modes
Each table can be synced in one of several modes, depending on what the source supports:
- Webhook (when available) – the source pushes changes to PostHog in real time. Fastest freshness, lowest ongoing cost, and the only mode that reliably captures updates and deletes.
- Incremental – only new or updated rows are synced on each run, using a cursor field (such as an
updated_attimestamp). Cheaper than a full refresh, but deletes aren't captured. - Append only – new rows are appended using a cursor field; existing rows are never updated. Ideal for immutable, append-only tables like event logs.
- Full refresh – the whole table is reloaded on every sync. Use it when a table has no reliable cursor or when you need deletions reflected.
See sync methods for a full explanation of how each mode works and how to choose between them.
All Clarifai tables are full refresh. Each sync replaces the contents of the table. This is because Clarifai's list endpoints don't provide a way to filter by modification time.
Configuration
| Option | Type | Required |
|---|---|---|
Personal access token | password | Yes |
User ID | text | Yes |
App ID | text | Yes |
API host | text | No |
Supported tables
| Table | Description | Sync method | Incremental field | Primary key |
|---|---|---|---|---|
models | Models in the selected Clarifai app, including details of their latest versions. | Full refresh | — | — |
workflows | Workflows that connect models in the selected Clarifai app. | Full refresh | — | — |
datasets | Datasets that organize inputs in the selected Clarifai app. | Full refresh | — | — |
concepts | Concept labels in the selected Clarifai app. | Full refresh | — | — |
- models - Models in the selected Clarifai app, including details of their latest versions.
- workflows - Workflows that connect models in the selected Clarifai app.
- datasets - Datasets that organize inputs in the selected Clarifai app.
- concepts - Concept labels in the selected Clarifai app.
Troubleshooting
- If the connection fails with an authentication error, the personal access token is invalid or expired. Create a new one under Settings > Secrets in Clarifai, then reconnect the source.
- If the connection fails with a permission error, the token doesn't have read access to the selected resource. Update the token's permissions to include the required list endpoint.
- If the connection fails with a resource not found error, check that the user ID and app ID are correct and match an existing app.
- If you're using a custom API host, ensure it's a valid HTTPS URL without any path, query parameters, or credentials.
If your sync is failing or data looks wrong, see the Data warehouse troubleshooting guide. If that doesn't help, contact support – we're happy to help.