Linking CircleCI Insights as a source

Let AI connect your sources for you

Skip the manual setup — run this in your project and the wizard auto-detects your databases and APIs and connects them to PostHog.

Learn more

Alpha release

This source is currently in alpha. The interface and available tables may change.

The CircleCI Insights connector syncs workflow metrics, workflow runs, job metrics, and more into the PostHog data warehouse, so you can analyze them alongside your product data.

Prerequisites

Credentials that can read the data you want to sync. PostHog only reads data, so read access is enough.

Adding a data source

In PostHog, go to the Sources tab of the data pipeline section.
Click + New source and click Link next to this source.
Enter your credentials (see Configuration below) and click Next.
Select the tables you want to sync, choose a sync method and frequency, then click Import.

Once the syncs are complete, you can start querying this data in PostHog.

Enter your CircleCI personal API token and project slugs to pull pipeline health metrics - workflow and job durations, success rates, credit usage, recent runs, and flaky tests - from the CircleCI Insights API.

You can create a personal API token in your CircleCI user settings. Note that CircleCI retains Insights data for roughly 90 days.

You'll be asked for:

Personal API token
Project slugs: comma-separated project slugs in vcs/org/repo format, e.g. gh/your-org/your-repo. You can find a project's slug in its URL on CircleCI.

Sync modes

Each table can be synced in one of several modes, depending on what the source supports:

Webhook (when available) – the source pushes changes to PostHog in real time. Fastest freshness, lowest ongoing cost, and the only mode that reliably captures updates and deletes.
Incremental – only new or updated rows are synced on each run, using a cursor field (such as an updated_at timestamp). Cheaper than a full refresh, but deletes aren't captured.
Append only – new rows are appended using a cursor field; existing rows are never updated. Ideal for immutable, append-only tables like event logs.
Full refresh – the whole table is reloaded on every sync. Use it when a table has no reliable cursor or when you need deletions reflected.

See sync methods for a full explanation of how each mode works and how to choose between them.

All CircleCI Insights tables are full refresh. Each sync replaces the contents of the table.

Configuration

Option	Description
`Personal API token` Type: password Required: True
`Project slugs` Type: text Required: True	Comma-separated project slugs in `vcs/org/repo` format, e.g. `gh/your-org/your-repo`. You can find a project's slug in its URL on CircleCI.
`Reporting window for aggregated metrics` Type: select Required: False
`Branch scope` Type: select Required: False

Supported tables

Table	Description	Sync method	Incremental field	Primary key
`workflow_metrics`	Aggregated metrics for each workflow in a project over the configured reporting window: run counts, success rate, duration percentiles, credits consumed, MTTR, and throughput.	Full refresh	—	project_slug, name
`workflow_summary`	Summary metrics for each workflow in a project, with the trend for each metric against the previous window. Complements workflow_metrics, which carries the raw aggregates without trends.	Full refresh	—	project_slug, workflow_name
`workflow_runs`	Individual recent runs of each workflow, with duration, status, branch, and credits consumed. CircleCI retains run-level Insights data for roughly 90 days.	Incremental, Full refresh	created_at	id
`job_metrics`	Aggregated metrics for each job of each workflow in a project over the configured reporting window: run counts, success rate, duration percentiles, credits consumed, and throughput.	Full refresh	—	project_slug, workflow_name, name
`job_timeseries`	Daily timeseries of metrics for each job in a workflow, giving point-in-time job trends rather than a single window aggregate. Daily buckets are retained for roughly 90 days. The endpoint has no all-branches option, so these rows cover the project's default branch even when the source is set to all branches.	Incremental, Full refresh	timestamp	project_slug, workflow_name, name, timestamp
`flaky_tests`	Tests CircleCI has detected as flaky in a project: tests that pass and fail across runs with no code change, with where they flake and how often.	Full refresh	—	project_slug, workflow_name, job_name, classname, test_name
`workflow_test_metrics`	Per-test duration and failure metrics for a workflow, covering the tests CircleCI reports as most failed and slowest. Calculated from the workflow's 10 most recent runs, so this is a snapshot rather than a history.	Full refresh	—	project_slug, workflow_name, job_name, classname, test_name
`branches`	The branches Insights holds data for in a project, as a dimension for slicing the other Insights tables by branch. The API returns at most 5,000 branches per project.	Full refresh	—	project_slug, branch
`org_summary_metrics`	Per-project summary metrics and trends across an organization over the configured reporting window, from the org-level Insights summary. Requires the token to have org membership.	Full refresh	—	org_slug, project_name

Troubleshooting

If the connection fails with an authorization error, the personal API token is wrong, expired, or has been revoked. Create a new one, then reconnect the source.
If a table syncs no rows, the credential may not have access to that data. Check its permissions, then reconnect the source.

If your sync is failing or data looks wrong, see the Data warehouse troubleshooting guide. If that doesn't help, contact support – we're happy to help.