Linking Prefect Cloud as a source

Let AI connect your sources for you

Skip the manual setup — run this in your project and the wizard auto-detects your databases and APIs and connects them to PostHog.

Learn more

Alpha release

This source is currently in alpha. The interface and available tables may change.

The Prefect Cloud connector syncs flows, flow runs, task runs, and more into the PostHog data warehouse, so you can analyze them alongside your product data.

Prerequisites

Credentials that can read the data you want to sync. PostHog only reads data, so read access is enough.

Adding a data source

In PostHog, go to the Sources tab of the data pipeline section.
Click + New source and click Link next to this source.
Enter your credentials (see Configuration below) and click Next.
Select the tables you want to sync, choose a sync method and frequency, then click Import.

Once the syncs are complete, you can start querying this data in PostHog.

Enter your Prefect Cloud account ID, workspace ID, and an API key to pull your flow and task run history.

Both IDs are in your workspace URL: https://app.prefect.cloud/account/<account ID>/workspace/<workspace ID>.

Create an API key under API keys in your profile settings, or use a service account key on paid tiers. The key inherits the owner's permissions, so read access to the workspace is all it needs.

You'll be asked for:

Account ID: for example 00000000-0000-0000-0000-000000000000.
Workspace ID: for example 00000000-0000-0000-0000-000000000000.
API key: for example pnu_....

Sync modes

Each table can be synced in one of several modes, depending on what the source supports:

Webhook (when available) – the source pushes changes to PostHog in real time. Fastest freshness, lowest ongoing cost, and the only mode that reliably captures updates and deletes.
Incremental – only new or updated rows are synced on each run, using a cursor field (such as an updated_at timestamp). Cheaper than a full refresh, but deletes aren't captured.
Append only – new rows are appended using a cursor field; existing rows are never updated. Ideal for immutable, append-only tables like event logs.
Full refresh – the whole table is reloaded on every sync. Use it when a table has no reliable cursor or when you need deletions reflected.

See sync methods for a full explanation of how each mode works and how to choose between them.

All Prefect Cloud tables are full refresh. Each sync replaces the contents of the table.

Configuration

Option	Type	Required
`Account ID`	text	Yes
`Workspace ID`	text	Yes
`API key`	password	Yes

Supported tables

Table	Description	Sync method	Incremental field	Primary key
`flows`	A flow is a Prefect workflow definition — the top-level container that flow runs are instances of.	Full refresh	—	—
`flow_runs`	Incremental syncs re-read a 24-hour trailing window so recently started runs pick up state changes; runs that change state later than that are only refreshed by a full refresh	Incremental, Full refresh	start_time, expected_start_time	—
`task_runs`	Incremental syncs re-read a 24-hour trailing window so recently started runs pick up state changes; runs that change state later than that are only refreshed by a full refresh	Incremental, Full refresh	expected_start_time	—
`deployments`	A deployment is a server-side representation of a flow that can be scheduled and triggered remotely, with its schedule, work pool, and parameters.	Full refresh	—	—
`work_pools`	A work pool organizes and distributes flow runs to workers of a given infrastructure type.	Full refresh	—	—
`work_queues`	A work queue within a work pool that prioritizes and delivers flow runs to workers.	Full refresh	—	—

Troubleshooting

If the connection fails with an authorization error, the API key is wrong, expired, or has been revoked. Create a new one, then reconnect the source.
If a table syncs no rows, the credential may not have access to that data. Check its permissions, then reconnect the source.

If your sync is failing or data looks wrong, see the Data warehouse troubleshooting guide. If that doesn't help, contact support – we're happy to help.