Amazon S3

Amazon S3

Beta
Beta release

This source is currently in beta. It works end to end, but you may still hit rough edges. Let us know if you do.

Let AI connect your sources for you

Skip the manual setup — run this in your project and the wizard auto-detects your databases and APIs and connects them to PostHog.

Learn more
PostHog Wizard hedgehog

Connect Amazon S3 to PostHog to sync your data into the PostHog data warehouse for analysis and modeling.

Import CSV, JSON Lines and Parquet files, and Delta Lake tables, from an S3 bucket. PostHog creates one table per folder, one per file at the top of the folder you choose, and one per Delta table. Every sync reads the files in full, so each table matches the bucket.

Configuration

OptionDescription
Bucket
Type: text
Required: True
Region
Type: text
Required: True
Folder (optional)
Type: text
Required: False

Leave it empty to import from the whole bucket.

File pattern (optional)
Type: text
Required: False

A glob matched against each file's path inside the folder, where * also matches across folders. Leave it empty to import every file.

Access key ID
Type: text
Required: True
Secret access key
Type: password
Required: True
File format
Type: select
Required: True
Do double quotes enclose CSV values?
Type: select
Required: True
Combine every file into one table?
Type: switch-group
Required: False

Turn this on when the folder holds files that share the same columns, such as a daily export. Delta tables still get a table each.

Linking Amazon S3 to PostHog

  1. Go to the Data pipeline page in PostHog
  2. Click New source and select Amazon S3
  3. Fill in the required configuration fields
  4. Click Next, select the tables you want to sync, and then press Import

Supported tables

The tables available from this source are discovered from your account when you connect it, so the exact list depends on your data. Once connected, you can pick which tables to sync from the sources tab.