In-depth: PostHog vs Optimizely

Nov 07, 2023

PostHog and Optimizely are both multi-product tools to help you improve your apps and websites. Beyond experimentation and feature flags, they have significantly different focuses:

  • PostHog helps you build better product with tools like product analytics, session replay, and surveys.

  • Optimizely is an all-in-one system for marketing that includes content management, campaign planning, asset management, and checkout customizations.

This post compares their platforms, experimentation features, reporting, pricing, and more.

How is PostHog different than Optimizely?

1. Product and startup-focused

PostHog is built for high-growth startups working to build the best possible products. It's easy to get started and provides all the tools you need at an early stage. There's a generous free plan and startups get free credits.

Optimizely focuses on providing marketing, ecommerce, and content tools to massive enterprises. It has fewer product focused tools.

2. Transparent, free, and self-service

PostHog is open source. Everything from our code to roadmap to strategy is open for everyone to see.

Along with this, you can sign up for PostHog for free. You don’t need to fill out a contact form, add a credit card, or have a sales call. You can use PostHog for free forever if you want.

Optimizely is open about some areas, like roadmap and its SDKs, but you have to talk to sales before signing up.

3. Analytics and reporting built-in

PostHog links all its tools together. This means you get all the features and visualizations of product analytics for your feature flags and A/B tests. You can use them in trends, funnels, and even directly query related metrics with SQL.

Optimizely has some analytics, such as web marketing, but largely relies on Google Analytics for tracking and reporting. This limits the analysis you can do related to your feature flags and experiments.

Platform

Although both Optimizely and PostHog provide experimentation and feature flags, their overall platforms are significantly different.

PostHogOptimizely

Open source

Optimizely has open-source SDKs

Self-service

Start without talking to sales

Experiments

Run A/B tests

Feature flags

Manage and rollout features remotely

Product analytics

Native feature tracking

Web analytics

Get web stats like traffic

Session replay

Play back real user sessions

Surveys

Ask users questions and track responses

CMS

Manage content

Cart optimization

Optimize ecommerce checkouts

Project management

Manage projects related to experiments


Ready to find out more?


  • The big platform difference between the two beyond marketing vs product features is analytics. Optimizely relies on external analytics providers like Google and Adobe Analytics to track feature flags and A/B tests. PostHog has a full analytics suite built-in, including autocapture, custom events, direct SQL access, and more.

  • Being a marketing-focused platform, Optimizely includes project and content management tools like request forms, asset libraries, and hypothesis briefs. PostHog leaves the planning to the other tools you are using but does include notebooks for analysis.

Web experimentation

Optimizely splits its experimentation features into two separate categories, web and feature. We will compare both separately against PostHog.

The core web experimentation features like traffic allocation, preview mode, cross-browser, dynamic website support, targeting, and more are available in both Optimizely and PostHog

PostHogOptimizely

A/B/n tests

Do tests with multiple variants

Custom targeting

Target users with custom attributes

Custom goals

Set experiment goals to any metric

Single-page app support

Use app frameworks like React and Vue

No-code experiments

Implement experiments without code

Low-code experiments

Implement experiments with a small amount of code

Funnel tests

Use funnels as a goal

Native analytics

Track experiments without third-party tools

Scheduling

Schedule experiments to run at specific times

Use external data

Use data from other platforms in experiments

  • In Optimizely, many features of web experiments, like scheduling, multi-armed bandits, multi-variate testing, and advanced personalization are only available on the higher-tier "Accelerate" plan or as add-ons.

  • PostHog doesn't offer a no-code experiment creator yet, but it does have a UI to create and manage experiments as well as snippets to make it easy to implement them. For example, you can add a basic experiment anywhere you can insert custom JavaScript like this:

HTML
<script>
!function(t,e){var o,n,p,r;e.__SV||(window.posthog=e,e._i=[],e.init=function(i,s,a){function g(t,e){var o=e.split(".");2==o.length&&(t=t[o[0]],e=o[1]),t[e]=function(){t.push([e].concat(Array.prototype.slice.call(arguments,0)))}}(p=t.createElement("script")).type="text/javascript",p.crossOrigin="anonymous",p.async=!0,p.src=s.api_host+"/static/array.js",(r=t.getElementsByTagName("script")[0]).parentNode.insertBefore(p,r);var u=e;for(void 0!==a?u=e[a]=[]:a="posthog",u.people=u.people||[],u.toString=function(t){var e="posthog";return"posthog"!==a&&(e+="."+a),t||(e+=" (stub)"),e},u.people.toString=function(){return u.toString(1)+".people (stub)"},o="capture identify alias people.set people.set_once set_config register register_once unregister opt_out_capturing has_opted_out_capturing opt_in_capturing reset isFeatureEnabled onFeatureFlags getFeatureFlag getFeatureFlagPayload reloadFeatureFlags group updateEarlyAccessFeatureEnrollment getEarlyAccessFeatures getActiveMatchingSurveys getSurveys getNextSurveyStep".split(" "),n=0;n<o.length;n++)g(u,o[n]);e._i.push([i,s,a])},e.__SV=1)}(document,window.posthog||[]);
posthog.init('<ph_project_api_key>',{api_host:'https://us.i.posthog.com', person_profiles: 'identified_only'})
posthog.onFeatureFlags(() => {
// Check the value of the 'test-flag' feature flag
if (posthog.getFeatureFlag('test-flag') === 'test') {
// If the feature flag is enabled, change the text of the landing-header
const landingHeader = document.getElementById('landing-header');
if (landingHeader) {
landingHeader.textContent = "Welcome to our site!";
}
}
});
</script>

Feature experimentation

Feature experimentation relates to releasing and testing feature changes in your product. Both Optimizely and PostHog have all the core features to do this safely and effectively.

PostHogOptimizely

Flags

Use and evaluate feature flags

Rollouts

Control rollout of features remotely

User targeting

Target specific users

Logging

Log flag usage

Audience builder

Known as cohorts in PostHog

Custom attributes

Known as properties in PostHog

UI controls

Configure experiments with UI

Stats engine

Calculate the statistical significance of experiments

Remote configuration

Configure your experiments without changing code

Environments

Manage flags for dev, staging, prod

Partial

In Optimizely, many of the feature experimentation features, like multi-armed bandits and custom segmentation, are only available are the higher tier plans. These are all available for free in PostHog.

Pricing

PostHog and Optimizely are very different here. Optimizely is sales-driven and completely opaque. PostHog is self-serve and transparent.

PostHogOptimizely

Transparent

See pricing without talking to sales

Usage-based

Pay based on how much you use

Free tier

Use for free forever

Per-product pricing

Separate pricing for each product

For many Optimizely products, there are also paid add-ons like advanced personalization, the data platform, and their Salesforce integration. PostHog only has free and paid tiers for each product with a single addition enterprise add-on for SSO, dedicated support, and advanced permissions.


Ready to find out more?


Reporting

Although Optimizely has web analytics through its content marketing platform, it relies on Google Analytics or other third-party analytics providers for advanced tracking and reporting.

PostHog’s product analytics suite shines here. It treats feature flags and experiments as usage, so you can analyze them like any other user behavior. On top of standard experiment results, you can use visualizations like trends, funnels, user paths, and even direct SQL access.

PostHogOptimizely

Native analytics

Track experiments without the use of third parties

Results

View experiment results

Segment results

Break results down for segments

Secondary metrics

Monitor non-goal metrics

Winner

Calculate the winning experiment variant

Custom insights

Query and customize analytics

Trends

Visualize results as a trend

Funnels

Visualize results as a funnel

Confidence interval

Show confidence in results

Session replay

View user sessions related to the experiments

Another bonus of PostHog is the ability to view user sessions related to feature flags and experiments. You can see directly how they respond to new features and changes as well as how it affects the rest of their session.

SDKs and API

PostHog and Optimizely both support similar languages and frameworks with SDKs, as well as provide an API for interacting with data.

PostHogOptimizely

Total count

Total number of SDKs

1414

Client

JavaScript, React

Server

Node, Python, Go, PHP

Mobile

Android, iOS

OTT

Over-the-top TV applications

API

Access and update data through REST API

Integrations

PostHog’s integrations are free while Optimizely often requires a subscription to their data platform "enhancement."

PostHogOptimizely

Google Analytics

Salesforce

Add-on

CDP

Zapier

Segment

Exports

S3

Snowflake

BigQuery

Slack

Teams

PostHog’s data warehouse further expands these destinations by enabling you to use data from these sources directly in PostHog.

Privacy, admin, & security

Both PostHog and Optimizely have the privacy and compliance tools users expect.

PostHogOptimizely

Change history

Trail of changes to data

SSO

Enterprise

Enterprise

2FA

Two-factor authentication

Roles and permissions

Control who can do what

GDPR ready

Stay compliant with GDPR

Cookieless

Use product without cookies

DPA available

Enter into Data Processing Agreements

Frequently asked questions

How difficult is it to implement Optimizely?

At its most simple, Optimizely’s web experimentation product requires adding a single script to your app. Their feature experimentation product is similarly simple, only requiring installing an SDK in your product and setting up the experiment logic.

To get full usage data and reporting, Optimizely also requires the implementation and connection of a third-party analytics tool like Google Analytics.

Optimizely’s other features are more complicated to set up, requiring a connection with your website, content system, or ecommerce software.

How difficult is it to implement PostHog?

You can access all of the features of PostHog, including feature flags and A/B testing, by installing a single script or SDK. There is no need to set up multiple scripts or SDKs for the different products.

Adding the specific logic for flags or A/B tests is as simple as a couple of lines of code. You can even implement them in no-code site builders like Webflow and Framer.

Who is PostHog useful for?

PostHog is useful for startups looking for all the tools they need to be a successful product. Companies like Y Combinator, AssemblyAI, and Contra use PostHog.

Who is Optimizely useful for?

Optimizely is useful for large enterprises looking to optimize their content, website, and ecommerce experiences. Companies like AmeriPride, JW Player, and HP use Optimizely.

Does Optimizely or PostHog offer a free trial?

PostHog offers a free forever plan as well as a generous free usage limit on the paid plan. This means you can access all of the features of PostHog for free as long as you stay under the free limits. It even provides billing warnings and limits to ensure you don’t go over the amount you want to spend.

Optimizely provides free trials for some of its products like feature flagging and content marketing, but most of its products (including web and feature experimentation) do not offer free trials.

Comments