Find the errors Twig's paying hosts hit

Twig's hosts pay a monthly fee. This custom scout reports issues concentrated in paying hosts, even when they rank low by occurrences.

What the scout looks at

TypeError: Cannot read properties of null fired 2,340 times this week on the stays of 31 hosts. Four of them pay for Twig's top plan and get 9% of its traffic, but they carry 71% of the issue, so the scout reports it Fig. 1. An issue spread evenly across hosts gets no report.

Share of the issue = Share of traffic×Concentration

 Share of the issueShare of trafficConcentration 
Issue A71%9%7.9×Concentrated
Issue B9%9%1.0×Even spread
Fig. 1 – What the scout saw: four paying hosts get 9% of Twig's traffic. They carry 71% of Issue A and 9% of Issue B, so only Issue A gets a report.

The scout skips issues driven by one browser retrying. The spikes and stuck loops scout covers those.

The report in your inbox

The report names the issue and the hosts, with each host's share of the issue next to its share of Twig's traffic Fig. 2.

P1One issue is 71% concentrated in four paying hosts Four paying hosts carry 71% of one issue and get 9% of Twig's traffic. The issue isn't in the top ten by occurrencesScout · errors in paying hostsReadyActionable3h ago
ArchiveReview
Fig. 2 – The report card in Twig's inbox. The claim is on the card, and the hosts and the comparison are inside the report.Hover over the figure to learn about each element.

The scout itself

This is a custom scout, and its file is in the Self-driving pocket guide. With group analytics, each $exception event carries the host of the stay. The scout compares each host's share of an issue with its share of Twig's traffic over the last seven days. It checks which hosts pay by their Stripe customer ID in Customer analytics. It only reports issues that fired in the last 24 hours. Querying exceptions shows the same join. It runs every 24 hours by default and stays quiet unless something needs the team's attention.

Add this to your scout troop

The scout needs exceptions reaching PostHog, hosts as a group, and hosts in Customer analytics with a Stripe customer ID on each paying host. The Add this scout button in the Self-driving pocket guide opens PostHog with the scout prefilled for review.

Open the scoutA scout that checks your issues every day and reports the ones concentrated in paying accounts.