Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(funnels): Highlight significant deviations in new funnel viz #9536

Merged
merged 5 commits into from
Apr 27, 2022

Conversation

Twixes
Copy link
Member

@Twixes Twixes commented Apr 26, 2022

Problem

#9412 added a new funnel viz (behind feature flag lemon-funnel-viz), but it didn't have support for highlighting significantly different breakdowns.

Changes

This should make use of the existing significance logic. Let me know if I got this right @neilkakkar.

Screen Shot 2022-04-26 at 16 20 39

@Twixes Twixes requested a review from neilkakkar April 26, 2022 14:24
@@ -92,8 +93,23 @@ export function FunnelStepsTable(): JSX.Element | null {
},
{
title: 'Total conversion',
render: (_: void, breakdown: FlattenedFunnelStepByBreakdown) =>
formatDisplayPercentage(breakdown?.conversionRates?.total ?? 0, true),
render: function RenderTotalConversion(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

curious about when and where does 'Total conversion' show up? Not sure I ever see this. Otherwise LGTM!

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suspect you might have not created and switched on the lemon-funnel-viz flag?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

D'oh, ofcourse. Gahh, let me go again :P

@neilkakkar
Copy link
Contributor

unrelated feedback: there's something funky going on when scrolling into this table:

2022-04-26 15 41 17

@Twixes
Copy link
Member Author

Twixes commented Apr 26, 2022

Well, I don't care @neilkakkar ;) About this table at least, because that's the old one, and it's going out the window once lemon-funnel-viz is released.

@neilkakkar
Copy link
Contributor

I see it now, this is beauty :D - and covers the whole line lol, much nicer UI!

@Twixes
Copy link
Member Author

Twixes commented Apr 26, 2022

I realized I had kind of confused FunnelStepWithConversionMetrics['significant']['total'] here and it was used wrong in Total conversion. This also led me to update the table columns to more clearly reflect what they actually convey, including significance. For instance the real difference between the "Rate" next to "Completed" and the one next to "Droppped" was that the former was the total so far conversion, while the latter was relative to the previous step. This should now be clearer in general. CC @clarkus

Before

before

After

after

(the screenshots are with DEVIATION_SIGNIFICANCE_MULTIPLIER = 1.2)

@Twixes Twixes requested a review from neilkakkar April 26, 2022 15:42
@neilkakkar
Copy link
Contributor

Hmm, I am not sure if that's what those conversion rates meant.

I think they were conversion rates for success, and dropoffs (which is why they sum up to 100%, otherwise it doesn't make sense how that's possible?)

But, your change makes more sense, as these numbers are more valuable/harder to compute mentally.

We probably don't need to highlight both rates in a single row though, since thats too many highlights? I had this condition earlier where if one is highlighted we shouldn't highlight the other conversion rate in the same overarching column

@Twixes
Copy link
Member Author

Twixes commented Apr 26, 2022

They don't actually add up to 100% in the old table, which I didn't realize before building this new table, so it probably wasn't the most intuitive experience:

Screen Shot 2022-04-26 at 18 40 34

Fair point with highlighting both rates! Used the same logic as before so that only one rate can end up highlighted.

@Twixes Twixes changed the title fix(funnels): Highlight significant deviations in new funnel viz feat(funnels): Highlight significant deviations in new funnel viz Apr 26, 2022
@neilkakkar
Copy link
Contributor

I see, makes sense then!

@Twixes Twixes merged commit 75037f2 into master Apr 27, 2022
@Twixes Twixes deleted the lemon-funnel-viz-5 branch April 27, 2022 10:23
fuziontech added a commit that referenced this pull request Apr 28, 2022
* master: (137 commits)
  feat(cohorts): add cohort filter grammars (#9540)
  feat(cohorts): Backwards compatibility of groups and properties (#9462)
  perf(ingestion): unsubscribe from buffer topic while no events are produced to it (#9556)
  fix: Fix `Loading` positioning and `LemonButton` disabled state (#9554)
  test: Speed up backend tests (#9289)
  fix: LemonSpacer -> LemonDivider (#9549)
  feat(funnels): Highlight significant deviations in new funnel viz (#9536)
  docs(storybook): Lemon UI (#9426)
  feat: add support for list of teams to enable the conversion buffer for (#9542)
  chore(onboarding): cleanup framework grid experiment (#9527)
  fix(signup): domain provisioning on cloud (#9515)
  chore: split out async migrations ci (#9539)
  feat(ingestion): enable json ingestion for self-hosted by default (#9448)
  feat(cohort): add all cohort filter selectors to Storybook (#9492)
  feat(ingestion): conversion events buffer consumer (#9432)
  ci(run-backend-tests): remove CH version default (#9532)
  feat: Add person info to events (#9404)
  feat(ingestion): produce to buffer partitioned by team_id:distinct_id (#9518)
  fix: bring latest_migrations.manifest up to date (#9525)
  chore: removes unused feature flag (#9529)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants