How does Signal display the results?

After the Signal report is generated, the results will immediately be displayed in a summary list-view and a detailed heat map.

Summary view

In the summary view, each Event will be represented by one card in the results with the goal of showing which combination of threshold # and time to convert was optimal for that event in relation to the goal event. For each Event evaluated, the list-view will display the optimal action, correlation with the goal event, and key findings about the event. Results can be sorted by highest to lowest absolute value correlation or highest to lowest Mixpanel opportunity score.

By default, the results will be sorted by “Opportunity.” “Opportunity” is Mixpanel’s proprietary calculation of how important a given correlation might be. For more detail on how "Opportunity" is calculated reference this article. The events will not be displayed with positive correlations on top and negative correlations on the bottom, but by the strength of the correlations.

If you choose to sort by Correlation Strength the results will be displayed by the absolute value of the correlation.

alt text

Detailed view

The detailed view provides customers with correlation calculations for each Event evaluated. This view uses a heat map to show the strength of the correlation with the Goal event (ie. retention) for every frequency and velocity combination of the event selected. The x-axis represents the velocity, or the number of days it took users to complete the event (up to 14 days) and the y-axis shows the frequency of the event, or the number of times the event was done, up to ten times. The Optimal combination will be highlighted in green. This data will be used to calculated Mixpanel’s assessment of the particular Event and threshold combination.

For each combination Mixpanel will provide supporting statistics for users that are inclined to evaluate the correlation on their own:

  • Precision: Percent of users who convert to your goal among those who did this event at least x times within y days

  • False omission rate: Percent of users who convert to your goal among those who did this event fewer that x times within y days

  • Recall: Percent of converted users who did this event at least x times within y days

  • Fall-out: Percent of unconverted users who did this event at least x times within y days

  • Correlation: Association between performing this event at least x times in y days and converting to your goal.

alt text

To see the calculations of the optimal correlation data, hover of the ƒx in the upper right hand corner of the chart at the bottom of the heat map.

alt text