Knowing There's an Issue is Great -  Understanding Why It's Happening Is Better...

By George Kouvaras | 1/10/19

One of the most popular features of the KPI Performance report in Real Customer Insights (RCI) is the “Start Analysis” button, also known as “what’s changed analysis”.

This feature addresses the missing element in any anomaly detection system – the isolation and identification of the root causes of anomalies.

Understanding what lies behind anomalies

Once an anomaly is detected, it will be highlighted on the KPI performance chart. We can also alert you on anomalies, so you know about big changes in KPI performance as soon as they happen. You can then use the “what’s changed analysis” to answer key questions such as:

  • Is it a global issue (i.e. across the whole site)?
  • Is it a specific timing point or traffic volume-related issue (e.g. has response start time slowed down site-wide)?
  • Can we pinpoint the segments which seem most responsible for the observed anomaly? (Note that a segment may contain one or more elements, e.g. users running Chrome on Windows 10.)
  • And, most importantly, does this anomaly really matter? In other words, is it having an effect on my KPIs?

How it works

“What’s changed analysis” encompasses a range of machine learning methods in order to identify, describe, and quantify the properties that significantly influenced the anomaly. It works by comparing the actual, observed values of each metric with the expected ones and quantifying this deviation.

kpi-perf

kpi-perf-changes-2

KPI performance and what's changed analysis in Real Customer Insights

The basic elements of this analysis include:

  • How much the volume has changed (to account for, e.g. when a slow segment increases in volume or a new, fast segment appears).
  • A score function to quantify the change from the expected.
  • A clustering algorithm that puts together similar segments.

All of this means that Eggplant’s “what’s changed analysis” enables better understanding about any anomaly, distinguishing the signal from the noise and providing clients with real, actionable insights.

Try Real Customer Insights for free.

Topics: website performance, KPIs, Real Customer Insights

George Kouvaras

Written by George Kouvaras

George Kouvaras is a Lead Data Scientist at Eggplant. He holds a PhD in Bayesian Statistics and he has worked for over 15 years in analytics, research and product development in both academia and private industry. During this time, he has designed, built and implemented large-scale data science algorithms that have had significant impact across business units and product lines.

Check out our newsletter for the latest in Eggplant news, events, blogs, and more.

Lists by Topic

see all