A Key Performance Indicator (KPI) is a way to measure and understand progress towards a particular result.
Certain KPIs are considered Health Metrics, which means we actively monitor them and alarm on them and take action when and if they fall out of expected range. Otherwise we may or may not have goals or initiatives associated with their outputs.
Meltano’s primary strategic goal is to achieve product-market fit for Meltano as a data movement (EL+T) solution with 10X developer experience over alternatives. Our primary metric for measuring progress towards this goal is the number of active projects.
Active projects is a metric we can influence directly and new active projects will inevitably lead to more Unique Pipelines and Pipeline Runs. This metric encourages us to retain existing Meltano users as well as activate new users.
We previously targeted Pipeline Runs as our primary metric, but because it, along with unique pipelines, are harder to directly influence, we have re-focused on active projects. However, we believe that a key part of increasing active projects is ensuring successful pipeline runs, so we will still monitor Pipelines Runs closely.
To learn more about North Star Metrics checkout these articles from Mixpanel and Amplitude.
See the metrics and definitions page for details on how we measuere pipelines.
Making KPIs as internal-by-default instead of “public” (counterintuitively) keeps politics and pride out of the honest reporting of our metrics, and it supports our values of company-wide humility, ambition, and transparency. This approach allows the best and most honest internal iterations on metrics, and promotes transparency across the company by default with no need for individuals to avoid or suppress metrics which at least initially don’t look “flattering” for meltano.
Additional KPIs and health metrics like retention, overall usage, and community engagement will be added to this page as we’re able to define and measure them.
Other metrics we track are documented in the data team handbook