You will learn about the basic metrics, the difference between correlation and causation, percentages and percentage points, arithmetic mean, and median.
A brief overview of the history of the browser wars. A good analogy to what your new company wants to achieve.
The first task from a Chief Product Officer. You will deal with the analytics system Amplitude, calculate the basic metrics of the app, and make the first conclusions about the product and its potential.
While everyone prepares for the launch, you have time to study the market using publicly available data. You will evaluate the audience and download figures of competitor apps and make your conclusions about the target market for the company.
Big day for the company — the public launch of the product!
Time to evaluate the results of the launch and the impact on key metrics. Is it good or bad?
You will understand the nuances of retention metrics and how it is calculated in Amplitude. You will get the idea of how retention, new users, and active audience are connected. You will create a model for predicting the audience to assess how changes to key metrics impact growth.
You will find out more about different kinds of metrics, and what they’re used for. You will also get information on retention rates for different product categories.
You will use cohort analysis and the funnel tool in Amplitude to understand how the changes made in the latest version of the product have affected the key metrics.
To compare the metrics of the two versions of the product, it is not enough to calculate them. You must verify whether the change is statistically significant or not. You will learn to apply mathematical formulas to draw relevant conclusions while comparing metrics.
Your manager tells you about a new feature, which will be developed soon. You decide to take the initiative and evaluate its potential effect and usage, and to do so, you create a product model to evaluate conversions of the key steps in the funnel.
You will learn what a value hypothesis is. Then you will formulate it and build a product model to better understand the product and how it actually works.
Sunday morning begins with an unexpected email from the CEO of the company. What’s the matter?
You will learn the difference between hypotheses and facts and check your product spidey sense, predicting the results of real experiments. You will learn to design experiments and interpret their results. You will formulate an important hypothesis, check it, and get unexpected results.
The unexpected results of the experiment have put the confused team in a bind. But you will find a solution by applying qualitative user research methods (interviews, surveys, etc.).
Time for one more educational story, uncovering WeChat’s path to dominating the Chinese messaging app market. This chapter will help you look at the product and things happening to it from a different angle.
You will learn how to apply a number of frameworks to find the hidden value of a product. You will observe something unexpected—or maybe not. It’s all up to you, remember?
You will use the insights from the previous chapter to change the product. And who knows where this will lead you?
You will have to step into the leader’s shoes and make tough choices. At the same time, you will understand why it’s so important to manage product risks as early as possible.
You will explore the second key hypothesis while creating a product. You will guess the key distribution channels for well-known services and prioritize the growth hypothesis for the product.
It’s time to deal with marketing analytics. It’s simple. It is enough to study the details of the ROI metric and learn how to apply cohort analysis to this task.
The product is improving, but to make this process meaningful, you need to understand the target market, i.e., who are your users, who are the competitors, and what are the market’s dynamics.
The team begins testing paid traffic acquisition. You will understand how advertising networks work. You will also analyze a number of test ad campaigns, as well as assess the potential for product monetization, deciding whether to invest in a channel or not.
You will have to create a semantic core for the product, and estimate the amount of potential traffic and competition.
Despite the progress in many areas, you are far from the goal. The situation is complicated by the fact that the company is running low on cash. To get the next round of investment, you need to change something. You have to use all your accumulated knowledge about the product to make a tough decision.
The decision you made leads to unexpected results. You have to conduct an investigation using all the skills you have mastered. Who knows where it may take you?
Resolution of the story. Repetition and consolidation of all the skills and knowledge gained in the training process.