Category posts
Series

Author:
Oleg Ya
Slack vs Teams vs Workplace: the intriguing dynamics of the work messenger market

Watching new and rapidly changing markets can teach you many things. The work communication market led by companies such as Slack, Microsoft Teams and Workplace by Facebook is something I have been following for a long time.

Last year, before Slack went public, I did an analytical review of the data disclosed in Slack’s S-1 filing. At the end of that review, I shared my opinion that Slack experienced problems in the enterprise segment: the competition from Microsoft Teams and Workplace by Facebook for this market segment threatened Slack’s long-term growth prospects and its $20+ billion valuation.

A lot of things have happened in the eight months that have passed since I published that essay. A lot of new data has surfaced, with one of the biggest market intrigues fading away and a new one appearing. The leading characters once again reminded us of a number of fundamental rules the market plays by. And this is exactly what I am going to talk about in this essay.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Slack vs Teams vs Workplace: the intriguing dynamics of the work messenger market
(more…)
Author:
Oleg Ya
Why your A/B tests take longer than they should

When conducting experiments, teams usually include all the active users in their tests, or sometimes they tend to add all the new users who join the app during this test. So when calculating the metrics for different test groups, all the data from the moment the A/B test kicks off is taken into account.

Today I’ll talk about how you can reduce the time required to get the signal on the change you are testing in a product. You can do that by changing the process of adding users to the A/B test, and in this essay I will show you how you can do it.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Why your A/B tests take longer than they should
(more…)
Author:
Oleg Ya
Experiments where you make your product worse – the most underrated product manager tool

Let’s start with a practical task.

Say a company’s management wants to allocate significant resources to the development of infrastructure that would increase their app’s speed. The hypothesis is that increasing the speed of the app will have a positive effect on the user experience and the key metrics.

Think of an experiment (an A/B test) to validate this hypothesis.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Experiments where you make your product worse – the most underrated product manager tool
(more…)
Author:
Oleg Ya
How engagement metrics can be misleading

It is common to evaluate your product performance and the impact of changes you make by using engagement metrics with active audience in the denominator. Examples of these metrics include the time spent per active user, the occurrence of certain actions (messages sent, levels played, chapters read, etc) per active user, or ratio metrics (what percent of active users perform a specific action) .

In most situations, these engagement metrics will be helpful. But in some cases, they can be misleading. And it is important to understand why and when this can happen, and what you can do about it.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

How engagement metrics can be misleading

pic from http://mediainjection.com

(more…)
Author:
Oleg Ya
What is product/market fit and how to measure PMF

Product/market fit is an important concept when working on a new product. All entrepreneurs and product managers are committed to it. But if you ask what the term means, very few will be able to give a clear answer. Even fewer will have an understanding of how we can measure product/market fit using metrics.

Without a clear definition, even the most useful concepts will be of little help when making decisions. In this post, we will discuss some of the most common product/market fit definitions and their advantages and disadvantages, as well as tell you about PMFsurvey.com (Product / Market fit survey by Sean Ellis) developed in collaboration with GoPractice, which is designed to give you an objective metric of how close are you to Product / Market fit.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

What is product/market fit and how to measure PMF
(more…)
Author:
Oleg Ya
How to increase the effectiveness of your product analysts

Finding insights and answers to questions in data is a key skill in product analytics. And developing this skill is the area where analysts usually see their growth potential.

Talking from experience, I strongly recommend paying attention to another aspect of analytical work: communication skills. Key here is not only finding insights, but also turning them into projects and making sure they convert into real value for users. 

Getting to this point requires building relationships with the team, participating in key discussions, gaining credibility, and learning to present information in an effective way.

This article provides a series of recommendations for product analysts. However, it will be equally useful for product managers and executives who want to maximize the impact of analysts working in their teams.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

How to increase the effectiveness of your product analysts
(more…)
Author:
Oleg Ya
Rolling retention, Day N retention, and the many facets of the retention metric
Rolling retention, Day N retention, and the many facets of the retention metric

Retention rate is one of the fundamental metrics in product management. We all use it regularly, yet few of us know that there are many different ways to calculate retention rate. And it is very important to know which one to use when you’re making decisions based on retention data.

Let me start with a story. When I worked at Zeptolab (popular game development company, creator of Cut the Rope, King of Thieves, CATS) once we got an email from a gamedev studio that wanted us to publish their game. We were getting many similar emails, but that one got our attention. We were impressed by the metrics of the game, which had just recently soft launched. According to the developers, Day 1 retention rate of the game was over 55%, and Day 7 retention rate was over 25%.

However, when we started playing and testing the game, something felt wrong. The gameplay was not engaging enough to justify >55% Day 1 retention rate. And the meta game design was not good enough to users in the longer term.

Further investigation revealed that what this game development company called retention was actually “rolling retention.” Classic Day N retention of the game happened to be unimpressive.

This is just one example of how retention metrics can misguide you. There are many nuances in how you can calculate it.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

(more…)
Author:
Oleg Ya
To reduce your product’s churn rate, first find out why users stay

Most of us have learned to think about products in terms of user churn at specific steps in the funnel. We keep asking ourselves “Why do users leave?” and then we try to find and fix the reasons for this. We assume that solving those issues and removing friction will improve the key product metrics.

Funnel optimization surely is a good approach to improve key product metrics. However, it doesn’t work in all situations. And when it does work, it usually only brings incremental improvements, not fundamental changes.

Today, we’re going to talk about a different approach when examining your product. This approach can boost your product, and sometimes it can take your product to a completely new direction.

I suggest posing the question “Why do users stay?” before “Why do users leave?”

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

To reduce your product's churn rate, first find out why users stay
(more…)