Latest Essays

Author:
Oleg Ya
How engagement metrics can be misleading

It is common to evaluate your product performance and the impact of changes you make by using engagement metrics with active audience in the denominator. Examples of these metrics include the time spent per active user, the occurrence of certain actions (messages sent, levels played, chapters read, etc) per active user, or ratio metrics (what percent of active users perform a specific action) .

In most situations, these engagement metrics will be helpful. But in some cases, they can be misleading. And it is important to understand why and when this can happen, and what you can do about it.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

How engagement metrics can be misleading

pic from http://mediainjection.com

(more…)
Author:
Oleg Ya
What is product/market fit and how to measure PMF

Product/market fit is an important concept when working on a new product. All entrepreneurs and product managers are committed to it. But if you ask what the term means, very few will be able to give a clear answer. Even fewer will have an understanding of how we can measure product/market fit using metrics.

Without a clear definition, even the most useful concepts will be of little help when making decisions. In this post, we will discuss some of the most common product/market fit definitions and their advantages and disadvantages, as well as tell you about PMFsurvey.com (Product / Market fit survey by Sean Ellis) developed in collaboration with GoPractice, which is designed to give you an objective metric of how close are you to Product / Market fit.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

What is product/market fit and how to measure PMF
(more…)
Author:
Oleg Ya
How to increase the effectiveness of your product analysts

Finding insights and answers to questions in data is a key skill in product analytics. And developing this skill is the area where analysts usually see their growth potential.

Talking from experience, I strongly recommend paying attention to another aspect of analytical work: communication skills. Key here is not only finding insights, but also turning them into projects and making sure they convert into real value for users. 

Getting to this point requires building relationships with the team, participating in key discussions, gaining credibility, and learning to present information in an effective way.

This article provides a series of recommendations for product analysts. However, it will be equally useful for product managers and executives who want to maximize the impact of analysts working in their teams.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

How to increase the effectiveness of your product analysts
(more…)
Author:
Editorial
Product Leadership: interview with Vaibhav Sahgal, Head of Growth at Reddit

What are the traits of a good product manager? Where do you get started from? How do you know you’re on the right track? Those are the questions that should be on the mind of anyone who yearns to have successful career in product management.

While each of us will have own unique journey to success, there’s a lot we can learn from successful product managers. One of them is Vaibhav Sahgal, former Director of Product and Vice President at Zynga, and current Head of Growth at Reddit. In an interview with Anna Buldakova, Vaibhav shared tips on growing your career as a product manager, balancing short- and long-term bets, and also developing the right skillset to become a product leader.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Product Leadership: interview with Vaibhav Sahgal, Head of Growth at Reddit

(more…)
Author:
Oleg Ya
Pricing experiments and how they can help your business increase revenue

Classical economics is built on the assumption that people act rationally, which means their decisions are aimed at maximizing their benefits. This statement (which is a base for the classic economics theory), is a bit doubtful, partly because people usually don’t have all the necessary information to make the best decision in a given situation. But even within the framework of the available information, people tend to make irrational decisions.

In this post I will show you some interesting experiments that highlight relevant characteristics and patterns in humans’ decision making processes. Most of these experiments are about the way people behave when deciding about purchasing something, so you can easily apply them to your business or everyday life.

I have to say, I really like the picture below as it perfectly portrays the main idea of ​​this article. Interestingly, squares A and B have the same color in this picture. (You can check it yourself using Photoshop or some other photo-editing tool if you don’t believe me.)

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Pricing experiments and how they can help your business increase revenue
(more…)
Author:
Editorial
Product Leadership: Interview with Director of Product Management at Twitter

Few people get to experience product management at large, successful tech companies and decide to share their expertise and outlook with others who want to get started in the field. One of them is my good friend Anna Buldakova, a seasoned product manager.

Anna sat down with Scott Eblen, Director of Product Management at Twitter, to discuss if technical background is a requirement for Product Managers, what is the difference between Google and small startups, and how to create a good vision and strategy.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Product Leadership: Interview with Director of Product Management at Twitter

(more…)
Author:
Oleg Ya
Setting up event tracking for a mobile app

Creating the app of your dreams can be a daunting challenge. But an even greater challenge is making sure your users find and experience its value. To do this, you need to have visibility on how users navigate through your app and interact with its features.

This is where analytics and event-tracking platforms come into play.

Analytics help you answer important questions about your users such as what do they like about your app, where are they struggling, which features need improvement, which features are hindering the user experience, and many more.

The foundation of analytics is data collection. Every analytics platform comes with a software development kit (SDK) that you can integrate into your app to send events. Developers add code that calls special application programming interfaces (API) in the locations where an event must be fired (for example, when users launch the app for the first time or when they send a message). If event logging is set up poorly, you will be blinded when working on your product, or you will work with erroneous data, which in my opinion is even worse than not having any data.

In this article I will be talking about the following:

  • Common mistakes in setting up analytics for mobile apps
  • The right approach to integrating analytics in mobile apps
  • Some hacks that will allow you to use data more efficiently

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Setting up event tracking for a mobile app
(more…)
Author:
Oleg Ya
How game developers can leverage the hidden potential of their data

The general perception is that data analytics and data-driven product management is more suited for business applications, social media apps, and communications platforms. But the reality is, any kind of product can benefit from a data-driven perspective.

One of the domains where the value of data is often underestimated is games.

In my experience, most teams working on mobile games don’t fully use the potential of data. They tend to track topline metrics, measure effectiveness of paid marketing campaigns, analyze the impact of product changes all while running meticulous AB tests. This may sound like enough, but it really isn’t. Not if your goal is to climb onto the top of the grossing charts and stay there.

There are many more ways how data can increase your chances of building and operating a successful mobile game. The key is to stop thinking of data as a way to look back at what you have done, but instead start using data as a tool that can help you make decisions, decrease uncertainty and remove main product risks as early as possible.

In this post, I will walk you through a few examples of how data can drive key product decisions at different stages of product development cycle. But first, let me tell you a story…

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

How game developers can leverage the hidden potential of their data
(more…)
Author:
Oleg Ya
This little-noticed change in iOS 13 can put an end to Calm’s 1B valuation and make the App Store better

 “You never know who’s swimming naked until the tide goes out.”
― Warren Buffett

The last few years were big for non-gaming subscription-based apps in the Apple App Store. During this period, lots of simple apps started making millions of dollars per month.

For example, Celebrity Voice Changer makes over $3M per month and raked in almost $30M in the past few years. QR Code Reader by Tinylab made over $800K last month and over $13M over the last few years. An app called Life Advisor generated over $1M in revenue in the last month alone.

Some of the companies developing pretty basic apps have even become unicorns. In February, Calm raised $88M in funding at a $1B valuation. The maker of Facetune app raised $135M at a unicorn valuation In July.

But how do they do this?

These apps aren’t powered by any innovative technology; they don’t have network effects; and they are pretty easy to copy. So what is their secret sauce? Subscriptions. To be more specific, the obscure way that subscriptions used to work in iOS.

I said “used to work” because Apple made a small change to subscriptions in iOS 13, the latest version of its mobile operating system. This change went unnoticed by media outlets covering iOS 13’s release, but I believe it will have a profound impact on the mobile apps ecosystem in the Apple App Store.

In this article I will use revenue and downloads estimates provided by Datamagic to explain why I believe the following will happen after Apple’s new adjustment to iOS app subscriptions:

  • The revenue of Calm and Facetune on iOS will drop by a factor of 2-4, and they won’t be able to justify 1B valuation.
  • Lots of sneaky subscription apps will first stop growing, and then disappear altogether from the App Store over time.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

Calm's iOS revenue forecast
(more…)
Author:
Oleg Ya
Rolling retention, Day N retention, and the many facets of the retention metric
Rolling retention, Day N retention, and the many facets of the retention metric

Retention rate is one of the fundamental metrics in product management. We all use it regularly, yet few of us know that there are many different ways to calculate retention rate. And it is very important to know which one to use when you’re making decisions based on retention data.

Let me start with a story. When I worked at Zeptolab (popular game development company, creator of Cut the Rope, King of Thieves, CATS) once we got an email from a gamedev studio that wanted us to publish their game. We were getting many similar emails, but that one got our attention. We were impressed by the metrics of the game, which had just recently soft launched. According to the developers, Day 1 retention rate of the game was over 55%, and Day 7 retention rate was over 25%.

However, when we started playing and testing the game, something felt wrong. The gameplay was not engaging enough to justify >55% Day 1 retention rate. And the meta game design was not good enough to users in the longer term.

Further investigation revealed that what this game development company called retention was actually “rolling retention.” Classic Day N retention of the game happened to be unimpressive.

This is just one example of how retention metrics can misguide you. There are many nuances in how you can calculate it.

→ Test your product management and data skills with this free Growth Skills Assessment Test.

Learn data-driven product management in Simulator by GoPractice.

Learn growth and realize the maximum potential of your product in Product Growth Simulator.

Join our discussion on LinkedIn. New topics to talk about every week.

(more…)