Lean Analytics – by Alistair Croll & Benjamin Yoskovitz
Date read: 8/11/19. Recommendation: 8/10.
The best book that I’ve read to date on product metrics and using data to your advantage without overanalyzing. The core of the book focuses on how to use data to build a better startup faster. Croll and Yoskovitz walk through a dashboard for every stage of a business, from validating a problem, to identifying customers, to deciding what to build, to positioning yourself. They discuss how to choose strong metrics and the analytics frameworks available for building a successful business (Pirate Metrics, Engines of Growth, Lean Canvas, Growth Pyramid). Croll and Yoskovitz also define their own “Lean Analytics” framework which features five stages – empathy, stickiness, virality, revenue, scale – and explain the metrics you should be tracking and the gates required to move forward at each stage. This is a great resource for founders and product managers if you’re looking to improve your analytics and be more strategic with key metrics.
See my notes below or Amazon for details and reviews.
My Notes:
How to use data to build a better startup faster. Dashboard for every stage of business, from validating a problem, to identifying customers, to deciding what to build, to positioning yourself.
Find a meaningful metric, experiment to improve it until it’s good enough for you to move on to the next stage of your business.
Airbnb photography metric:
Hypothesis: hosts with professionally photographed homes will get more business and sign up for this as a service. Airbnb took the Concierge MVP approach and sent professional photographers to take pictures of hosts’ homes. Initial tests with this MVP showed that listings featuring professional photographs received 2-3X more bookings. The new metric they began to monitor was shoots per month (already knew it resulted in more bookings).
Good metrics:
Comparative, understandable, a ratio or rate, changes the way you behave (actionable).
Total signups = a vanity metric. “Total active users” is a bit more insightful, but even better is “percent of users who are active.” Tells you the level of engagement users have with your product.
Be data-informed, not data-driven:
Slippery slope towards overanalyzing: “Using data to optimize one part of your business, without stepping back and look at the big picture can be dangerous – even fatal.”
Analytics frameworks for building a successful business:
Pirate metrics: AARRR - acquisition, activation, retention, revenue, referral.
Learn Startup, engines that drive growth: sticky, virality, payment.
Sean Ellis’s Growth Pyramid: product market fit, stack the odds (find defensible unfair advantage), scale growth.
Lean analytics: empathy, stickiness, vitality, revenue, scale. Each of these has a gate required before you’re able to move forward (page 53).
Two-sided marketplaces:
Start by focusing on whoever has the money, model the buyer side as your primary focus. Harder to find people who want to spend money, than it is people who want to make money.
When Uber launched in Seattle, they created supply. They overcame chicken-and-egg problem by buying up towncars, paying drivers $30 an hour to drive passengers, and switched to commission once there was sufficient demand.
Business models vs. business plans:
“Business plans are for bankers; business models are for founders.”
“By knowing the kind of business you are, and the stage you’re at, you can track and optimize the One Metric That Matters to your startup right now. By repeating this process, you’ll overcome many of the risks inherent in early-stage companies or projects, avoid premature growth, and build atop a solid foundation of true needs, well-defined solutions, and satisfied customers.”
Empathy (stage 1):
Primary job is to get inside someone else’s head. Discovering and validating a real problem. Then find out if your proposed solution is likely to work. Interview at least 15 people at each stage.
Goal of this stage is to determine whether the problem is painful enough for enough people and they’re already trying to solve it.
“Always know what risk you’re eliminating, and then design the minimum functionality to measure whether you’ve overcome it.”
Stickiness (stage 2):
Focus is squarely on retention and engagement. Are people using product as expected? Are they getting enough value out of it?
Goal of this stage is to build a core set of features that gets used regularly and successfully.
One in, one out: If a new feature doesn’t improve the one metric that matters most, remove it.
Major risk is driving new traffic when you’re unable to convert that attention into engagement.
Revenue (stage 4):
Shift focus from proving idea is right to proving you can make money in scalable, self-sustaining way.
You need to be able to answer these: how big can the business grow, how good can the margins get, and what kind of barriers to entry does it have?
“Users engage with the online world in three postures: creation (often on a computer with a keyboard), interaction (usually with a smartphone), and consumption (with a tablet).”
User groups and feedback:
You can get better answers by asking your customers to make a selection of one alternative from a set of possibilities, rather than asking them to rate something on a scale of 1 to 10. “Would you prefer a delicious, high calorie candy made with artificial ingredients or a bland, low calorie organic candy?”
“Asking customers to trade off variations of combinations, over and over, dramatically improves prediction accuracy.”