The first time I saw Kent Beck speak he was going on and on about an itchy goat. I had no idea who he was or why he was talking about this goat or why he was scratching it on the back. But he said something that struck me and keeps coming back.
The Build Measure Learn loop is backwards.
There is a presumption there that if you start building something and slap some analytics on it then you will inevitably learn something.
Step 1 Step 3 – Build a Minimum Viable Product
Building an MVP shouldn’t be about minimum effort or just taking out features.A Minimum Viable Product must be designed for validated learning. Click To Tweet
Sure, if you just want to hack something fun together over the weekend, go for it. Release it, see what happens, decide if you want to continue. That’s certainly one way to approach things. (This is affectionately called the “Field of Dreams” approach by some.)
But if your goal is validated learning, the first thing you need to do is decide what to learn. Scientists don’t just start throwing chemicals into a vat and randomly feed it to babies to see what happens. They didn’t build the Large Hadron Collider for the hell of it.Building random toys to find Product/Market Fit is like paying $80k / year to pick classes by throwing darts at a college catalogue. Click To Tweet
A good scientist forms a hypothesis, then carefully designs an experiment with a control group to measure the effect of that experiment. Only then do they implement the experiment and learn something.Minimum Viable Product is a terrible name. I prefer to build a Minimum Viable Test. Click To Tweet
(Parker Thompson also proposed the term Minimum Viable Interaction which I also like tremendously.)
Step 2 – Measure What?
Let’s just throw it out there and see if it works!
Awesome! Do it! How will you know if it works?
Let me guess…you’ll slap google analytics on it, throw up a post on Hacker News, it’ll be voted to the top it meritocratic fashion, and then you’ll be able to tell if people sign up.
Here’s the problem:
- Getting to #1 on Hacker News? – A vanity metric.
- # of sign ups? – A vanity metric.
Product / Market fit does not mean, “does anyone want this thing I built?”
Just knowing that someone, somewhere out in the world want something you build doesn’t help you.
If there are enough dubiously curious individuals out there who want to buy the shake weight, then I guarantee you that no matter how idiotic your startup idea is, there is at least one individual who is willing to pay for it.
Who is that person? Why do they want it? How are you going to find that person? How many of them are there? Are they willing to pay for it?
At the cruz of the biscuit, Product / Market fit asks, “does this specific customer segment desire this specific value proposition?” So at the minimum you need a to measure what % of your target market sign up with a reasonable sample size.
That implies you either restrict your marketing to the customer segment, or you screen them out of your conversion somehow.
In other words, if you’re building a product to target soccer moms, then a viral posting on Hacker News has no bearing on your product, even if you have a 100% conversion rate. (If anything, that would imply that you are targeting the wrong customer segment.)You can not measure your signup conversion rate without having a clear target market. Click To Tweet
(BTW: “Everyone” is not a clear target market. More on that in another post.)
Step 3 Step 1 – Learn
So if you want to start with Build, please do so. I enjoy building random toys myself from time to time. But don’t kid yourself about what you’re learning.
If you really want to learn about your business, start by figuring out what you want to learn.
- Establish a hypothesis
- Determine a quantitative or qualitative method to evaluate that hypothesis.
- Build an experiment to test that hypothesis