Our study, which recently appeared in Harvard Business Review and Forbes, empirically verifies the varying effects on performance that a company can achieve by applying a scientific approach to decision-making processes. We specifically looked at launching a new business model or product idea, compared the results of this approach to one based on heuristics, and then attempted to explain possible divergencies.
During our randomized control trial (RCT), we utilized a sample of 116 Italian startups and 16 data points over a year-long period.
We randomly sorted the companies into two groups, one treatment group and one control group, offering all companies a four-month entrepreneurship training program. Then we monitored the performances of the two groups over time.
Both the treatment group and the control group participated in ten sessions of general training, focusing on how to get market feedback and how to gauge the feasibility of ideas by searching, collecting and elaborating information before committing resources to actually developing these ideas. Specifically, the program consisted of four steps centering on market validation: business model canvas, customer interviews, minimum viable product and concierge or prototype.
As for the startups in the treatment group, we taught them to develop a framework for predicting the performance of their ideas, and to run rigorous testing on their hypotheses, just as scientists do in their research. With the control group instead, we let the companies follow their intuitions as far as evaluating their ideas using a method that normally produces fairly standard search heuristics.
Although we offered the same basic training to both groups, we did not provide decision-making criteria to the control group. More specifically, we taught the treated group to identify the problem, formulate theories, clearly define their hypotheses, run tests to prove or disprove their theories, measure their test results and finally make decisions based on the outcomes of all these techniques.
Our study highlights the fact that entrepreneurs who act like scientists get better results, more readily pursue new and original ideas, and are less likely to give up on a project in the initial stages. The results from our trial are consistent with the main hypothesis of our theory: a scientific approach actually improves the precision of predictions.