In our last post we looked at various management approaches to reduce risks. One of them pertained to business experiments. In this post, we’ll dig a bit deeper to better understand this approach.
You have most likely heard of business experiments. The Harvard Business Review, as well as many other business management publications, published multiple articles on the topic in the last few years. They were mostly in the context of innovation.
What is a business experiment?
If you have not, a business experiment is simply testing a concept (idea, program, process, design, product, strategy, etc.) with stakeholders (customers, suppliers, distributors, employees, etc.). The experiment’s goal is to provide pertinent data to assist with decision making (usually with go/no go decisions or sometimes fine-tuning).
So yes, you do know what a business experiment is. It’s been around for, well, pretty much ever. Now you’re asking yourself; Why this article is drawing my attention to it?
The reason is that business experiments are no longer used as an occasional management tool, they are transforming into the way businesses are managed.
Why are companies experimenting at an increasing rate?
As we mentioned, business experiments are used to collect data that assists management with decision-making.
Decision-making in the business world is becoming a more demanding task (to say the least).
- Companies are significantly leaner (i.e. less resources and more work for everyone, including managers).
- The amount of information available, from secondary sources, is enough to make any manager’s head spin.
- There is a higher supply than demand for managers hence making bad decisions is a riskier proposition for your longevity in a given company than ever.
- In many sectors, markets are moving at a faster pace than ever before with competitors coming in from everywhere and customers’ choices exploding.
Hence managers are turning to ways to reduce the time and the risk involved to make the best possible decisions.
Running a business experiment to gather pertinent and timely data quickly answers the needs of over-burdened managers to reduce the risks of the decisions they make.
This explains, in part, why organisations are experimenting. What explains the increasing rate at which they are doing it, and transforming it into a management approach, has more to do with the following reasons:
- It’s cheaper and faster than ever to run business experiments (many can be done in minutes with free tools)
- An increasing number of employees or outside consultants have the skills to run experiments, analyse and interpret the collected data
- The costs to store, process and communicate the data/result are very low (compared to a decade ago) and falling constantly.
Business experiments and the Lean Startup framework
So how does an organisation go about implementing business experiments as a managerial approach? There is no one way to do so. There are however experimentation frameworks out there that can structure your approach.
One of these is the Lean Startup framework.
The base of Lean Startup is the experiment. The Lean Startup experiment is based on the scientific experiment model. It follows a build, measure, learn process.
Build (designing your experiment)
Building your experiment is a 3 step process
1. Identify the critical assumption associated with the concept to be tested
When you stop to think about it, there are thousands of assumptions we could test to assist with decision making when managing a business. If we tested all of our assumptions there would be no time or other resources left to run the business. Hence, you only want to test the critical assumptions. The ones that, if not validated, pose a business risk that you (or your organisation) are not willing to take.
2. Transform your critical assumption into a hypothesis statement
Your critical assumption was a thought you put into words. Your hypothesis statement is one sentence that can be validated (or invalidated).
3. Design the experiment that will validate (or invalidate) your hypothesis
Designing your experiment is only limited by your (and/or your team’s) imagination. The way you choose to render the concept of your hypothesis (how you present it or illustrate it) is called your Minimum Viable Product (MVP).
An important part of the MVP is the minimum part of it. In the design of your experiment, you will be aiming at spending the least amount of resources in order to obtain the maximum amount of learnings from your experiment.
This doesn’t necessarily mean bootstrapping your experiment. It simply means that you will make sure that whatever learnings you need to get from your experiment, you get by using the least amount of resources possible.
This can mean it will cost you nothing but a few minutes of the time of one person or tens of thousands of dollars, if that’s the only way to go about getting the information you need. Of course, the cost of your experiment must be proportionate to the financial risk associated with it.
The reason you are making the experiment is to get data that will help you with your decision making. Hence, you want that data to be reliable.
This is where you need a bit of knowledge about primary data gathering. You need to make sure the data you collect is not biased. You won’t be looking to get statistical quality data. That would take too long, cost too much and be an over kill for your purpose.
You’ll simply need the clear direction that your data in headed for.
In business experimentation instead of gathering a lot of data once, you gather a small amount of data repetitively. Although not as precise as statistical data it does provide you with a sufficient amount of information to de-risk, to a great extent, your decision. It is also a more suited approach to an environment that changes rapidly.
When deciding on the data you will be capturing in your experiment, remember these three important rules.
Your data should be:
If it doesn’t go in the direction you thought it would then you can change something in your business strategy or product or program that will make the data go in the direction you want.
You need to be able to re-produce the exact same experiment, in similar conditions and get similar results. For example, if you are testing the design of a snow shovel and are doing it during the storm of the century, the data you collect won’t be accountable.
The more people who interpret the data you collect, the deeper and richer your learnings will be. So make sure that the data captured during your business experiments is shared throughout your organisation. Ensure that everyone knows they are welcome to share their interpretations on the data. Making your experiments, the data collected and the results accessible throughout your organisation will also accelerate business experiments process as some parts/resources of one experiment can be used for others.
The more experience one has at conducting experiments, the faster and more accurately they are done.
This part of business experiments, although it may seem like the easiest, is the hardest. Learning means you are either
- absorbing completely new information (rarely the case) or
- you are changing in some way (sometimes drastically) already stored information in your brain
The second type of learning is the hardest. The more contradictory the data you have is to the one you previously had, the more difficult it is to learn from it.
This stored information in your brain will create a filter that will impact how you interpret new data.
Also, the more resources that has already been invested in a project, the more difficult it is to pivot on a previous course of action.
The benefits of using business experiments to manage
The main benefit, as mentioned previously, is to reduce the risk of your business decisions. This in turn will minimise your losses on various projects.
Another benefit, that is not obvious, is the improvement in work relationships. This happens for multiple reasons.
First, employees get a sense of empowerment. If they submit ideas to upper management with supporting empirical data, they know their idea will be considered.
Also, managers don’t need to spend as much time justifying their decisions. They let the data speak for itself. They do however need to include questioning the quality of the data into their process.
Finally, as mentioned, organisations that use business experiments on a daily basis to manage usually encourage employees to share the results of their experiments. This not only improves internal communication and efficiency it also creates an environment where mistakes, that bring new learnings, are valued.
This type of environment is essential to not only foster innovation but pro-activity.
Getting started with business experiments
If you think that using business experiments may be a profitable management approach for your business, start with one project (which will be a meta experiment) during which all higher risk decisions will be taken with supporting data. The project you select should be one that has high inherent risk within it (like launching a product in a new and different market). It should also be a type of project that is somewhat recurrent in your organisation. This will help you have a baseline scenario in order to compare the results of the meta experiment. Make sure to identify the metrics you’ll be evaluating before starting your meta experiment.
Some metrics (there are many others) you may want to look at would be:
- How long the project took from start to finish
- Overall budget
- What % of the initial planed output was achieved
- Variables pertaining to team cohesion
- Variables pertaining to employee (the ones who worked on the project directly and indirectly) satisfaction
- ROI projected vs achieved on a timeline (3, 6, 12, 24 months)
Implementing any new management approach takes a while. There is no one-size-fits-all recipe. You need to…yes you got it…experiment and find the approach best suited for your organisation.
If you need coaching or help getting started with your first experiment Baker Marketing can definitely help.
 Although MVP most often refers to a prototype of a product, it also means the representation of your hypothesis you will present to participants of your experience.
The core of every business organisation’s mission is to answer customer needs. In order to do so you must first identify and understand them.
Understanding your customers’ needs is essential but superficial knowledge is not enough to ensure your organisation’s profitability. To achieve product/market fit, the point where you answer needs better than your competitors, you must get to a deeper level of understanding of those needs.
Benefits of understanding customer needs
An added bonus to mastering customer needs (and providing a solution that fulfills them) is that every marketing dollar spent will yield higher returns than those of your competitors, who don’t have the same depth of knowledge.
A deeper level of understanding your customers’ needs will also ensure an overall better customer experience, which we already saw in a previous post on the customer experience journey, leads to higher profitability.
Ok, so now that you are convinced understanding customer needs is in your organisation’s best interest, the question you may be asking is how to go about mastering them.
First you have to identify the needs you will be fulfilling (hint; don’t stop at the needs attached directly to your product/service, also look at the ones surrounding the entire customer experience). Once you have zoomed in on the needs to fulfill, you must not only understand the needs but the whole story around them. This process requires lots of effort, time and knowledge of data gathering techniques. It isn’t as straightforward as it may seem.
As a marketer a huge part of my role, aside from finding the right customers, is to identify and understand their needs. Over the years, I learned that there are three steps to any quest aiming to either identify or understand customers’ needs.
Those steps are; Listen, observe, and empathise
The very first thing you should do when you have a business idea is to talk informally with potential customers. This mostly means listen to their answers. It also helps you figure out who your early adopters are. If it’s not possible for you to talk directly to potential customers, find people who know your potential customers inside out, and talk with them.
Don’t forget to set objectives for your conversation. Examples of conversation objectives are; to see whether the needs you think exist actually do, how they are being filled and the relative importance of those needs. In order to maximise the amount of information you take in, not only do you have to limit how much talking you will do, but you need the proper mindset. Your mind should be open and devoid of as many filters as possible. Always remember that explaining your project in length and your view of the world is just taking time away from achieving your goal. Listen.
On a side note, many of the entrepreneurs I meet are worried that someone will steal their idea before they get a chance to develop it. Unless you have a truly patentable solution (very few are), and potential customers can either beat you to market (they already operate a company in the same field) or spill the beans (to an existing competitor), you have nothing to worry about. Honestly, initial business ideas are very rarely marketable. Even if they were, almost no one wants to put in the blood, sweat, tears and go through the hell that starting a new business entails. Furthermore, even if they did, they’d most likely end up with a completely different business than yours in the end. Lastly if the threat of theft is real, there are still ways to explore the needs of potential corporate customers without spilling your own beans.
Please do not let the fear of someone stealing your business idea prevent you from engaging with potential customers.
Observation is essential to identify less obvious needs and understand all pertinent customer needs at a deeper level. Asking potential customers won’t yield the information you seek because people don’t or can’t always tell you the truth.
There are many categories of observation techniques.
Natural observation techniques allow you to observe your potential customers while they are naturally fulfilling the needs you want to address. Ideally, without them noticing you too much so their behaviours are not altered.
Such observation experiments will yield huge amounts of customer knowledge. Hence you need to ensure you set observation goals for your experiments. Your observation goals can pertain not only to your subjects’ actions but also their interactions, environments, and the tools they use.
You will most likely need to repeat such experiments many times to take in all the knowledge you will need. Alternatively, you can task multiple people to observe the same situation while giving them different observation goals.
Two of my favorite natural observation techniques are shadowing and A day in the life.
These techniques are associated with a goal of understanding a specific thought process or behaviour in a given circumstance.
They require putting the customer in a specific situation or assigning him, or her, a task and then observing. This can be followed by a question period to help interpret what you observed. It can be done face to face, remotely with cameras or on the web (such as A/B testing).
Third person observation
This technique is used in addition to one of the previous ones where the observer is someone who has a vision of the world that is significantly different from you or anyone in your industry. This technique yields much richer interpretation/insights from the data you collect.
Whenever possible, put yourself in your customers’ shoes or, even better; take the time to get to know some of your favorite customers personally. This will enable a relationship of trust and maybe even friendship (personal bonus for you) to develop over time.
Get involved in activities or causes your customers are passionate about. This will give you an even deeper understanding of their values and what is important to them.
Sharing your customers’ values is a requirement to attract them into your community. If you are unsure of what I am referring to here, see this previous post on community marketing.
The 360 view of customer needs
Applying all of these techniques to understand your customers’ needs is required to get a 360 degree view of them. Using many different perspectives to master your customers’ needs will yield rich and actionable information. It will also facilitate innovation in your organisation.
Customer Feedback Flow
Striving to understand customer needs is a continuous process. Set up processes and assign resources in your organisation to make it an integral part of your business activities.
These processes can be as simple as a quick questionnaire you send out on a regular basis, or an automatic feedback one, after a certain task is completed. Analytics reports, comments on social medias summaries or a managed (live or online) community feedback or observation reports are all valid continuous feedback processes that can yield precious information on your customers’ needs.
Be aware that this feedback is highly valuable to your organisation, if you act on it. Hence, reward your customers adequately (often a simple thank you is enough) for sharing their thoughts and concerns.
Mastering the understanding of customer needs is no small task. Your rewards for listening, observing and empathising with your customers, will be a tighter product/market fit, greater customer satisfaction and higher profitability.
 Needs are always dependant other factors. E.g. The need for a given medicine will be dependant on experiencing specific symptoms at a level that requires relief and not being allergic or prone to adverse effects to said medicine.
 The following book describes these techniques : This is Service Design Thinking – M. Stickdorn, J. Schneider et al. – John Wiley & Son
This is the last of an 8-post series on applying Lean Startup in the various phases of a start-up. In this post we’ll take a look at the tools that will accompany you in your efforts to maintain a lean startup practice in your company during the concierge phase.
Lean Startup Principles and fundamental tools
The tools suggested in this post are but the tip of the iceberg of the tools that exist to help you adhere to the principles of Lean Startup. They will vary according to the specifics of your business model. A great place to find apps to help you with your productivity is the Slack apps directory. Using thes tools doesn’t mean you are following a Lean Startup approach. You can only do this by putting into practice, on a daily basis, the various principles that underly Lean Startup.
Top Lean Startup Principles:
(Click on the theory to see an example of a book on the topic)
||Customer focus; Efficient use of resources; Just in time; small batches;
||Understand your customers’ needs then develop your product/service; Use continuous feedback from your markets to make decisions (feedback loop)
||Have a 360 view of needs, problems, issues; Empathize with your customers before you start designing your product; test multiple prototypes before going to market; transparency of information and process
||Develop in iteration; test your developments with users before going to the next step; use agile planning tools
There are also fundamental tools that come with the Lean Startup approach. These tools are:
- Management tools:
- Business model canvas or the Lean Canvas for planning.
- Experiment board to guide you with your first experiments.
- Kanban boards to ensure you are not creating bottlenecks in your production
- Metrics: Use data to make decisions whenever possible.
- Innovation accounting:
- Keeping a log of your experiments
- Innovation options to calculate the maximum value of your start-up and the associated level of risk.
Here are ideas of tools or types of tools to look for when applying the Lean Startup approach in the concierge phase (last phase) of your start-up.
Product development tools
If your product is an application or software
Continuous deployment (or delivery for certain markets) espouses most of the Lean Startup principles. It requires a slew of tools. Atlassian offers many of them with apps such as Bitbucket, JIRA and Bamboo.
If you’re creating a physical product
You may want to look at integrating your suppliers into your corporate Slack, if not already done. In order to do so, you should get the secure ($) version of Slack.
You’ll also want to establish processes that will ensure your marketing/product design and production teams communicate regularly in order to ensure market needs and trends are communicated asap throughout your value chain. Common work tools for these teams and spaces (physical or virtual) where they can easily meet on a daily basis should be available.
You will want to look into integrating as many of your data sources as possible (Analytics, CRM, Ticketing system, social media feeds, and manual data) into a robust business intelligence platform. One of the better and more agile one out there at this time is Tableau. Qlik and Microsoft BI are also good choices. IBM’s SAS and Watson are better, since they integrate AI elements, but highly likely out of your price range.
If you’re running an on-line business then you need to start looking into an agile and powerful real-time analytics solution. Google, aside from its free version, has a module approach that is neat since you can only get the packages you use. The entire 360 suite of 7 add-ons is very costly. You’ll need to make sure you get an ROI before investing in it. There are other options such as Clicky that also offers real-time analysis. Clicky integrates with Slack.
Whatever BI or analytics platform you get, the most important part is to ensure you have the resources and processes in place to maximise their returns for your company. Hence it must be part of most everyone’s job description to feed the BI databases on a regular, if not daily, basis. You’ll also need someone to ensure the data in your system is clean and the analyses are correctly interpreted.
Your experiment logs should be scraped for pertinent market information regularly. They should have their own Slack channel (or section in your intranet).
By the end of the concierge stage, you may be cranking out multiple new products in rapid fire in order to get a larger wallet share of existing customers or to satisfy the needs of new segments. Applications such as LaunchLeap that help you get quick feedback from a large number of users will help you accelerate your experiments.
HR tools and guidelines
If you aren’t outsourcing your recruiting and training then you’ll want to look for tools to make these processes more efficient.
Get a screening tool (with broad mesh) up on your website to reduce the time spent looking at non pertinent resumes. Make sure your corporate values and culture are also reflected on your website and all your social media content.
Use your FB and LinkedIn corporate pages to get referrals for potential top candidates.
Invest in training video s available 24/7. These online videos make the on boarding process more efficient and transparent.
Encourage inter-employee training and coaching. Having video, sound and recording capabilities on their computers or laptop will enable employees to share their knowledge with their peers either in real-time or asynchronously.
Have as few employee guidelines as possible. When they are absolutely necessary, keep them as broad as possible. Nothing kills creativity and initiative as well as guidelines. Just remember not to substitute good management with guidelines and you should be fine.
Finance is not my area of expertise so I won’t venture into suggesting accounting apps or platforms. What you will want to look for in your accounting system to support your Lean Startup approach are the following capabilities:
Integrating market information into your sales projections (by segment)
Enabling you to show only the financial data you want to specific categories of employees.
Although you want to remain as transparent as possible with your financial results, your growing staff and eco-system will require you to limit the financial information you share with some of them. If your system doesn’t allow you the flexibility to easily share some of the information with specific employees/partners/suppliers then you may be tempted to only share summarized data on a monthly or quarterly basis.
As you have now come to realise throughout this series of posts there is no one way to apply the Lean Startup approach. There are however wrong ways to go about it. If whatever you are doing goes against or disregards Lean Startup principles, then it’s obviously not Lean Startup. Throwing in buzzwords like MVP and pivots won’t change this.
We also saw a variety of tools used in the practice of Lean Startup. These don’t even represent the tip of the iceberg. They will also become obsolete very soon. Newer and better ones will become available. The important message is to keep looking for tools that will make you more efficient and help you achieve the minimum in MVP. These tools will also enable you to run experiments in a timeframe that was impossible only a few years ago.
These tools are the reason an iterative, experiment-based approach like Lean Startup is now viable.
Lean Startup is the essence of entrepreneurship. It’s about doing. It’s about taking only the risks you have to take in order to answer a market need with a product or a service. It’s about having some core competences but mostly about how fast you can learn what is pertinent and apply your learnings. Finally, it’s about discipline, rigor and lots of hard work.
Lean Startup is rarely sexy but then again neither is starting and growing a successful business.
This will be the second to last post of a series of how to apply the Lean Startup approach to a new business.
Until now in this series on applying Lean Startup, we started with an introduction, then looked at the ideation phase, the discovery phase and the pre-sell phase (also known as the Death Valley).
Either because you have made it this far in reading this series or, even more important, you have successfully crossed the Death Valley (pre-sell phase) and came out of it with the holy grail of a product/market fit (when the hockey blade becomes the stick on your revenue chart).
You now find yourself in the concierge phase.
What is the concierge phase
The boxes below presents a very high level summary of usual situations your start-up can expect in the concierge phase.
- Your core features all work pretty well
- You created your first (official) road map to additional features
- If you are outsourcing, you are either looking at optimizing your suppliers or taking steps to bring production in-house
- If you are manufacturing in–house, you are looking at getting decent equipment to start producing at a larger scale
- You are looking at more efficient tools to learn about your customers, markets, and environments
- You are exploring new customer segments
- You are aggressively growing your initial markets
- You are constantly reassessing the total size of your markets
- If you are an innovator in your market; you are keeping an eye out for the chasm (1)
 The saturation of the early adopters market and passage to the early majority (re. The innovation adoption curve)
- You are feeling the need to put processes down on paper so your teams has a more homogenous approach
- You realise you need a lot of processes and procedures but don’t want to bog down your agility
- You are on boarding team members at a rapid rate
- Job definitions are getting more specialised
- Your core team is trying to find a fit with their new, more limited, roles in the company (spoiler alert – some won’t adjust)
- Your core team feels as though they spend more time coaching new resources than getting work done
- Money is coming in at a decent rate from sales
- Labour costs need to be controlled as they are growing faster than your sales at times
- Extra office space and equipment mean increasing your bank margin or taking out (mostly) short term loans
- Investors are now calling you and want to hear about your scaling strategy
Too busy for Lean Startup
You are now running a small business that is experiencing the fastest growth rate it ever will, short of an acquisition.
It is easy and oh so tempting to abandon the build, measure, learn approach. After all, you know your initial market’s needs very well by now and you are crazy busy fulfilling orders, fixing issues and well, running a company.
It is a trap most entrepreneurs will fall into. Until their growth rate slows down, stalls and starts to plummet. The dirty secret of the concierge phase is that most companies’ revenues during this period don’t look like a straight hockey stick handle. That straight upward slope is just the trend of your revenues. The revenues themselves go up and down regularly. If you want your slope average to be positive and steep, you need to minimise those downs. Most times these down periods will happen for the following reasons:
- Your customer needs are changing due to a shift in the market (often due to a new competitor)
- You experience process or production failures
- Your initial early adopters market is getting saturated and you didn’t react quickly enough to open new markets
- Your early adopters markets are saturated and you haven’t figured out how to sell to the early majority customers.
Continuing to apply the Lean Startup approach during your concierge phase will ensure that any new features or internal processes will answer the needs of your customers (external and internal). It will also ensure that market changes are captured and acted upon. This does mean that many of your processes must incoporate Lean Startup elements in them. In some cases, it can also mean that the you will need the build, measure and learn processes themselves to be written down and into job descriptions.
Incorporating Lean Startup in your processes is the key to keeping your company innovative and agile as it grows.
Your product, processes, marketing and overall strategy will adapt continuously. When you need to cross the chasm to reach your early adopters, the Lean Startup approach will be your natural bridge to the other side.
In our next and final post of this series, we’ll take a look at the tools that are most useful in the concierge phase.
 The saturation of the early adopters market and passage to the early majority (re. The innovation adoption curve)
Would you have taken a bet that offered you 10 to 1 odds that anyone but Donald Trump would be elected President back in July 2016? I’m guessing you would have. I know I would have and probably bet a bundle. After all, it was obvious that most Americans thought Trump’s views were too extreme. The British parliament even debated on banning Trump from the UK. Well we’d both be poorer now and scratching our heads as how this outcome came to be.
This scenario is similar to one where an entrepreneur believes that everyone will want to buy the product he/she is making. After all, the product solves an obvious and important problem that so many people have. You wouldn’t think twice about buying it, so why would anyone else.
Let’s see the factors that can lead us to be so bad at predicting our customers needs.
There are realities you don’t even know exist
Experience, environment and nature, are responsible for shaping beliefs and thought processes. They differ from one person to the next.
Although nature (human biology) may be similar from one person to the next, environments are not. This is harder to remember given most people we exchange with on a daily basis share similar environments to ours. Experience, which is the sum of all the various situations we were in and how we reacted to them since birth, differs even more greatly from one person to the next.
Although we all know that others don’t think like we do or have the same reality, we sometimes forget to what extent they differ from ours.
This explains why designing an experiment, that captures other people’s realities, is so difficult. It also explains why it is so difficult to interpret other people’s answers accurately. The less we know about our respondents’ experiences and current reality, the more difficult it is to interpret their answers. Hence, we will tend to fill in the blanks with elements of our own reality. This will give us a distorted view.
The lesson learned here is:
- try to understand your respondent’s environment as much as you can before asking them questions
It will ensure you ask the right questions with words that will mean the same to them as they mean to you. It will also enable you to interpret their answers correctly.
Things change, sometimes overnight
Unforeseen events happen and change realities and the choice set we have. In the political sphere this could mean email scandals. In the product world it could mean new regulations, new competitors or technologies that pop up overnight.
These new realities can sometime remove existing problems. They can also give potential customers more choices as how to solve their problems. Finally, they can leave them so uncertain about their choices, that they will need a lot more time and energy to evaluate their options. This situation is well captured in the innovation adoption curve.
The lessons learned here are
- You need to act fast on survey results as environments can change quickly
- When the respondents’ choice sets are in flux, you may have some of them who can’t or won’t make choices
We are willing to put up with a lot to stay true to our identity
Certain behaviours we have take root in our own self image. When US voters identify themselves as Republicans or Democrats they don’t only refer to how they cast their ballot. They often refer to a part of their sets of beliefs. However strongly they feel against a representative of the party, they won’t vote against their identity. They’ll just find a way to rationalise their decision. This is part of the concept of cognitive dissonance.
Some consumers may see the value proposition you offer them clearly but won’t purchase your product. Because part of their identity ties in to doing the work the way they always have done it.
The lesson learned here is:
- You may need more time and effort to convince your customers to adopt your product/service when it affects their identity
Why do polls/surveys get it wrong?
We won’t reveal (to strangers) actions, beliefs or views that we think will affect their image of us negatively. This is cognitive dissonance at work.
This is why it is so important to test your market on their actions rather than on what they say. Especially when you don’t know how important cognitive dissonance is for a particular choice.
The lesson learned here is:
- Cognitive dissonance will skew your survey results significantly
Here is one last lesson to keep in mind. However wrong you may have been at predicting an outcome there is always something you can learn from the thought process that led you there. You can learn from it and improve your future predictions.
This post follows Lean Startup Experiment – Discovery Phase. It will help you find Lean Startup tools that will accelerate your experiments significantly. Many of these Lean Startup tools increase productivity and can also be used on a daily basis in your business.
None of these tools, aside from the Javelin board and the experiment log template were developped specifically to be used within the Lean Startup approach. They are simply productivity tools that enable fast and efficient Lean Startup experiments.
Lean Startup Tools
Lean Startup tools make continuous experimentation throughout your startup feasible. Many of those tools are free or cost very little. None of the tools presented in this post were developed specifically for Lean Startup. They are simply productivity tools that are used by the Lean Startup community to increase their productivity.
The following are some of the tools I find most useful and often recommend when entrepreneurs are in the discovery phase. Keep in mind there are hundreds if not thousands more of these tools out there. A bit of googling and asking around will yield you many options to accomplish the same task.
Lean Startup tools to organise
These applications are great as they often work as a checklist as well as organisers. The following Lean Startup tools are all free or have free parts to them. Click on the titles for links.
Ash Maurya has graciously made his Lean Canvas application, which is very well made, free for your first project. It will help you keep a record of the various iterations, enable you to share with other team members and print your canvas.
Free business model canvas application developed by Johan Steenkamp. It has some really great features such as various colours for your post-its, picture and sketching capabilities as well as communication features for your team.
This is a great tool to start figuring out your cost and revenue model. It will act as a check list of all the items you need to take into consideration in your revenue statement. As you progress in your startup, Budgeto will also take care of most of your accounting needs.
Lean Startup Tools to communicate/collaborate
If you don’t yet know about Slack, you must. It’s an instant messaging app, on stereoids, that allows you to connect just about any other popular productivity tool such as Dropbox, Google docs or Hangouts, Skype, Trello and hundreds more. It’s mobile friendly so it will enable you to keep in touch with your team wherever you are.
Trello is one of the many simple and intuitive project management tools out there. Trello is the only full application that still offers free access. It is very powerfull and still simple to use. Other project management platforms such as Asana and Basecamp are even more complete but don’t offer any free versions.
Definitely one of the best ways to share large files and documents. It’s as simple to use as can be and is entirely free unless you are a power user.
Lean Startup tools to run my first experiments
Javalin first developed the Experiment Board for the Lean Startup Machine a couple of years ago. They are now developing it in an app and are still in the testing phase. Until the app is out, you can get a Google docs version of it and print it out. Watch this great video tutorial, from Grace Ng, of how to use the Experiment board.
This book contains over a dozen techniques to help you conduct offline experiments. Each technique is well explained and illustrated with an example. If you’re not familiar with data gathering techniques, it’s the best place to start.
Powerful online survey creation and data analysis application. It’s free for basic forms and data crunching. It has more survey question options and data analysis capabilities than AYTM and GCS. You must provide your own participants list.
Google Forms enables you to create surveys that you can send to your own participants list. Google Consumer Surveys provides the participants and you only pay for completed questionnaires. Pricing starts at $0.10USD per completed survey.
Similar to Consumer Surveys AYTM offers highly targeted participants to answer your surveys.
Pricing starts at about $1USD per participant. AYTM boasts over 25 million survey or experts panel participants.
As of writing this post, I haven’t seen any experiment log templates or application to facilitate the keeping of a journal of your experiments.
Hence, I created one for my own use that I will share with you. It’s a simple Excel spreadsheet that you can modify as you see fit. The important part is to keep your rows constant over time so you can have a base to compare.
Keeping an experiment log is a pain and requires some time and effort. Hence, if you don’t plan on going to VCs for funding, it’s not a must to keep one.
An added benefit of the log is that of a training tool when you onboard other members. Careful reading of this journal will help your new recruits know about your young corporate history and learn from you previous mistakes and wrong turns.
Note: I will add the experiment log template to this post very soon.
Tapping into the Lean Startup community
Some of the most important resources found in Lean Startup are its local and international communities. It is by far the entrepreneurial community that is the most generous with its time and knowledge that I have encountered.
Locally, you have Lean Startup Circles members that meet periodically to learn, practice and exchange on Lean Startup experiments, tools and resources. Circles have experienced coaches that can help you with any part of your experiments.
You can locate the Lean Startup Circle nearest you by consulting the list on the Lean Startup wiki. Most of them, such as the Montreal LSC, have a Meetup page, Facebook page and/or website where you can register to become part of the community.
Once you are part of a Lean Startup Circle community you will gain access to the Lean Startup Slack channels by asking your local organisers. These channels encompass hundreds of members that form a help community.
If you are stuck somewhere in your experiment, are looking for a tool, experiment design ideas, want to know how to go about testing a foreign market, your local and virtual Lean Startup communities will be there to help.
The next phase
Once you have acquired sufficient knowledge on your various stakeholders and have attained a certain level of validation with your business model, you will want to put it to the test.
The next phase will be about validating your business model where it counts; in the market. It is the true acid test. This phase is also sometimes referred to as the Valley of Death. It is when most start-ups end up dying in the Lean Startup approach.
This phase will also be when you start developing your product/service. The good news is if you can’t find any way to have your product/service fly in the market, you will not have spent months or years working on it.
The next post will guide you through this phase using Lean Startup. It will show you how Lean Startup can help transform, some (no, not all) ideas that would have died, into lucrative ventures. We will also present tools and tactics that can help you survive these difficult times.