Many founders suffer from optimism bias, which prevents us from challenging our own ideas. We develop something we believe in, and show it to a few friends and family who confirm our belief. And by the time we put it out into the real world, our belief in our success is so great that we expect everyone else will flock to the idea!<\/p>\n\n\n\n
Even when these negative opinions increase, our optimism makes us deaf to critics saying, “This might not work<\/a>.\u201d And this continues on through the launch. But what was once just an opinion, by this point, has turned into a more harmful and evident lack of sales.<\/p>\n\n\n\n That\u2019s one of the main reasons why 80% of all product launches fail. There\u2019s simply no demand after launch. But it shouldn\u2019t come as a surprise! There also wasn\u2019t any before the launch \u2014 had the product owners cared to carry out some fake door testing and listen? And so, companies spend an average of 15 months and $300,000<\/a> on developing new products doomed to fail.<\/p>\n\n\n\n What are the best solutions the industry has come up with so far?<\/p>\n\n\n\n Surveys and widely used focus groups don\u2019t work<\/a> as they are all based on opinions<\/strong>.<\/em> While opinions can be important, asking the right people is more important. <\/p>\n\n\n\n Even if you have a perfectly structured survey, you can\u2019t be sure that you’re asking the right people. It’s possible they bought something similar. They might have even been your previous customers. But there’s no guarantee they’re the right audience for you now. And as a result, they might not buy what you\u2019re building right now. <\/p>\n\n\n\n So how can you ensure you have the right insights from the right people before investing huge resources in developing your product? <\/p>\n\n\n\n That\u2019s what we\u2019ll be looking at in this article. We\u2019ll cover the best methods currently available to product owners, like the painted door test or fake door testing, and offer some insights into what the future holds. By the end of this article, you will know:<\/p>\n\n\n\n So, let\u2019s jump right in!<\/p>\n\n\n\n While surveys and focus groups measure what people think, there\u2019s one method that many companies use, which is based on people’s actual behavior. <\/p>\n\n\n\n It\u2019s called a Painted Door Test<\/strong> or Fake Door Testing<\/strong>. And the concept is really simple. The goal is to mimic a real store and have people walk through the real sales process \u2014 including buying! \u2014 only to discover that it was a \u2018Fake Door.\u2019<\/p>\n\n\n\n The most typical example is to create a seemingly-real online store. You showcase your non-existent product as though it exists, with a price, estimated shipping, and everything else as though it were a real online shop. And then, you drive traffic to that page via Facebook ads. <\/p>\n\n\n\n Then, you measure who actually bought it, your conversion rate, and the return on your ad spend. All else being equal, this is a powerful indicator of what your real product\u2019s metrics will be, as it\u2019s measuring the actual purchase behavior instead of asking if you\u2019ll buy this or not. <\/p>\n\n\n\n But wait\u2026 a shop that pretends to sell something that doesn\u2019t exist? Isn\u2019t that a scam? <\/p>\n\n\n\n Kind of, but not really. For starters, don\u2019t worry. It\u2019s not stealing! Whoever buys your non-existent product gets an immediate refund with a message that the product is not yet available. <\/p>\n\n\n\n However, this system definitely has its drawbacks \u2014 as the name implies, it\u2019s\u2026 fake! <\/p>\n\n\n There are many benefits to Fake Door testing that can\u2019t be achieved with surveys, focus groups, and other industry-standard methods. Among these are the ease of setting it up \u2014 you can do it by yourself, with minimal digital experience \u2014 the opportunities to test different angles and the accuracy of the data it provides.<\/p>\n\n\n\n Surveys and focus groups <\/a>try to get relevant audiences to answer questions related to your product and their buying decisions. But this presents 2 challenges: <\/p>\n\n\n\n It\u2019s nearly impossible to narrow down your audience perfectly through surveys and focus groups, as the selection is based on the subjective opinion of the founder. And even if it is run by a capable marketing team, there\u2019s still no guarantee that they\u2019ll define the right audience on the first go 100% of the time. Expecting anyone to accurately predict this every time is misguided!<\/p>\n\n\n\n But let\u2019s say that you do find the perfect audience; what\u2019s to say that they\u2019re answering truthfully? Not only that they\u2019re not knowingly lying, but even in the best-case scenario, how can you be sure that what they think they\u2019ll do is what they\u2019ll actually end up doing? <\/p>\n\n\n\n This problem, explored in depth in The Mom Test<\/a>, has many roots. The primary example \u2014 and where the book got its name \u2014 is the unreliability of asking your mom whether she likes your idea\u2026 of course, she\u2019ll say yes! Would she buy it if it wasn\u2019t your idea, though? How can you be sure? <\/p>\n\n\n\n These 2 problems plague current methods to gather insights into your product and audience. But not Fake Door testing!<\/p>\n\n\n\n One of the most important benefits of the Fake Door testing method is that it tests the actual purchase intent<\/strong> of customers. It\u2019s not based on opinions and desires. It only shows what customers will actually buy.<\/p>\n\n\n\n And by playing around with the price, audience, and messaging on the page through careful A\/B tests, you can iterate through product cycles quickly until you land on an idea that is guaranteed to work!<\/p>\n\n\n\n Building on the previous benefit, you can also test your audience. Many early founders panic when their product doesn\u2019t immediately take off. But you shouldn\u2019t make any rash decisions and trash your idea too soon. You might just be targeting the wrong audience. <\/p>\n\n\n\n By targeting different groups and monitoring the results, you can clearly see if the audience you are targeting is buying your products or not. Then you can test different interests, countries, and demographics until you find the perfect audience(s) for your product!<\/p>\n\n\n\n Once you think you\u2019ve found the right audience and price, and have a significant amount of visitors on each variation, change the visuals, messaging, and overall positioning to see how the audience reacts. <\/p>\n\n\n\n This helps you hone in on your unique selling proposition, improve the way you communicate the value of your product, and even play around with the features and benefits you\u2019re thinking of including in your product.<\/p>\n\n\n\n Many times, a feature you think is central to your product actually turns out to be less important than something you\u2019d overlooked!<\/p>\n\n\n\n Just be aware that it\u2019s dangerous to change things too quickly. You need to have at least 1,500 – 2,000 people landing on each variation to be able to derive the right conclusions. Otherwise, you might end up killing a version that indeed had lots of potentials. <\/p>\n\n\n\n While Fake Door testing is more accurate and reliable than focus groups and surveys, the method still has some drawbacks because, well\u2026 it\u2019s fake! Let\u2019s look at some of the main problems you\u2019ll run into with a Fake Door testing strategy.<\/p>\n\n\n\n When a customer places a payment, they receive a refund immediately. <\/p>\n\n\n\n While they\u2019re not technically robbed or cheated out of any money, the process does leave them feeling cheated and disappointed nonetheless. They went through the ordeal of reading through the sales page, fishing for their card details, and filling everything in \u2014 only to be presented with an immediate refund! <\/p>\n\n\n\n It\u2019s only natural for those customers to go off thinking, \u201cIf they didn\u2019t have it in stock, why not just tell me at the beginning and save me the pointless hassle?!\u201d<\/strong><\/em><\/p>\n\n\n\n Sometimes the disappointment caused is big enough to lose their future business and even receive negative press!<\/p>\n\n\n\n Many brands can\u2019t openly and transparently discuss their products with customers. This isn\u2019t only because of the above problem but can also be due to R&D secrecy and company IP privacy policies.<\/p>\n\n\n\n This leads to many large companies not using their real brand names during testing and coming up with new \u2018fake\u2019 brands. This, in turn, means their products don\u2019t benefit from their own brand awareness and appeal, and the resulting data is not indicative of real-world scenarios.<\/p>\n\n\n\n Without real brands, there are no relationships\u2026 it\u2019s that simple!<\/p>\n\n\n\n And even for brands who do take the risk of using their real name, without the very real promise of a product at the end of the testing journey, why should they stick around?<\/p>\n\n\n\n Customers don\u2019t get any value \u2014 hence there\u2019s no relationship. And without a relationship, you can\u2019t really develop a community, ask them questions, get to know your customers, and gather insights. <\/p>\n\n\n\n Another issue with Fake Door testing is that creators can\u2019t get the right insights from their metrics in silos. If everyone is testing their products independently from one another, how can they know how successful their launch is going to be?<\/p>\n\n\n\n Is a 20% subscription rate good? For that product and that audience? What if the price was $50 cheaper? Should the subscription rate bounce up to 25%? Or 30%?<\/p>\n\n\n\n Not having industry benchmarks that take into account things like product niche, audience, location, season, price, and more, limits the usefulness of the data of Fake Door testing and limits the amount of decisions creators can make.<\/p>\n\n\n\n If you\u2019re a technical founder or have a team of experienced developers and marketers, congratulations!<\/p>\n\n\n\n But for the rest of us, it can be hard to create a fake door landing page, get a domain and hosting set up, connect a Stripe account, set up all the Google tags and dashboards, run Facebook ads, set up an email marketing service, and connect all the necessary tools to automatically send surveys to those people who subscribed.<\/p>\n\n\n\n Fake Door Testing is relatively good, or at least better than no testing at all! However, there has to be a better way. One that is more transparent allows creators to establish deeper connections with their audiences and help to build a community prior to launch that will increase the chances of making informed decisions at every single step. <\/p>\n\n\n\n After 3 years of testing and experimenting with different formats, running hundreds of tests for established and newly-created brands, building dozens of communities, and collecting petabytes of data that accurately predicts launches, we distilled all the elements that are required to build a better testing system.<\/p>\n\n\n\n Most importantly, we found a way to upgrade the Fake Door Testing model to more transparent testing \u2014 what we like to call Glassdoor Validation. <\/p>\n\n\n\n Instead of faking a website and putting nonexistent products on a landing page, what if you could talk openly about your product\u2019s status and ask your potential customers to reserve it? Rather than fooling them into \u2018fake buying\u2019 it and refunding them, just offer them a discount later in exchange for a reservation now. It\u2019s simple, it\u2019s transparent, and it\u2019s ethical.<\/p>\n\n\n\n You get all the benefits of Fake Door testing:<\/strong><\/p>\n\n\n\n With none of the disadvantages:<\/strong><\/p>\n\n\n\n And by running this for 100s of different product launches over the past 3 years, we also built a sizeable benchmark database \u2014 that is constantly growing with every new launch \u2014 and refined the prelaunch process so that even the least technical team members can handle a campaign on their own.<\/p>\n\n\n\n It turned out to be so effective that we eventually built Prelaunch.com<\/a>. To help other founders improve their chances of success, so that prelaunching products was not just some internal secret methodology our team could run but something that any founder or enterprise, big or small, could use to validate their own products independently.<\/p>\n\n\n\n Prelaunch.com<\/a> is a product validation platform designed for creators to prelaunch, showcase, and validate their coming-soon products. The system revolves around 2 easy-to-build pages:<\/p>\n\n\n\n On the first page, you show the concept or idea of the product. Visitors can read about it and look through the pictures. And if they\u2019re interested enough to scroll down, they\u2019ll find a button that they can use to subscribe and learn more. <\/p>\n\n\n\n This page tests for interest in the concept itself, regardless of the cost. If money were no object, would people want to use your product?<\/p>\n\n\n\n On the second page, you show people who have shown their interest in the concept how much it will cost them. And you offer a small discount in exchange for a small deposit they can place to reserve the discounted price.<\/p>\n\n\n\n This page tests the price people are willing to pay. <\/p>\n\n\n\n Then in the dashboard, you can see whether people love your idea or not and, most importantly, if they are ready to buy it. <\/p>\n\n\n\n Why is this so powerful? <\/p>\n\n\n\n Because by requiring people to leave a monetary reservation, they\u2019re proving their actual purchase intent. People pulling out their credit cards and reserving the products \u2014 this is the best validation ever. <\/p>\n\n\n\n Using Prelaunch.com<\/a>, both of these pages are easy to build thanks to the built-in AI copywriter \u2014 trained on hundreds of successful prelaunch pages \u2014 and the guided drag-and-drop page builder and included templates that let you know the best way to layout your pitch. This removes the technical knowledge that Fake Door testing requires you to have in order to test your product. <\/p>\n\n\n\n But it\u2019s by leveraging the powerful insights of the dashboard, and getting real-time feedback based on relevant benchmarks, that Prelaunch.com<\/a> truly redefines the validation system.<\/p>\n\n\n\n With all that data being collected and the value provided by the predictions, there needs to be a central location where you can monitor the state of your prelaunch campaign. Prelaunch.com<\/a> empowers your validation with a powerful dashboard that gives you insights into your product\u2019s performance. Both within the variations you create and also in comparison with similar products in your niche and price point.<\/p>\n\n\n\n All this helps you intuitively discover whether you are in the top 1% or below the market average:<\/p>\n\n\n\n On the left side, you can track how many visitors landed on your page. Due to the rigorous testing and comparing that goes on, we recommend a minimum of 3,000 visitors per variation. This gives your results enough statistical significance to be able to make accurate predictions.<\/p>\n\n\n\n In the middle is Concept Validation<\/a>. This shows the number of people who subscribed to learn more about your product and their ratio compared to the total number of visitors. They hadn\u2019t seen the price yet, so this is just a measure of market interest in your idea.<\/p>\n\n\n\n And on the right is the Price Validation. This shows the total number of reservations and the ratio of these compared to the total number of visitors. As people who reserve have seen the price, this metric tells you whether or not people are ready to pay for your product.<\/p>\n\n\n\n For example, if your Concept Validation is Great, but your Price Validation is Bad, that means people are interested in your product but are not ready to buy. You can play with the price, increase it and decrease it to look at the data and see how it goes. <\/p>\n\n\n\n But when both metrics are Bad, then you need to make some significant changes to your page \u2014 and maybe even your product \u2014 and start a new variation!<\/p>\n\n\n\n More important than any of the above metrics is your Prelaunch Score. This is your product\u2019s health score, which shows how well you are doing by combining, weighting, and analyzing 30+ metrics. <\/p>\n\n\n\n The dashboard also shows you how well you are doing compared to similar products in your category and price. The following chart shows important metrics, such as whether or not you are in the Top 1% of your industry according to your subscriptions, reservations, or other ratios. <\/p>\n\n\n\n These comparative metrics help you understand not only how well you are doing but also how well you are doing compared to others. <\/p>\n\n\n\n Of course, these powerful simplified metrics are great for getting a clear real-time image at a glance, but some of you will want more detailed data. How much has been spent on ads? What\u2019s the cost per ad click? How many people are clicking on your ads?<\/p>\n\n\n\n More advanced users appreciate these powerful charts that show you how each of your variations is doing, as well as metrics that will help you understand what you need to change when things are not great:<\/p>\n\n\n\n Some things can\u2019t be measured in pure numbers, though. For all this qualitative data, Prelaunch.com<\/a> uses advanced surveys to gather in-depth relevant insights into your potential customers and their thoughts on your product.<\/p>\n\n\n\n When your potential customers subscribe or reserve products, they automatically get these surveys. But these are not just any old surveys. These are targeted surveys aimed at your ideal target audience who just proved that they were your buyers when they gave you money for your non-existent product. That is credible proof that they want to have your product and are ready to help you improve it. <\/p>\n\n\n\n There are lots of potential questions you can ask your audience. But surveying our users\u2019 surveys, the most useful questions product creators tend to ask include:<\/p>\n\n\n\n All these responses are gathered in an easily digestible dashboard, showing you the number and percentage of people who agreed with each point:<\/p>\n\n\n\n Imagine getting access to what your favorite brands are working on before they are available to the larger public. And being able to reserve what you like, give valuable feedback, and get significant discounts. That\u2019s what Prelaunch.com<\/a> is to consumers. <\/p>\n\n\n\n From a consumer\u2019s perspective, Prelaunch.com<\/a> is a unified platform of coming soon products. A marketplace where they can reserve products that are not live yet by placing a small deposit and help in their creation by engaging with the product creators. <\/p>\n\n\n\n Reservations are 100% risk-free for consumers. When creators decide not to move on with production, consumers get a full refund. And consumers can cancel their reservations whenever they want to, as long as creators haven\u2019t started shipping. <\/p>\n\n\n\n This marketplace is where many visitors will organically discover new products, including yours. Serving as a powerful and free traffic boost for your campaign, a pool of people interested in innovations who might join your early-stage community and people who will end up pre-purchasing your product!<\/p>\n\n\n\n Prelaunching is the most accurate method that not only predicts how well you are doing and how well you will<\/em> do once you launch your product but also helps you find out where your problems are and what you need to change to achieve better results. It helps creators save hundreds of thousands of dollars otherwise spent on product development and production \u2014 on products that nobody really wants. <\/p>\n\n\n\n Prelaunching also uncovers untapped opportunities, as in the case of Kitty Spring cat water fountain<\/a>. Initially, Kitty Spring\u2019s creators were planning on launching their new product at a price point of $29. After months of research, they had landed on that as the ideal price. No competitors were charging more for similar products, so it was safe to assume that customers wouldn\u2019t pay more. But after a few weeks of validation on Prelaunch.com<\/a>, they discovered that the market was ready to pay $44!<\/p>\n\n\n\n They were able to increase the price by over 50% without affecting conversion rates! They launched Kitty Spring at $44 and ended up generating $1 million in revenue in a few months!<\/p>\n\n\n\n And Prelaunching goes beyond validation \u2014 it helps establish long-lasting relationships with your customers, be transparent about the product status and develop products together. You have a team of ten? That\u2019s great. Now imagine you have a team of a thousand people who are your target customers as well and are ready to give you the feedback you need to improve your products at every stage. <\/p>\n\n\n\n So rather than just launching your next product without knowing how it will perform, rather than spending 18 months and $300,000 developing it, rather than stressing out and worrying about your shrinking budget and diminishing returns\u2026 why not validate it first?<\/p>\n\n\n\n Launch with confidence by running your own Fake Door test. Or take the easy and fast route to reliable results to product validation that compare you to the market by prelaunching before you launch on Prelaunch.com<\/a>.<\/p>\n ![\"fake](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/fake-door-testing-1-1024x683.jpeg\")
<\/figure>\n\n\n\n\n
Fake Door Testing: Actual Purchase Behavior Requires Skin in the Game<\/strong><\/h2>\n\n\n\n
![\"banner](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2025\/03\/Frame-4560-1-1.png\")
\n <\/div>\n\t\t\t\t\t Advantages of Fake Door Testing<\/strong><\/h2>\n\n\n\n
![\"Advantages](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/Advantages-of-Fake-Door-Testing-1024x683.jpeg\")
<\/figure>\n\n\n\n\n
Testing the Willingness to Pay<\/strong><\/h3>\n\n\n\n
Testing the Target Audience<\/strong><\/h3>\n\n\n\n
Testing the Right Positioning & Messaging<\/strong><\/h3>\n\n\n\n
Disadvantages of Fake Door Testing<\/strong><\/h2>\n\n\n\n
![\"disadvantages](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/disadvantages-of-Fake-Door-Testing-1024x1016.jpeg\")
<\/figure>\n\n\n\nCustomer Disappointment<\/strong><\/h3>\n\n\n\n
Brand Image Suffers<\/strong><\/h3>\n\n\n\n
No Long-Lasting Relationship with Customers<\/strong><\/h3>\n\n\n\n
Absence of Industry Metrics<\/strong><\/h3>\n\n\n\n
Technical Knowledge<\/strong><\/h3>\n\n\n\n
From Fake Door Testing to Glassdoor Validation<\/strong><\/h2>\n\n\n\n
How Prelaunching (aka Glassdoor Validation) Builds on Fake Door Testing<\/strong><\/h3>\n\n\n\n
\n
\n
How does it work?<\/strong><\/h3>\n\n\n\n
Testing Interest<\/strong><\/h3>\n\n\n\n
![\"testing](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/testing-interests-1024x683.jpeg\")
<\/figure>\n\n\n\nTesting Price<\/strong><\/h3>\n\n\n\n
![\"testing](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/testing-prices-1024x683.jpeg\")
<\/figure>\n\n\n\n![\"validate](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/validate-your-market-banner.jpg\")
<\/a><\/figure>\n\n\n\nAchieve Greater Understanding with Smart Dashboard Insights<\/strong><\/h3>\n\n\n\n
![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-dashboard-1-1024x207.jpg\")
<\/figure>\n\n\n\n![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-dashboard-2-1024x172.jpg\")
<\/figure>\n\n\n\n![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-score.jpg\")
<\/figure>\n\n\n\n![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-metrics-1024x511.jpg\")
<\/figure>\n\n\n\n![\"facebook](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/facebook-ad-campaign-data-1024x431.jpg\")
<\/figure>\n\n\n\nGetting Insights from Your Customers<\/strong><\/h3>\n\n\n\n
\n
undefined<\/li>\n\n\n\n
undefined<\/li>\n\n\n\n
undefined<\/li>\n<\/ul>\n\n\n\n![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-customer-survey-1024x560.jpg\")
<\/figure>\n\n\n\nThe Marketplace of Coming Soon Products<\/strong><\/h3>\n\n\n\n
![\"prelaunch](\"https:\/\/prelaunch.com\/blog\/wp-content\/uploads\/2023\/12\/prelaunch-marketplace.jpg\")
<\/figure>\n\n\n\nPrelaunch Your Way to Success<\/strong><\/h2>\n\n\n\n
\n <\/div>\n\t\t\t\t\t