The Three Greatest Survey Questions Ever

P G T The VP of a Fortune 100 company recently asked for some advice. They were heading into their peak selling season that would last only three months max, and they only had an ability to measure revenue from the website, nothing else. They did not have any web analytics tool.

Her question was: Which analytics tool do you recommend because we want to improve our website and increase sales.

My answer: Don’t implement a web analytics tool, implement a short website survey that would have just three questions.

Surprised?

There were a number of factors behind my recommendation but one of the main ones was that if you want to move really really fast and you don’t know anything then it is better to ask the customer what you should do rather than implement a tool and try to figure it out based on clicks. You will get better insights, faster than you can imagine.

Web analytics is awesome (you do expect me to say that don’t you! : )), is has to be a critical part of your web strategy because it can yield great insights. But for the fastest way to understanding customer problems there is nothing like asking the customer herself / himself (and yes it will lead to improved revenues).

Given the time crunch going to the customer made the most sense, implementation of the Web Analytics tool would happen and after a month or so and slowly over time ClickStream data would play a increasingly important part in decision making. In due course it would achieve parity with the Qualitative data (but hopefully never overshadow it).

Ok so survey got the nod, what questions to ask?

[UPDATE: Qualroo is an affordable survey tool to create the survey below, it also has a user-friendly survey invitation model. Another option is Google Consumer Surveys, it has a free version with the questions below.]

Here are the three questions no survey can live without (and often a survey can be pretty awesome with just three questions):

What is the purpose of your visit to our website today?

    It can also be framed as "what is the reason for your visit today" or "what task are you looking to accomplish on our website today" or "why are you here today".

    Few website owners have a good understanding of why people visit their websites and this is one of the best possible ways for you to find out that critical piece of information. Answers that you will read, the distributions you will get between different primary purposes, will be eye opening for you, and they will help explain so much of the "weirdness" you see in your ClickStream data (and yes even your path analysis).

Were you able to complete your task today?

    If you like conversion rate and revenue then you are going to love this one. An extremely simple question that asks the survey takers to self report their own perception of your website's effectiveness in helping them complete their tasks.

    With this question we don't have to rely on our hypothesis such as if the visitors saw this page then they might have gotten their question answered or if I am measuring conversion then I can understand how effective my site is or our site is doing great because we just launched a massive quarter of a million US dollars redesign. We have the customers voice telling us exactly how well the website is performing when it comes to delivering the goods.

Now in case you want to know exactly what you need to do to improve the numbers in the graph, you'd ask a third question:

If you were not able to complete your task today, why not?

    It can also be framed as "If you were able to not complete your task please explain" or "Why were you not able to complete your task on our website today" or simply as "How can we improve our website to ensure you are able to complete your task", etc.

    The answer to this question is open text VOC, Voice of Customer. It is optimal to refrain from making this a drop down with choices like: Improve internal search, Update the navigation, and Provide more product information etc etc. Let the customers talk, give them a chance to tell you in their own voice the reasons and provide you with suggestions. It works better than you guessing what the answers might be and suggesting those.

    Analysis for this question is done by categorizing the responses into common themes and then rating the % of times each theme is occurring in the open ended VOC for those who are not able to complete their task. This is your simple and direct to-do list of issues directly from the horse's mouth about what you should work on in order to improve your website experience for your customers.

These three simple questions that will be the source of a wealth of insights when it comes to helping your deliver on your customer centric strategy. [Want more: Got Surveys? Recommendations from the Trenches.]

ClickStream data is often missing the context, in that absence we overlay our own opinions / experiences / perspectives to make sense of it all. But with answers to these simple questions you’ll have the context to make sense of it all.

What do you all think? Have you tried surveys? Do you have a golden question or two that you use? Please share your own tips and feedback on my question suggestions above via comments.

PS:
Couple other related posts you might find interesting:

Comments

  1. 1

    Nice post Avinash. I especially like this question, as it reminds me of something else:

    'Were you able to complete your task today?'

    I often like to compare internet business to offline business. We have this big supermarket here in Germany (Kaufland) and every time you buy something you're asked something along the lines of 'Was everything alright?'. They started doing this a few months ago…

    I'm really wondering, if they ever get any constructive feedback from such questions in the offline world. For example, I would never say: I didn't appreciate the fact, that I had to go upstairs to the third floor in order to find the dairy products & then go back down to the first floor, because that's where the beverage is (bad example, but you get the drift, right?).

    I think being anonymous on the web helps, because visitors can give whatever feedback they have on their mind, without possibly coming off as unfriendly or odd.

    On the internet, forms and collecting user feedback (if the surveys are short!) seem to be really great tools: Somebody not familiar with the web might not expect to get much positive feedback from that (in case it's not working well offline?), but I'm often tempted to give constructive feedback when I see a form with a question, that I know an answer, too.

    Don't mean to overanalyze this, but I think it's similar to the need we have to socialize (that other marketing techniques thrive on): If we think we have a good idea, some of us want to tell the webmaster. Why not do it after all?;-)

    Reminds me of some web design or usability book, I read, in which the author wrote something like 'You wouldn't believe it, but people actually DO use those forms' ;-).

  2. 2

    I just realized, that I shouldn't have narrowed it down to this one question.

    And I should have put 'beverages are', I guess ;-(

  3. 3

    Great Point, Avinash:

    ClickStream data is often missing the context, in that absence we overlay our own opinions / experiences / perspectives to make sense of it all.

    One of my greatest challenges is managing these overlays when I publish reports. The differing views of the same data based on personal experiences causes debates that get pretty heated at times. Because of the broad range of potential interpretations I am very careful when using click-stream. I agree that a couple of usability questions (especially like the ones you cite) really help to cut through the ambiguity.

  4. 4

    Great post Avinash. My only observation would be that many people don't complete these surveys. And without web analytics, the site owner's wouldn't know which percentage of visitors chose to complete the survey (i.e. do the opinions represent 'just' the few vocal fans or are they are real cross-section of your visitors…) Maybe combine the survey with a really simple analysis of survey completion vs. abandonment?

    Looking forward to your book.

    Chris

  5. 5

    Chris: I would encourage you to experiment and give it a try, you'll be surprised. I was.

    This is an actual example: Our internal company audience was skeptical but when we launched a 20 question survey (!!) we routinely got response rates of between 6 and 24%. That compared to internet standard survey response rate of one percent.

    Two interesting lessons learned: 1) People love to talk if you give them a chance, they are after all your customers. 2) You do have to time the presentation of the survey right – experiment with the options of pop up or pop under or on exit etc.

    On a decent sized website you only need around 300 responses to get statistically significant results and around 1,000 if you want to slice can dice the data to measure micro segments of your questions / customers.

    Watching the response and abandonment rate is, as you say, critical.

    Thanks so much for sharing your comments.

    -Avinash.

  6. 6

    I would suggest integrating the survey data with your clickstream data. Being able to group responses and segment users with certain reponses gives you valuable insight to how they interacted with the site. Using a really good segmentation engine or reprocessing engine you can see how the interactions (behavior) affected the qualitative data.
    CSI investigators look at all evidence, so they know the how, what and where. They also interview those that may have information about the crime to understand the why. You need both for the full picture.

  7. 7

    Avinash,
    While you are 100% correct that voice of customer is a great compliment to traditional analytics, it is not just about a "survey". Without a accurate, precise and reliable measurement of voice of customer, the data we gather can actually do more harm then good. It is not only about getting voice of customer, but getting it at the right time, in the right manner.

    To your 3 question approach, they are clearly 3 important questions, but not enough! Primary purpose of visit, completion of task and why not able to complete are all important. But we are missing a very important thing. If someone comes to your site today, and after a gruesome experience, is finally able to complete the task they set out to (let's say for example, download an update to the software), simply looking at those three questions will give you a false sense of security, that all is good.

    If they were very dissatisfied with the experience, and as a result are likely to say negative things about your site/company, and not purchase from you in the future, you will have missed all of that with the 3 question survey.

    Don't fall into the trap that there is only one (or three) things you need to know. Our customers are very complex and we cannot simply understand them with one or three questions.

    Ultimately, the one concept that has been proven over the years to predict financial performance, is satisfaction. But we cannot simply ask that one question either. We need a system of attributes to measure that include your magic 3, but also what drives satisfaction, overall satisfaction and what is likely to happen as a result of the experience.

    -Larry Freed
    http://www.ForeSeeResults.com
    http://www.FREEDyourmind.com

  8. 8

    Larry my friend you are right of course. The implication in my post is not so much that you should only ask three questions but that these are three you should always ask because, IMHO, they will be chock full of actionable insights.

    I have loads of experience with ForeSee, your tool, and think very well of it. ForeSee asks more than three questions (as does iPerceptions). I encourage experimentation to figure out the right number because there is no correct "off the shelf" answer that one should ask 28 questions. Each business will find the right number of valuable questions for their unique circumstances.

    Makes sense?

    Thanks so much for sharing your valuable perspective, it is always welcome.

    -Avinash.

  9. 9

    I sort of agree with what Larry says, but I think you could easily put this fourth question in the third question by changing that question to "or what else did you find annoying?" or something along those lines (or even add a fourth question).

    I don't really think Avinash – who seems to be extremely intrigued by the (growing) complexity of the web, user behavior and web analytics ;-) -believes all it takes is looking at those three questions. The beginning of this blog post makes it sound more as if he was trying to provide a quick way to improve the website and thought those 3 questions would be the most effective solution for that 'quick fix'.

    However, I'm wondering why you would deter a fortune100 company from using web analytics, if they are doing nothing whatsoever already? Does this have to do with the short amount of time the company apparently had in order to improve their website for their peak selling season?!

  10. 10

    Avinash hadn't posted when I began writing my post and the last paragraph was for avinash, and not directed at you Larry, btw, just so there'll be no misunderstanding :-)

    I think the more questions you can ask the better probably, but I guess it all comes down to the amount of traffic you get..because the more questions you ask the less likely visitors will be to reply to them..and you need a big enough sample for your survey data to be statistically significant/insightful in general, I guess…

    oh but then again, if you ask too many questions (and too complex ones) your data might get skewed, too, as some survey takers might want to just get it over with and thus not think as profoundly about the questions & their replies…so you probably need to find a balance

  11. 11

    I agree with your approach, but would either add or replace a question with the below question or two:

    Would you recommend this website to a friend? If no, why not?

    Keep up the good work!

    ps – I certainly agree with your approach of going beyond just usability (and even optimization) and just ask your customers, too.

  12. 12

    Hi Avinash,

    Great post! I agree with this immensely. Mostly because, this is the quickest way to make the right improvements to the site w/ such a short peak season. Of course, an analytics/clickstream tool is always necessary however, if I had only 3 months to work with, I'd opt for the surveys just because, you can go down so many ratholes trying to infer customer intent with a analytics/clickstream tool. When a customer tells you, I came to download and your download process sucks, there's not much to have to infer from that. You go fix your download process.

  13. 13

    How timely this article is for me.

    I'm debating between hiring a analytics consultant or running a survey to get a better idea why we are losing customers from when they click on the BUY button to actually finishing the check out.

    Of course one issue is that our site is brand new so that may have something to do with this issue but I'm concerned that requiring registration prior to check out is depressing orders.

    Unfortunately I'm not nearly knowledgeable about using Google Analytics to fully understand the reports (I need to spend time digging deep into Avinash's blog to get smarter :)

    Anyway, I think we will start with the survey and try to intercept browsers as they leave the site. For smaller site I found SurveyMonkey.com to be a great tool to easily create surveys and they give you great tools to analyze the results

  14. 14

    Avinash,

    The spirit of your questions is spot-on. The implementation is what I would quibble with. Having been involved with many surveys that have attempted to ask those questions (or some variation), I can tell you that the term "task" can sometimes be confusing for the average person.

    What was my "task" when I came to your site this morning? I can't answer that question. I didn't think of what I was doing as a "task". Ok, so did I have an "objective"? Nah, that doesn't capture it either.

    I don't think there's any easy solution here. As I've posted on my site, I think the objective that we as marketers are trying to achieve by asking the questions is what the site visitor's expectations were, and whether or not those expectations were met. But I wouldn't use the word "expectations" in the survey question either.

    — Ron

  15. 15

    Avinash,

    This was a great post that we are actually implementing today. We are an online survey software company and we know that our site is not set up well on the home page. Our software is great and as soon as someone tests it out they love it. The problem is getting them to test it.

    We are going to practice what we preach start surveying our prospects and clients.

    Thanks for the great idea.

    Ryan

  16. 16

    I love your cut-to-the-heart-of-the-matter attitude, Avinash. Details aside, your three golden questions are essentially what I ask when I do customer interviews about product needs.

    I don't ask "what improvements would you like us to make to the product?" I ask "what are you trying to accomplish and what obstacles do you face?"

    This gets directly at what you need to know to improve what you provide to the customer. And it leaves the door open wide enough to any kind of issues the customer may be having that you are sure to learn some things.

    My bias has always been to start with qualitative research tools like this and then, once you've categorized the common issues, start quantifying them and measuring the effects of different strategies on them. That's where web analytics would come in.

    You've convinced Lynda above. She says, "we will start with the survey and try to intercept browsers as they leave the site." That's the right first step.

  17. 17
    Tim Leighton-Boyce says

    Yesterday a client asked me if I could cite any examples of a survey leading to an uplift in trade.

    I've got plenty of evidence of customer surveys bringing in real gems of information about obscure glitches which we might otherwise have missed.

    For example an e-commerce site with double digit conversion rate. So the site's working very well by many standards. But we can still make it better…

    Customers are very loyal and around 50% fill in a survey (this is a confirmation page one, not the more interesting general one suggested by Avinash) and around 16% then add comments in the VOC box. Those comments produce real gold. For example: snags with routes to the edit credit-card-details system (not the system itself) are hard to spot in the clickstream. Without knowing the intent of such users we would be unlikely to segment for them and they would be lost within the general noise of the checkout funnel. A usability study would find it, but only if something prompted us to test for returning customers with expired cards — a fairly small group unless your site has very loyal customers.

    So there's an example which will produce an uplift in trade over time. But I think this client was asking about something even harder to quantify. Does the mere fact of asking for the information demonstrate a willingness to engage in dialogue with the customer in itself and cause an improvement? That would be very hard to measure, so I wonder if anyone here has any thoughts on the subject, please.

    In a bricks and mortar store we tend to shy away from salespeople who ask "Can I help you?" — at least in the UK where the automatic response is "No, I'm just looking." But for the moment the effect would probably be the other way round on line. A site which showed some form of interest in the visitor might turn out to be more interesting to the visitor. I'd love to find some evidence of that…

    Tim

  18. 18

    My question, having done one of these on our site, is – now what? I've uncovered some surprises and discovered some strengths but what can I say to management about what to do next?

    25% of visitors report failing because of a specific problem. If I fix that what should I expect?

    Great things, no doubt:-) But is there any way to guess how great?

  19. 19

    Hi Avinash. I'm interested in online survey capability. In terms of selecting a vendor for this, what are the important capabilities you should look for?

    I assume that you need to be able to specify when and where the survey would be asked, and that this would need to be done as folks were leaving the task you want to measure? Is that right, and is there anything else that you feel is important?

  20. 20

    Tsk, tsk. Too many people speaking out without any REAL evidence or experience with any of this stuff. Bottom line: Web Metrics by themselves are useless — if you don't know 'why' you know very little. Tools like iPerceptions are critical for the 'why'. That said, I have never recommended the purchase of iPerceptions to a client yet (even though it is one of the best tools in the market) because they don't tie their data to the transactions (but allow you to do so).

    Since many clients have nothing at all (and typically are not ecommerce focused), I leverage Usability Sciences' WebIQ, which gives you both the transactional and the qualitative data [no confustion…this is not a transactional toolset — it is not focused on transactions in total].

    At Texas Instruments, where I gained the greatest hands on exposure to a breadth of tools, I relied on data both from HBX and from WebIQ.

  21. 21

    I like this for its simplicity. Too many times analytics experts will be tempted to ask a lot of questions, not realizing that the more trouble they cause the participant, the more likely they are to get bad or incomplete data. I'd much rather have three questions that are answered 100% truthfully and 90% completely than have 25 questions answered 50% truthfully and 20% completely.

  22. 22
    arabian4ever says

    Hi there,

    I think that this does not make any sense, what is the idea of asking those three questions?
    Using your web analytics tool , you can easily answer the three questions by yourself easily. in addition you won't spend your precious time going through a lot of spammy answers.
    I think that those three questions enter into the game powerfully when it comes to offline marketing.

    Thanks

  23. 23

    arabian4ever : The problem with all the web analytics data is that it can only tell you what it knows, it can't tell you what it does not know.

    You bring an interesting perspective, but I believe that data, in this case, can be deceptive in the insights it can provide.

    Here is a example. I come to your site, I am looking for a job (or support or a product I saw in a store or ….) and you don't have it on your site. How would the web analytics tool tell you that? The survey would.

    Or I am on your website and it stinks at major things. How would you know? You can look at top exit pages. You can look at segmented content or visitors. In the end you will have to rely on your, potentially limited, point of view (and experience in life) to guess what stinks. If you use a short survey you can let the customers tell you.

    In the end here is a good way to think about it. Web Analytics is good at the What. It is not good at the Why. The Why can only come from the customer.

    Here's a post that might be interesting:

    Overview & Importance of Qualitative Metrics

    Hope this helps,

    -Avinash.

  24. 24

    But could we expect the customers to answer these quiestions…I doubt , we could have such patient customers. Further, at times a customer could end up buying but by the time he/she has bought something, he would be frustrated by the difficulty he had locating what he wanted (from my own experience) that he would decide to rather buy it from an other site next time on. In such case does this simple question make sense
    " I find shopping here…. " and then have a few options from Easy to Hard , or Rapid to time consuming.
    In simple terms that could give us an idea about our User Navigation, coz its the customer who knows how user friendly the navigation is.

  25. 25

    Nilesh : I encourage experimentation over entrenched opinions. You never know what you don't know.

    For example:

    My first survey on a large ecommerce site had 24 questions (all on one page in a pop up). I was positive it would stink – and I said so to the survey vendor.

    The response rate (completed forms) was 18%.

    I was astounded. And embarrassed because I was overlaying my own opinions on what the customer might do.

    Of course since then we have fewer questions, much better surveys (ajax and everything!), greatly improved targeting systems etc. Which each the response becomes better and more importantly our ability to listen has dramatically improved.

    Moral of the story: 1) Experiment, it can't hurt that bad and you might just be proven wrong (or right and then you'll know for sure). 2) If you allow a mechanism to your customers to speak, they like to talk.

    Hope this helps.

    -Avinash.

  26. 26

    Avinash,

    Where do you recommend placing this 3-question survey, and how prominently? I assume that if you put it at the point of conversion, you will not reach many people who do not even get there, but if you put it on the homepage, you will have people unable to answer questions 2 and 3.

    Thoughts?

  27. 27

    Hi Avinash,
    I`m doing some research about surveys to share with my students. I`ve seen that a common problems with this kind of surveys are that they are often displayed during navigation so you have answers to question 2 like "I don`t know. I haven`t finish my search yet". Is there anyway to avoid this?

  28. 28

    Pablo: You are absolutely right, it can be a issue. Hence I recommend a "onexit" survey, it is only shown when someone leaves the site.

    We have recently released a free survey that does this now, please check out this post:

    https://www.kaushik.net/avinash/2008/03/4q-the-best-online-survey-for-a-website-yours-free.html

    Hope this helps.

    -Avinash.

  29. 29

    Avinash,
    Great post, I agree with you; getting "what we don't know" from customers is key to making improvements. This will help our Alternative medicine community site given the breadth of topics we cover.

    One question – what's the best practice as to where to place the survey. Options I am thinking of are – 1) Button on top of every page or 2) pop up at the time of exit. Any thoughts or are there off the shelf packages to achieve this.

  30. 30

    We went ahead and implemented this survey last week on our staff blog. Can't wait to see how it comes back!

    http://multiply.multiply.com/journal/item/299/Survey_Three_Questions

  31. 31

    Hey,

    I decided to create a Q4 survey for my client and also signed up.I was able to complete my 1st step successfully.Unfortunately I didn't get that"specific link" from Iperception after the 1st step , as you mentioned in your youtube video. Am unable to edit the questionnaire according to the relevance of my clients' website. Can you please help?

    Thanks!

  32. 32

    Hi Avinash,

    Yes this one is a winner for me, will be requesting this of our web developer. My thought now turn to implementation, how do I encourage people to fill out that survey?

    Thanks!

    • 33

      Damian: Keep your survey short, experiment with different types of non-intrusive invitation models. I've been playing with a small box that show up on the bottom right of the browser, and only for people who have seen x number of pages.

      Both Kissinsights and 4Q have this type of an invitation model.

      -Avinash.

  33. 34

    I have been doing internet marketing since 2006 and have never used a survey. Maybe I have if I were speaking to the customer on the phone, but not on my actual website.

    I think surveys should be an integral part of the online marketing process even if it doesn't directly rank a site higher. In the end the customers opinions are what matters because they are the ones forking over the money for services and product.

    I already implemented 4Q, but I am also interested in https://www.kissinsights.com.

    I saw this on Avinash's AWESOME Web Analytics Training Course.

  34. 35
    Tony Gilbert says

    I wonder if any of you have tried using something simple like a 4Q survey, but adding an invitation to users at the conclusion of this survey to participate in a longer survey if they'd like to help improve the website? It's something we've been interested in trying out for a while, but haven't had the pressing need for a longer survey to make us take the step.

    Anyone doing this? I'd be interested to know what results you're getting.

  35. 37

    Hi Avinash

    Although this post is pretty ancient in web terms I hope you can still help me with a bit of a dilemma.

    The company I work for owns several websites. We've been trying to improve them over the years using web analytics and usability testing and sometimes by conducting online surveys. Those surveys tend to be really really long though and in the end I usually find only three or four questions really interesting. That's why I want to try something different and conduct an ongoing survey with your three questions.

    However, one of my colleagues that is responsible for our financial news website thinks it's absolutely ridiculous to ask those specific three questions on a news website. He thinks the purpose of the visits to his site is clear: read news and that you don't have to ask. I don't really agree with him and furthermore I would just like to try and see what happens but he is adamant that we will make a fool of ourselves if we do so.

    Do you have a convincing argument why these three questions are suitable for news websites as well?

    • 38

      Anne: It is very hard to argue with entrenched opinions. All I would say is that if you use something like https://qualaroo.com/ it will take you and your BFF just 5 minutes to create an launch the survey with the three questions.

      Why not let real world users and real world data help you decide if this is a good idea or a bad idea?

      As to the question of why people go to a news site… I concur that many people will be there to read news. But the beauty of the primary purpose question is that it will help you understand what are all the other reasons people might come to the site for. And if that data is material use it to improve your site. If it is not, in the next iteration of the survey just ask two questions. :)

      Avinash.
      PS: The only way you might be making a "fool of yourself" might be with you loooooooong survey. I have yet to encounter an instance where a short focused survey ever lead to a "fool of yourself" outcome!

  36. 39
    Eric Shuai says

    Hi Avinash,

    I manage the site satisfaction survey for my company and we did an analysis where we merged the survey and click stream data together then compared the survey population to our overall site population. From this analysis, we saw that the survey respondents are not representative of the overall site population from an engagement, composition of OS, etc, however, they were representative of some of our most engaged and valuable customers (a very active, but small % of the total population).

    My manager saw this analysis and is now skeptical of the usefulness of the survey data, even though he acknowledges that the survey respondents are made up of these highly engaged users on our site. Do you have any recommendations on how I can potentially address my managers concerns?

    Thanks,
    Eric

    • 40

      Eric: There will never be a 100% match between quantitative data and qualitative data. But both have holes in them that make it mandatory that we focus on using the other one as a complement to make smarter decisions.

      For your survey, as pointed out in this post, you need to ask both the Primary Purpose and Task Completion Rate questions. If you do, just make sure you have enough responses for all Primary Purposes and you should be all set. Either to make decisions about what to change right away, or what A/B tests to run to continuously improve the site performance.

      Your manager, from the limited information here, seems not so much skeptical about qualitative data but rather all analytics data. In this case, you need to figure out how to earn his love/trust. Here are two posts with ideas:

      ~ Six Rules For Creating A Data Driven Boss!

      ~ Empowering Analysis Ninjas? 12 Signs To Identify A Data Driven Culture

      Good luck!

      Avinash.

      • 41

        I just ran across your article, "The Three Greatest Survey Questions Ever". While analytics is indispensable, there is nothing like getting direct customer feedback, and your three question approach is simple and direct.

        Do you have a suggestion on a simple tool that can be used to categorize responses?

        • 42

          Richard: I am afraid I have not found a pubic source that I trust to provide sufficient value. Though there are many out there:

          https://www.google.com/search?q=analyze+text

          Internally the team has a tool they use that is pretty good. Sadly, not public,

          Overall, humans are still better at parsing these patterns. Though I recognize if you have 10,000 rows that is beyond human. Then, I use the link above to find something to reduce things enough to have a human take over. :)

          Avinash.

  37. 43

    Hey Avinash,

    I agree with you on best surveys being made with only 3 questions and the ones you have mentioned here in your blog would help website yield tons of data.

  38. 44

    Great post Avinash

    Just an idea…

    Why not just have an intelligent survey that asks questions depending of the last answered one.

    So the first question could be about a feeling of your Customer visiting your Website and after that 2 or 3 other questions could "pop".

    This way you will add value to the survey and be able to segment super fast .

    • 45

      Daniel: It is a good idea.

      Many nice survey providers allow the if-then-else functionality. That way you can have more questions in the hopper, but only serve a certain number to the visitor.

      -Avinash.

  39. 46

    Hi,

    Google Surveys are not free anymore or I was too dumb to find the free version. You may want to correct that in your post.

    Anyway, thanks for being awesome and sharing your knowledge!

Trackbacks

  1. […] Here are several excepts from a weblog post by web research and analytics consultant Avinash Kaushik, The Three Greatest Survey Questions Ever: Web analytics is awesome (you do expect me to say that don’t you! : )), and it has to be a critical part of your web strategy because it can yield great insights. But for the fastest way to understanding customer problems there is nothing like asking the customer herself / himself (and yes it will lead to improved revenues). […]

  2. […]
    Design Empirically

    The key is to convert this small slice. How? Testing, testing, testing. Experiment. Don’t follow the HiPPO (Highest-Paid Person’s Opinion.) Your boss is not your user. Your designs (and certainly the HiPPO’s designs) will most often be wrong, and even when they’re right, they’ll be stale in short order. You must experiment and innovate, constantly.

    There is a progression of methods that you can use to do this. Here’s the list from the fastest/easiest to the more complicated:

    * Customer Surveys [This was not actually in the talk, but I saw it on Avinash’s blog.]
    * A/B Testing
    * Multivariate Testing
    * Experience Testing
    […]

  3. […] The report can be multi-dimensional but it has to be just one report that gives you a ton of insight. I could do a lot with a report that provides you with single access (bounce rate) and conversions by referrer source. This report would tell me where the scent was broken in my marketing. I would then spend my time optimizing source/landing page to refine the scent trail so that more people would convert along the way. What dream report would you build? Why would it be this report and what would you do with it? Do any of the vendors currently have this report just the way you want it? I wonder what these smart folks would build (and keep the meme going in case the vendors are paying attention):Eric Peterson Jim Novo Avinash Kaushik – I wonder if it be this? Jacques Warren Robbin Steif René Dechamps Otamendi Marshall Sponder Technorati Tags: insights, reports, Web Analytics […]

  4. […] Michael asked a great question the other day on the "best survey questions" post and I started to write a reply back in the comments section but it turned out to be too long so here is the answer as a post. […]

  5. SPOS #71 – Six Pixels Of Separation – The Twist Image Podcast – +1 (206) 666-6056 – CarCast With Bryan Eisenberg And Avinash Kaushik…

    Welcome to episode #71 of Six Pixels Of Separation – The Twist Image Podcast. In this episode, we take a deeper look into what people are looking for (and why) when they visit a Website. This episode has an amazing CarCast with Bryan Eisenberg and Avinash Kaushik. There's even a Six Points of Separation tie-in. This is a deep one with tons of philosophy and insights about consumers, their online experiences, voice of the customer, and where the Web will (hopefully) go. I am also playing with the length of the show and would love to know what you think. Enjoy this conversation…

  6. […] An analytics guru, Kaushik says metrics tools are great, but website managers shouldn’t necessarily invest all their money into a stats reporter. Instead, a short survey form may be the best option for better connecting with your site users – That is how you can ask the questions, right?. […]

  7. […] If you can’t measure the success of the your website or blog through conversion rates, what’s a qualitative way of finding out if it is effective or not? Avinash, a web analytics and usability guru explains three greatest survey questions that every web master must know: […]

  8. […] Have you ever wondered why your site does not have a high conversion rate even though you have a good amount of traffic? The quickest way to fix the problem is by surveying your users. Here is a great post by Avinash Kaushik on how you can easily implement a short website survey to ask your users and gain a wealth of insight. Easy to implement and highly effective. […]

  9. […]
    Hace ahora un año aproximadamente, Avinash publicó un post en el que recomendaba cuales eran las tres preguntas básicas para conocer lo más importante sobre nuestras visitas con el menor número de preguntas.Estas tres preguntas eran: ¿por qué has venido a visitar mi web hoy?, ¿ has podido completar la tarea que te ha traído aquí ? si la respuesta es no ¿ por qué ?

    De hecho yo utilicé un tiempo surveymonkey, una herramienta gratuita de encuestas para preguntar esas mismas preguntas y en buena medida me ayudó a tomar la decisión de cambiar el enfoque de este blog.

    Bien, pues ahora Avinash añade una pregunta más: qué es lo que más valoras de nuestro site, y un rating de satisfacción entre uno y diez y ha salido 4Q ( 4 questions ) una aplicación gratuita, en beta todavía y sólo en inglés ( de momento ) que se puede personalizar y a la que podemos añadir nuestro logo.
    […]

  10. […] but we have captured a valuable insight into our users' experiences of the website – the 'voice of the customer', as Avinask Kaushik calls it. I would not suggest planning an entire overhaul of the website on the […]

  11. […] Je trouve tout à fait symptomatique de voir que ce qu’exprime Michel, avec ses mots d’entrepreneur, je le retrouve dans le discours d’Avinash Kaushik, web analyst, quand il nous dit que le premier KPI qu’il surveille, c’est l’avis de ses clients. Ils se situent chacun à une extrémité du processus économique, l’un alimentant le processus par des idées, des produits et des finances, et l’autre analysant l’ensemble des actions menées par l’entreprise, mais ils se retrouvent sur le même KPI : quelle image ont de moi mes clients, et comment puis-je l’améliorer ? […]

  12. […]
    The web analyst only sees his or her little slice of my experience, and just like the scientists studying Neanderthals, completely lacks the greater context. However, the web analyst has a couple big advantages over the scientist, because he or she can:

    Get a few users to answer some questions! (Imagine we could ask Neanderthals questions, that would be awesome! We don’t have to imagine what our website visitors would say if they could talk, because they can!)
    […]

  13. […]
    In web analytics marketing research is called Voice of the Customer (VOC). It is the light version of big off-line projects market research. It can be done on a quantitative or qualitative basis and it’s useful prior to new product launches to get a baseline idea of consumers’ needs. So, get on!! Open a dialogue with your customers now and use surveys, comment cards, focus groups, online communities to grab potenential business opportunities, identify uncontested markets and improve your business performance!!xx!!

    Useful links:

    Avinash again talk’s about the need to ask questions. Here you can find the posts for the 3 most useful questions.
    […]

  14. […] The clickstream may be the starting point for analytics, but the real gold is insight at the end of a process that encompasses analysis of multiple outcomes, experimentation/testing to optimize these outcomes, listening to voice of customer (mentioned only briefly, but Avinash has strongly advocated it elsewhere), and gathering competitive intelligence that can be put to work in support of your outcomes. The point is that your website has a purpose and the outcomes that you want visitors to accomplish should be identified, measured, analyzed, improved upon. Yes, this means looking at the clickstream, but looking at it with a purpose and digging in to find actionable information […]

  15. […]
    We got 577 answers (which is less than 1% of our website traffic) but we have captured a valuable insight into our users’ experiences of the website – the ‘voice of the customer’, as Avinask Kaushik calls it. I would not suggest planning an entire overhaul of the website on the basis of these data alone but, in combination with the recent usability studies and other, secondary research, it continues to support the case that finding study information is the number one task on our website.
    […]

  16. […] I am a fan ofAvinash Kaushik. I can't pronounce his name, but, he speaks my language! The Three Greatest Survey Questions Ever | Occam's Razor by Avinash Kaushik He speaks of the shopping experience as a "task based" mission. So… as we all know, […]

  17. […]
    Cada bloque de herramientas en el cuadro de Avinash tiene al menos una gratuita y otras de pago. Para el caso que me ocupa hoy os recomiendo una herramienta gratuita que precisamente se creó gracias a la inspiración de un post publicado por Avinash.
    […]

  18. […] Avinash Kaushik has strongly advocated for using task completion rate as the primary metric for site optimization.  Recognizing that visitors come to your site for different expectations of what they want to accomplish.  These may not be reasons for which the site was designed but for whatever reason  – are your visitors finding what they were looking for? Did they complete the task they implicitly set for themselves when coming to the site?  From this we have Avanish's "The Three Greatest Survey Questions Ever" […]

  19. 4Q Survey Google Analytics Integration | Web Analytics | Jared Huber — Web. Analytics. Remix. says:

    […] with the experience. VOC (voice of the customer) solutions are hot, and understandably so; web analytics does a lousy job of explaining why a visitor came to your site, as well as whether or not they acheieved what they set out to do. Note […]

  20. […]
    Aangezien ‘4q survey’ mijn favoriete gebruikersonderzoek tool is en meer nuttige resultaten heeft opgeleverd dan Kampyle zal ik deze tool kort toelichten. Volgens Avinash Kaushik, een statistieken goeroe bij Google, zijn er eigenlijk maar 3 belangrijke vragen om te stellen bij een enquête. Namelijk:
    […]

  21. […]
    Je trouve tout à fait symptomatique de voir que ce qu’exprime Michel, avec ses mots d’entrepreneur, je le retrouve dans le discours d’Avinash Kaushik, web analyst, quand il nous dit que le premier KPI qu’il surveille, c’est l’avis de ses clients. Ils se situent chacun à une extrémité du processus économique, l’un alimentant le processus par des idées, des produits et des finances, et l’autre analysant l’ensemble des actions menées par l’entreprise, mais ils se retrouvent sur le même KPI : quelle image ont de moi mes clients, et comment puis-je l’améliorer ?
    […]

  22. […]
    Undersökningen baseras på The Three Greatest Survery Questions Ever som tydligt visar att en kundundersökningen inte behöver vara så avancerade för att nå insikt i de absolut viktigaste frågor.
    […]

  23. […]
    Mi ha molto divertito anche il modo in cui ha distrutto Libero.it (il grande banner in overlayer sopra i contenuti significa che il portale vuole avere un orgasmo prima dell’utente!, esattamente al contrario di ciò che avviene con Groupon). Di certo d’ora in poi implementerò le famose 3 grandi domande da rivolgere agli utenti.
    […]

  24. […]
    Three Greatest Survey Questions Ever – set of three great questions to ask people who are on your website. Extremely valuable as you track how well your site is working over time.
    […]

  25. […]
    Another way of soliciting feedback is via surveys. This is a good opportunity to seek advice on the organisation of your website. Even frequent users of your site may expect to find content in certain sections of your site or spend several minutes finding content they know exists but can’t recall what it’s categorised under.

    Not sure what to ask your visitors? How about The Three Greatest Survey Questions Ever?
    […]

  26. […]
    VOC: Can’t figure out why no one is buying your fantabulous widget…why not ask them. Online surveys, like iPerceptions 4Q, and other Voice Of Consumer (VOC) tools allow you to go beyond your quantitative measuring your customers actions and begin to understand their intentions. As you begin to look behind the curtain and understand your customers motivations the actionable insights you gain will blow you mind…
    […]

  27. […]
    Also within the field of Web Analytics there has been a lot of discussion about Voice of Customer data supplementing quantitative website data to get deeper insights. There are some good free online survey tools like 4Q and Survey Monkey that allow you to run on-exit surveys on your website in order to automatically collect customer feedback data (like the ones they sometimes use on the QlikTeck site). Especially 4Q is very good. By asking 4 simple questions they can measure important KPI’s as Task Completion Ratio and Overall Satisfaction scores.
    […]

  28. […]
    Even before I co-founded WorkBuddy with my partner in business and life, Sherri Belk – I was consumed in research regarding technology and marketing on the web. Web design intrigued me, but the concepts surrounding SEO, inbound marketing, and developing rich content for my site really pulled me in. And for good reason – they provide results. Now post-launch of WorkBuddy, I find myself an even more voracious consumer of research articles, ebooks, and commentary on these subjects – which is to the benefit our my clients, and not to benefit of my sleep patterns. So when an article brings me pause and causes me to stop and reflect on my own business – I know I have found a gem. That's how it was with a  post by Avinash Kaushik regarding the "Three Greatest Survey Questions ever."
    […]

  29. […]
    The insights from a good website visitor survey can be invaluable in increasing the effectiveness of your website at generating results. One of the most popular website feedback formats is the free 4Q survey developed by analytics guru Avinash Kaushik – check out his excellent blog Occam’s Razor to learn from the best about web analytics.
    […]

  30. […]
    I recently read the book Web Analytics: An Hour a Day by Avinash Kaushik. While some of the material dealt with minutiae beyond the interest level of the casual reader, the book did contain some very easy-to-understand-and-implement ideas for gaining insights about one’s website. One such recommendation involved what he describes as The Three Greatest Survey Questions Ever:
    […]

  31. […]
    Hablando ya de encuestas, sí, las creo útiles, pero *especial y concretamente* para averiguar información crítica como los motivos de visita y abandono de una web, información difícil de hallar a través de otros métodos como la analítica tradicional, in page, test de usuarios,… y que al final, no pueden revelarnos la intencionalidad del usuario. Y digo *especial y concretamente* porque echo en falta un discurso más estricto que insista en los errores generados por planteamientos/aplicaciones indiscriminados de las encuestas:
    […]

  32. […]
    We didn’t invent this lens. It’s derived from a methodology proposed by Avinash Kaushik (a digital marketing / analytics savant, author, and one of the smartest men I’ve ever met and had the pleasure to work with) in 2007 . Simply put, it’s the most actionable analytical framework you can use to measure, optimize, and manage the omnichannel customer experience.
    […]

  33. […]
    Mas o que perguntar? Em um post de Avinash Kaushik, o autor afirma que com apenas 3 simples perguntas já é possível acumular muita inteligência sobre o desempenho do site junto ao seu público-alvo: qual o propósito da visita, se a pessoa conseguiu o que queria e, caso contrário, por que não conseguiu?
    […]

  34. […]
    Each survey can be as simple or complicated as you like. According to website analytics guru Avinash Kaushik there are three important questions you should ask, but you can tailor your survey as you see fit.
    […]

  35. […]
    A very effective and easy way to get to know what your visitors are missing is to simply ask them! We’ve been using on-site surveys on yoast.com for a few months now, and the results are always helpful and insightful. You can find out everything you need to know with three simple survey questions, thanks to our friend Avinash Kaushik:
    […]

  36. […]
    What exercises will help me? Any exercise that helps you Find Your Sweet-Spot Audience, and exercises that help you deliver your value to the market (usually someone with a ‘problem’ who’s more of a beginner than you.) If you’d like to get a little more concrete and stastistics-based, Google A/B Split-Testing or Talk To Your Customers Through A Survey, it’s magical.
    […]

  37. […]
    A very effective and easy way to get to know what your visitors are missing is to simply ask them! We’ve been using on-site surveys on yoast.com for a few months now, and the results are always helpful and insightful. You can find out everything you need to know with three simple survey questions, thanks to our friend Avinash Kaushik:
    […]

  38. […]
    iPerceptions is another surveying platform. Its free version allows you to ask users "the 4 questions that no website owner can go without". If you are unsure of where to begin pre-testing or are struggling to initially come up with questions this provides a simple starting point.
    […]

  39. […]
    The line of your questioning will ultimately depend on your website and the lines of enquiry that you are following at a given time. However, Avinash Kaushik shared three questions that will always deliver valuable insight in his post ‘The Three Greatest Survey Questions Ever‘. They were:
    […]

  40. […]
    For me, this is one of the most insightful things to ask because it drills straight into the one core thing that we care about in this process – what is stopping the customer from buying? I really like this presentation from Conversion Rate Experts which outlines their favourite questions to ask customers at this stage of the process as well as these three questions from Avinash.
    […]

  41. […]
    I really like this presentation from Conversion Rate Experts which outlines their favourite questions to ask customers at this stage of the process as well as these three questions from Avinash.
    […]

  42. […]
    This may be a configuration issue. That is for the web site administrators to ascertain. I tried looking for a place to contact and advise them, but didn’t see it. Too bad. I guess they missed the advice of Avinash Kaushik to ask three questions about user experience on your web site:
    […]

  43. […]
    Measuring task completion rate will give you the exact reasons, straight from the customers themselves, about how your site is performing. That best way to do that is by creating an creating an in-session or an exit survey survey that asks three simple questions:
    […]

  44. […]
    As Avinash Kaushik of Google writes, “…for the fastest way to understanding customer problems there is nothing like asking the customer herself/himself.” The challenge is knowing the best questions to ask when and where.
    […]

  45. […]
    Ankiety dostępne na stronie (np. Qualaroo czy Survicate) są niezwykle użyteczne. Osobiście jestem wielkim fanem “ankiety trzech pytań” polecanej przez Avinasha Kaushika. Używam jej notorycznie i często jestem zaskoczony rezultatami.
    […]

  46. […]
    Avinash Kaushik once wrote about the “three greatest survey questions ever.” The story is that, when asked which analytics tool he’d recommend to a VP on a short time frame, he answered that she should not install an analytics tool. Instead, install an on-site survey and ask these three questions:
    […]

  47. […]
    Even after a passage of so much time, I still love and adore Task Completion Rate the most. It is a qualitative metric, and we are supposed to be quant jocks. But. I really do love Task Completion because of its power to bring meaning to our quantitative data.
    […]

  48. […]
    The difference with on-site surveys, though, is they should be succinct, since the shopper isn’t exactly requesting them. Avinash Kaushik, acclaimed digital marketing evangelist and best-selling author, describes three questions that are essential on any on-site survey, and are quick enough to not be a burden:
    […]

  49. […]
    On-site surveys can provide valuable context that is often missing from click-stream data. Avinash Kaushik is convinced that nothing beats the Three Greatest Questions Ever:
    […]

  50. […]
    What to Ask Your Visitors? Avinash Kaushik picks out three essential questions to ask visitors to your site:
    […]

  51. […]
    To increase the response rate to these surveys, you can use a “3 question survey” format to tailor the questions to uncover specific pains and gains. As you already know, using Hotjar you can show tailored surveys to specific groups of customers. However, sometimes you need to go beyond their apparent concern to find the root of the pain/gain which will give you great consumer insights. To incentivize its completion, you can offer a coupon that gives them a discount to your products/services.
    […]

  52. […]
    One of the famous conversion rate optimization experts, Avinash Kaushik, suggested asking visitors the following three questions:
    What is the purpose of your visit to this page today?
    Were you able to complete it?
    If not – what prevented you from it?
    You may get quite surprising answers and lots of information to work with to adjust your pages to user intent.
    […]

Add your Perspective

*