Competitive Intelligence Analysis: Metrics, Tips & Best Practices

seaworld small11The post on Monday was titled: Competitive Intelligence Analysis: Why, What & How to Choose. This post takes a few steps deeper into the world of competitive intelligence with best practice recommendations for analysis, metrics that you should report on and traps you can avoid.

Hopefully this will be helpful in focusing our valuable energies and produce impactful actionable insights.

If you have not had a chance to read the other post I recommend it as foundational material for this one.

Two suggestions for things Not to do:

1) Conversion Rate: The instant tendency for anyone, especially Senior Management, is to ask for the competitor’s conversion rate and compare it to their own. Usually this is a huge waste of time for the following reasons:

  • Even companies who are in exactly the same business have radically different business strategies when it comes to the web. For example you could be driving all the sales via the web channel to the detriment of other channels while your competitor could have a more holistic web, retail and phone strategy. So if you compare conversion rates you are really comparing apples and mosquitoes. 

    [Think of Best Buy and Circuit City, two electronics power houses. You might think they are in the same business in reality whether in their retail stores or on their websites they execute such radically different strategies that even if you knew what their web conversion rates were it would give you very little insight that you could exploit to your advantage.]

  • It is a classic “so what” situation. Let’s say your conversion rate is 90% and your competitor is 9%, what would you do? What if it were vice versa? Would you change your fundamental business strategy? Would it really matter?

I am quite honest in my opinion that even for our websites we should not obsess too much about conversion rate. For reasons in that post and the ones above in doing competitive analysis conversion rate has the potential to be nothing but a distraction. Usually. YMMV. : )

2) Pages / Content Viewed: This one is tricky. It seems logical that you would want to know the pages that visitors are viewing on your website and pages they are viewing on your competitor’s website. Common Question: How many visitors are viewing the “product detail” pages on their site compared to ours? Here are some reasons why this could be a sub optimal use of time:

Tips & Best Practices on what you Can do:

The most delightful use of Competitive Intelligence data is in understanding what is happening on the demand generation side (acquisition), post site visit analysis, deep search analysis and comparison and in identifying new targets for marketing relationships. Specifically……

1) Share of Visits by “Industry” Segment: This is what we start the game with. Either for an industry segment (say Software – Technology) measure what is the share of traffic that you are getting. It should show you at a quick glance who the big boys and girls are in your segment that you are fighting with.

I also recommend one more drill down on this report. Create Share of Visits by Custom Segment. This allows you to plonk in your core competitors (as defined by you) into the tool and measure what share of visits you have on your own turf. This is where you’ll see if you are really dominating or your competitors are kicking your butt.

As always remember to trend over time to get a real good feel for how you are doing.

2) “Upstream and Downstream” Traffic against Competition: Referring URL’s in your web analytics tools report give you something, but usually 50% of referrers are blank. I love this report because you type in your url into HitWise (or whatever you use) and it will tell you what sites people were before they come to your site. Some will overlap with your referring urls report. But most won’t and this helps you fill in some of the gaps.

This also gives you a great feel for “mindset”, if you have a small cluster of sites people see before they come to you there is some inference you can make for customer intent. More than that “upstream” sites for your competitors helps you identify who they are doing business with that you are not (nice!).

ClickTracks gives us Exit Tracking, so if people click on our site to go to another it reports that (with zero development work on the website). But we want to know where people go after they visit the site, even if they did not click on an exit link. The “downstream” report will tell you that. For example how many people visit your competitor after they go to your website? How many people go to Google from your website because they can’t find what they are looking for?

3) Share of Search: The latest stats indicate that roughly 80% (!!) of the traffic on the web starts at a search engine. This is a great report to run for the % of traffic you are getting from the major search engines against your core competitors.

My tip would be correlate this with any efforts you might have expended in the critical area of search engine optimization (SEO) to see if your changes are helping. Typically you can measure this with your own analytics tool. Where a competitive tool is important is that it will give you context if the general web trend for search in your category is up and you are just riding that wave or if both you and your competitor are up at the same time or if you really benefited from SEO and are now beating your competitor.

4) Share of Brand and Category Key Phrases: Now you are cooking. Start with brand key phrases because they are most of your search traffic any ways. A quick report for your top brand key phrases will tell you what share of traffic you are getting for coca-cola vs your competitors or, more likely, your affiliates or other retailers.

But perhaps the most amount of value comes from doing a report on your top category (non-branded) key terms (for example “digital camera”). This is where you really have an opportunity to gain a strategic advantage against your competitors because the theory is that category key terms are “entry points” into the consideration process and if you can capture the visitor early, you could get mind share and convert them (at that point or later in the consideration process).

5) Discovery of new Search Key Phrases: Most often we are limited by what we know. Competitive analysis tools are great for keyword discovery (great complement to any strategy you have for keyword generation or building the long tail).

In our friendly neighborhood competitive intelligence tool I look for keywords driving traffic to your competitors, to your overall industry segment or your partners. There is a quick little optimization exercise waiting to happen as you diff the keywords that you already have vs those your intelligence report provides you with.

One recommendation here is to be creative here as you define your competition and “industry”, cast a wider net. For example if you are selling coca-cola your “competition” for keywords is not just Pepsi but also Target.

6) Traffic by “Media Mix”: This is a great HitWise report (perhaps also in ComScore, pardon my ignorance). I like it because I am such a fan of segmentation. This report will show you your “media mix” vs your competition. Media Mix is defined as the core streams of traffic to your site as defined by “Email” (so potentially your Direct Marketing), Affiliate, Search and Direct/Other.

This report is insightful because it is a peek into the acquisition strategy of your competitor, something you would have a hard time getting otherwise.

Is the media mix for your competitors the same as yours? Very different? Should it be the same? Who are their core affiliate sites that are driving traffic to them? Should you go after them as well and have a relationship? Perhaps an alternative affiliate network? How about DM, now that you know how efficiently (or not) they are using email what should be your strategy?

These are very complex questions that you can’t even begin to answer normally. But with competitive intelligence you can start that journey. Even one adaption of strategy based on this data could be worth hundreds of thousands of dollars. So it is complex but the payoff is huge.

7) Psychographic Analysis: Fantastic way to identify new options for marketing, advertising or simply link building. Tools such as HitWise have integrated PRIZM data into the weblog / IP information allowing them to integrate lifestyle, personality, household income data for us to mine.

Examples of Prizm clusters are: Upper Crust, College Student, Digital Hopefuls, Handshakers, Techno Strivers, Gadget Grabbers (i think this is me : )), and the methodology assigns one single cluster value to everyone in a zip+4 code. The system is getting even more advanced now where it can get down to a street level (scary!! : )).

Marrying this data with IP data with website browsing behavior allows you to go really deep in understanding the internet behavior of segments of populations you might want to target.

So you can do things like, you are interested in the Techno Strivers (they are up and coming believers in technology for career advancement) then your competitive analysis tool will tell you most likely what zip codes these folks are in, what websites they browse and have have a short list of websites you want to establish relationships with to target these much coveted folks.

Or maybe you want Upper Crust (affluent, older white and Asian suburban couples), and on and on.

Often we partner with websites knowing only the most superficial data about their visitors. Here is a great alternative where you can start from ground up (identifying your customers) and then building your web marketing and advertising relationships from the ground up.

Competitive intelligence analysis is a tough game. The good news is that this is very far from “daily reporting”. It is more intense and focussed effort and it truly is analysis. Not every company will be ready to leverage all seven of the above recommendations (or even more options that you’ll find).

I encourage a very honest self critical analysis of your own abilities to action this data before you go buy a tool, although it might be obvious from this post the upside is literally huge sums of money and a strategic advantage that will influence your fundamental business strategy in a very positive way.

Please share your own recommendations and feedback via comments.

[Like this post? For more posts like this please click here.]

PS: Hello from San Diego, California. I love going to Sea World, hence a picture of “Shamu” on this post.

Comments

  1. 1

    Wow Avinash! Pretty deep post. I hope you liked the CA I sent – it gets into some of the Psychograpic stuff but not as much as another I did for a Tattoo site earlier this year.

    One of things I want to directly comment on is point "4) Share of Brand and Category Key Phrases: Now you are cooking. Start with brand key phrases because they are most of your search traffic any ways"

    The couple of Architectual House Plan clients (current and former) that I have worked with seem to exhibit the same search behavior. Most of the search traffic does, indeed, come from the Architect's name or brand, but so do the conversions! While I have put great effort to get rankings for my Oregon architect for carriage house plans, craftsman house plans, and for house plans, home plans, floor plans for my current and former clients in this sector, – a look at KeywordMax which I had installed in both cases, showed that most of the time, the keywords that led to a conversion were on the architects own name!

    Well, that's a problem if we're trying to sell Search Services to increase traffic for "house plans", "home plans" and "floor plans" if those terms don't actually lead to a sale.

    That's what lead me to comment. Your right, you can't for example, compare a Dell Server page vs. and IBM Server page vs. a HP Server page and say that one conversion rate is better than the other becasue the business strategy is so different (even if it seems like they are all direct competitors).

    A couple of years ago you might say that Dell and IBM were direct competitors but lately it was Bill Gates who was saying that Google was not its' direct competitor – IBM is Microsoft's direct competitor.

    The Claritas Geo-Demographics is something I've known about and studied for over 5 years. The ability to co-relate a search query to a Geo-Demographic cluster segment (with age/sex data included) is exteremly complex and no one is doing it perfectly yet.

    Finally, I get the feeling with Competitive Analysis – that is should be grounded in reality – that you should try to use the HitWise tools to explain why people do what they do (as much as you can) and compare it with what the competitors are doing on their site (again, if you have the access to the data and you can do it).

    One thing to add about HitWise. You know your percentage of Search Traffic at Intuit – but do you know your competitors's share? Probably not. IBM does not want to tell people what it's traffic is – neither does Dell, HP or, for the most part, anyone else.

    But, with HitWise, you can sorta reverse engineer and figure out your competitors share of search traffic, even if HitWise's numbers for your own site are off (they were for ..you know who…). Once you work out the ratios, you can get a fairly good idea of what each competitors search traffic really is as well as what terms are actually working for them….that's where the competitive search strategy begins.

  2. 2
    Jacques Warren says:

    Hi Avinash,

    I'm glad to see your enthusiasm about CI, because I am also a big believer that this should/will be an important part of the Web Analyst's portfolio of techniques in the near future.

    A few questions/comments:

    Suggestions 1 & 2: A bit puzzled here; this assumes that you would have access to the competitor's data, which is highly unsual…

    Tip 1: Isn't it neat!!

    Tip 2: Wait! you're saying Clicktracks can tell me the downstreams?? How? I guess you are talking about Hitwise capability here, right?

    Tips 3, 4 & 5: Any company investing a lot in SEM gets a good reason to purchase CI applications right there!

    Tip 7: yeah, pretty sexy. However, I am afraid that it is rather US centric (as a Canadian, I tend to notice ;) ), whereas, as we all know, the Web is borderless (well, simply put). A web site with a large portion of its traffic coming from areas not covered by PRIZM would have some distortion in the portrait. But, still, this is very interesting stuff.

  3. 3
    Jen says:

    Wow, you were busy while I was gone! (We were off seeing Shamu in Orlando, coincidentally) This is very interesting, I had not realized there was an alternative to panel-based (ala Nielsen) CI.

    There are also some web analytics providers offering some level of CI or benchmarking, which would help with your second "Do NOT". However, I had never heard of anything like the upstream/downstream. I have had alot of clients ask, "where do they go next?" Wondering if they are shopping around, for instance.

    As always, thanks so much for these posts!

  4. 4

    Jen: Welcome back. : )

    Jacques: I am glad you found the post helpful. In response to your questions:

    Suggestions 1 & 2: A bit puzzled here; this assumes that you would have access to the competitor’s data, which is highly unusual…

    That is exactly what you get with HitWise or ComScore (please see my other post about important differences in how each company collects data).

    Once you have access to the tool you simply punch in any website url and you can do #1 or #2. The only care I would apply would be for really small sites, they might not have enough data in either tool.

    Tip 2: Wait! you’re saying Clicktracks can tell me the downstreams?? How? I guess you are talking about Hitwise capability here, right?

    If you have links on your site that take people to other sites then ClickTracks will help you measure those site exits (without needing things like internal redirects etc).

    A competitive analysis tool will tell you where people go next regardless of if you have have links to other sites. So you can find out how many people go from microsoft.com to google.com easily. That is what I mean by downstream.

    Tip 7: yeah, pretty sexy. However, I am afraid that it is rather US centric (as a Canadian, I tend to notice ;) ),

    Hmmm I am not a native US resident and I always thought Canada was the 51st state! Just kidding, honestly. : )

    You are right in your observation. But it would not surprise me if PRIZM covers canada, I am not sure though. Of course other countries in the world are still out of reach.

    For international I would recommend HitWise for other things because they have a huge international sample set (almost 18 million).

    Thanks so much for taking time to comment.

  5. 5
    Lars says:

    Thanks for an interesting post as always.

    Experian offers similar psychographic data over here and I'm about to look into how that could be tied to Web usage data.

  6. 6
    navid says:

    i am deeply interested to find a model for appraising the level of CI in my company.
    do u have any idea in this regards?

  7. 7
    Ed says:

    Quick question on media mix. I am using hitwise as well in my company but I can't seem to find where the media mix report is. Any hint?

  8. 8
    Ben Hinson says:

    Hey Avinash,

    Great post and great insights! I was looking up what additional parts I could incorporate into a web report I'm putting together, and got some insightful stuff from this! Thanks again for this free knowledge…you're the man!

    -Ben

  9. 9

    I was trying to find more tools that would help us track the downstream flow. Are there other options or should I say competitors :-) to ClickTrack?

  10. 10
    jeremy says:

    Hi Avanish,

    Thanks for the post. I also read the chapter CI in your book.

    I am a small business owner but i see the potential of upstream and downstream traffic analysis.

    But all the tools are really expensive and I cant afford them.

    Do you know of some resources/ tools that are cheaper or free which small business can use to gain competitive advantage?

    Thanks in advance!

    Kind regards from the Netherlands,

    Jeremy

    • 11

      Jeremy: Two important thoughts….

      If you have a smaller website, you might not be able to get good enough data for your own website or your competitors if they are small as well. It is one of the limitations of competitive intelligence data. (You can learn more about it in this blog post: The Definitive Guide To (8) Competitive Intelligence Data Sources! http://www.kaushik.net/avinash/competitive-intelligence-data-sources-best-practices/)

      But what you can definitely do is learn from your bigger competitors. What are they doing? What is working for them? What keywords/sites/strategies might be worth digging into for you and which may not be?

      Ok, with all that said…. http://www.compete.com has a very good sample of US data, and http://www.similarweb.com has a good sample of worldwide data. They are both quite affordable (in the grand scheme of things).

      -Avinash.

    • 12
      Jeremy says:

      Hi Avinash,

      Thanks so much for the reaction.

      Similarweb has e free report that satisfies my needs (for now). Thanks for the information and the tips!

      Much appreciated.

      Kind regards,

      Jeremy

  11. 13
    Atul Sharma says:

    Hi Avinash,

    Very useful insights.

    I have a question. Do you any competitive analysis template ? I am looking for one.

    • 14

      Atul: I'm not sure what you are looking for in terms of "competitive analysis template."

      Typically you would identify the goals and objectives, and then the metrics most relevant for your company/client and use that to create a dashboard (/template).

      Relevancy and fit of the metrics are substantially more important than the template, as you can well imagine.

      -Avinash.

  12. 15
    taryn says:

    I wonder if you can help me, i need to know how to use Competitive Intelligence as a Career Advancement Tool?

Trackbacks

  1. Competitive Intelligence Analysis: Metrics, Tips & Best Practices…

    Avinash Kaushik has a pretty deep post on Competitive Analysis on his blog – he mentioned to me by email last night that he was about to post his most deep post on this subject.  And the Competitive Analysis information……

    http://www.webmetricsguru.com/2006/08/competitive_intelligence_analy_1.html

  2. [...] "Competitive Intelligence Analysis: Metrics, Tips & Best Practices" – Occam’s Razor by Avinash Kaushik (Competitive Analytics in Action by the ever insightful Avinash Kaushik) [...]

  3. [...]
    Avinash Kaushik is a web analytics expert, evangelist, blogger and author who has some really great posts on his blog about competitive intelligence tools. His blog is called Occam’s Razor. His postings are tutorials that can help you to extract some great insights about a competitor’s online activities.

    I highly recommend that you read each of these postings. The comments in each of the postings are informative as well.

    Competitive Analysis: A Podcast & A Competency Model
    Competitive Intelligence Analysis: Why, What & How to Choose
    Competitive Intelligence Analysis: Metrics, Tips & Best Practices
    [...]

  4. [...] Kaushik, Avinash (2006). Competitive Intelligence Analytics: Metrics, Tips and Best Practices, Occam’s Razor, http://www.kaushik.net/avinash/competitive-intelligence-analysis-metrics-tips-best-practices/ [...]

Add your Perspective

*