ERIC T. PETERSON
JOHN LOVETT
ADAM GRECO
All Blog Posts
Archives
BRIAN HAWKINS
SUBSCRIBE
Subscribe by Email
Subscribe by RSS
SEARCH
HOME

|
|
Archive for 'Traffic Variables'
Almost all websites have forms. Whether you are a B2B/Lead generation site, an eCommerce site, a travel site, etc… you most likely have forms. More importantly, you have people who don’t fill out your forms correctly and get some sort of error message. While error messages are a fact of life, in the web analytics/optimization world these are painful since you work so hard to get people to your site, to read your content and then agree to give you personal information. That is a lot of time and money spent only to have someone potentially abandon because they have problems with your forms. This represents your “low hanging fruit” so to speak – people who have already decided they like you and want to give you their information! In this series of posts, I am going to share some techniques for seeing how much of a problem your website has with form errors and in the next few posts I will cover some more advanced things you can do to diagnose these form error issues.

Which Fields Produce the Most Errors?
The first step in diagnosing form error issues is understanding which form fields are causing issues. Unfortunately, since a user might receive more than one error message, you have to pass in multiple values to a SiteCatalyst variable. This can be done using the Products variable, but since that is often already being used for more important purposes, I will suggest that you use a List Traffic Variable (sProp) to capture these values. Unfortunately, List sProps are not well documented and have some specific limitations (see Knowledge Base ID# 2305). All you need to know is that List sProps allow you to pass in delimited values and when you view them in the sProp report, these values will be split out. Let’s look at an example. Here we see a form in which a user has attempted to submit the form without filling out some required fields. What we want to do is capture which fields this user messed up (could mean incorrect value or leaving blank) so we can see which ones are messed up the most often. In this case, we see that the form errors are related to Job Title, E-mail Address, Phone #, Company Name and the MSA checkbox.
So in this case we can use a List sProp to capture the fields giving us errors. Here is how it would look in the JavaScript Debugger:

Unfortunately, List sProps are still constrained to the 100 character limit so if you have long forms you are out of luck or you can select the most important form fields to capture. Once you have captured the fields, you can open the sProp report and you will see something that looks like this:

In this case, we can see that we are getting the greatest number of errors on the Phone Number form field on the US website (I have added the site since forms exist in multiple sites). I could also filter this sProp report for just US or Japan form fields by using a text search of “us:” or “jp:” as needed. This report should help steer you in the right direction when it comes to fixing basic form field issues.
Correlating Form Field Errors to Forms
Once you have seen which form field errors, the next logical question is to see which forms had which errors. Unfortunately, one of the limitations of List sProps is that they cannot be used in Traffic Data Correlations. Therefore, if you want to breakdown form field errors by Form, you will need to use the Discover product as shown here:

If you don’t have access to Discover and seeing this type of breakdown is important to you, you may want to consider using the Products variable instead of a List sProp since the Products variable comes with full Subrelations by default (though this implementation will be significantly more difficult). I will also be covering a different way to approach this in my next post so stay tuned!
Final Thoughts
If you are not currently tracking form field errors, hopefully this will give you some ideas on how you can start the process of seeing where you are tripping up your visitors. Keep in mind that this post is just a start and that the next few posts will go into more advanced stuff you can do and how you can identify your biggest opportunities for improving conversion.
(Estimated Time to Read this Post = 4 Minutes)
In the past, I have written about Bounce Rates, Traffic Source Bounce Rates , Segment Bounce Rates and Site Wide Bounce Rates. In the latter, I even promised I was finished writing about Bounce Rates, but, alas, I have yet another Bounce Rate installment. I was recently in a conversation with a peer and she asked me how they could see the bounce rates of the various landing page A/B tests they were running via Test&Target. I told her that this was easy to do if you follow my instructions in the Segment Bounce Rate post, but she asked if I could write a brief post with more specifics so here it is…
Why A/B Bounce Rates?
Before getting into the solution, let’s re-visit why this is of interest. Test&Target (and other tools like GWO) are wonderful when it comes to optimizing landing pages. They allow you to alter content/creative elements and see what works and what doesn’t. I have seen many cases where clients have used tools like Test&Target to change content based upon when brought the user to the website (i.e. Search Keyword) or demographic information (i.e. Location). Regardless of the reason you want to test, if it is a landing page, one of the questions you often get asked is related to Bounce Rate. Understanding how many people saw “Version A” of a test and bounced vs. those who saw “Version B” and bounced usually comes up for discussion. To answer this question using Omniture/Adobe tools you have the following options:
- Create a unique page name for each test variation and use the regular Pages report and Bounce rate metric. However, this can get very messy, so unless your website is small, I don’t recommend this approach.
- Use ASI or Discover to build a segment for people coming from “Version A” or “Version B” and then compare the bounce rates. This is a viable option if you have access to these tools and are well versed in Segmentation.
- Attempt to track Bounce Rates from within Test&Target. This does not come out-of-the-box, but if you have mboxes on all of the pages the landing page links to, I have heard of some people setting conversion events on the landing page and the subsequent pages, but I don’t think this is for novices (if you are interested, I’m sure @brianthawkins could figure out a way to hack this together!)
- Do what I suggest below!
Implementing A/B Bounce Rates
Luckily, implementing this in SiteCatalyst is relatively simple. All you need to do is the following:
- Enable a new Traffic Variable (sProp)
- In this new sProp, concatenate the Test&Target ID and the Page Name on each page of your website
- Enable Pathing on the new sProp
That’s it! By concatenating the Test&Target ID and the Page Name, you create a unique join between the two and can find the combination of the Test ID you care about and the page name that you expect them to have landed on. Once you find this combination in the report, you can add your Bounce Rate Calculated Metric (Single Access/Entries – which hopefully you already have as a Global Calculated Metric) and you are done. Here is an example of a report:

In this report, you have all of the ID’s associated with the US Home Page, how many Entries each received and the associated Bounce Rate. If you wanted, you could perform a search for the specific Test&Target Test ID you care about and then your report would be limited to just those ID’s. In the example above, we have multiple tests taking place on the US Home Page. However, in the following example we can see a case where there is just one test taking place on the UK Home Page and the associated Bounce Rate of each:

Other Cool Stuff
But wait…there’s more! Since you have enabled Pathing on this new A/B Test sProp, there are some other cool things you can do. First, you can look at a trended view of the report above to see how the Bounce Rate fluctuates during the course of the test. To do this, simply switch to the trended view and choose your time frame:

Another benefit of having Pathing enabled on this sProp is that you can see how visitors from various tests navigated your site using all of the out-of-the-box Pathing reports. Here is an example of a next page flow for one of the tests:

You can run the preceding report for each test variation and compare the path flows to see if one version pushes people more often to the places you want them to go. Another report you could run is a Fall-Out report which can show you how often people from a specific test made it through your desired checkpoints:

In this example, instead of seeing how the general population falls-out from the Home Page to a Product Page and then to a Form Page, we can limit the funnel to only those people who were part of Test ID “18964:1:0.” I like to run this report and the corresponding one for the other test version(s) and add them all to a SiteCatalyst Dashboard where I can see the fall-out rates side by side.
Final Thoughts
As you can see, by doing a little up-front work, you can add an enormous amount of insight into how your A/B tests are performing on your site including Bounce Rates, Next Page Flows, Fall-Out, etc…Enjoy!
Unless your website is very basic, odds are that you use some sort of navigation to help visitors find website content. Usually navigation is in the header or left side of web pages. Inevitably, there will be times when you are asked how often and in what ways visitors are using navigation. In this post I will cover some common navigation questions and how to answer them.
Common Questions
So what are the common questions you may get around navigation. Here are some that I have been asked over the years:
- Which individual navigation links are clicked the most?
- Which navigation areas are clicked the most? This is usually related to the main section area, not individual links.
- From which pages are visitors using each navigation link?
- For what percent of website visits is navigation used?
- In what order do website visitors use navigation links?
- Which navigation links lead to key website success milestones being accomplished?
The following will show how to answer each of these questions:
Which individual navigation links are clicked the most?
In this scenario, people are looking to see which detailed navigation links are clicked the most. In the image below, this would represent such links as “Sales Cloud 2,” “Service Cloud 2,” “Custom Cloud 2,” etc…

To answer this question, you should have your developer write code that will pass the name of the link to a Traffic Variable (sProp) when a visitor clicks on each link in your navigation. In addition, I highly recommend that you have them include the high-level navigation area in the value passed to the sProp. For example, when a visitor clicks on “Sales Cloud 2″ in the example above, I would pass the value of “products:sales cloud 2″ (I always use lower case since sProps are case-sensitive) to the sProp. Passing the high-level area will ensure that your data is clean as there are times when the same link can occur more than once in a navigation structure. When this is complete, you can view a report that looks like this:

Which navigation areas are clicked the most?
In this question, people are generally asking to see (in the example above) if the “Products” section is clicked more than the “About” section and if so, by how much. The good news is that if you have done the previous step correctly, you can answer this question by creating a SAINT Classification which rolls up the values in the preceding report into higher-level buckets. You can create this classification easily by exporting the above report to Microsoft Excel and splitting the column by the separator and using the first part as the high-level navigation name. Here is what your SAINT file might look like:

After you create and process this SAINT file you will be able to see a new high-level navigation report that looks like this:

From which pages are visitors using each navigation link ?
In this scenario, people at your company may want to know what is the most common top navigation link clicked from the home page or from another page on your site. To see this, you need to have setup a Previous Page sProp. This sProp passes the name of the previous page to the current page which allows you to create Traffic Data Correlations between it and any other Traffic variable. In this case, once we have a Previous Page sProp, we can correlate it to the Top Navigation Link sProp shown above to see what navigation links are clicked from each page. For example, I can open up the Previous Page sProp within a report suite and then break it down by the new Top Navigation sProp…

…to see a report like this:

In this case, we can see that the “customers:india customers” Top Navigation link was only clicked 482 times from the home page.
In addition, since this uses a correlation and correlations are bi-directional, you can also use this to find out all of the pages from which visitors clicked on a specific navigation link:

In this case, we can see that the “customers:india customers” link was clicked a total of 957 times and then see the breakdown of pages visitors were on when they clicked it. This can help your content people understand when visitors are reaching for the navigation… Finally, if you look closely, you can see that the “SFDC:in:homepage” shows the same 482 clicks referenced above, but in this case we can see that it accounts for 50% of all clicks this link gets across the entire website…
For what percent of website visits is navigation used?
In some cases, you may be asked how often website navigation is used (in general). One easy way to figure this out is to look at the the total Page Views from the first SiteCatalyst report shown in this post and divide it by the number of website Visits. This can be done easily using the ExcelClient where you can pull a Visits data block and the report above and divide the two. However, if you think you might need this on a recurring basis and if trending is important, I will show you another way to do this. When visitors click on navigation links, in addition to passing the link name to a Traffic Variable as shown above, set a “Navigation Clicks” Success Event. Once you have a Success Event, you can create a Calculated Metric that divides Navigation Clicks by Visits as shown here…

…which will allow you to see a report like this:

In what order do website visitors use navigation links?
If you are redesigning your navigation, a useful piece of data is the order in which visitors click on navigation links. Do they always click on the first items in the list? The ones that are farthest to the left? Fortunately, if you have implemented the items above, you can see this by simply enabling Pathing on the new Navigation Links sProp created above. This will allow you to view the Pathing reports including a Next Page Flow and Previous Page Flow just for navigation items:

Which navigation links lead to key website success milestones being accomplished?
Finally, I will occasionally be asked which navigation links are contributing to success. To answer this question, all you have to do is enable Participation for your key metrics on the Navigation links sProp described above. This will allow you to add a Participation metric to the first report shown above to see which links were in the flow of your key website Success Events.
Final Thoughts
Well, there you have it. Everything you wanted to know about tracking your website navigation, but were afraid to ask! If you have any comments/questions, use the form below.
I believe that every SiteCatalyst implementation should have a Previous Page sProp. There! I said it (I feel like I am channeling Avinash!). In past blog posts I have touched upon the use of a Previous Page sProp, but I feel like I have not done it justice and wanted to take time to explain it in greater detail. In this post, I will describe why I think this variable should always be set and provide some examples of its use.
Why You Need a Previous Page sProp
I find that in the web analytics world, I often receive the following question:
“What page was the visitor on when he/she _______?”
You can fill in the blank with many things. Here is a list of the ones I have been asked:
- …searched for this phrase in our internal search box…
- …clicked on a button to go to a web lead form…
- …downloaded a white paper…
- …added products to the shopping cart…
- …clicked on a banner advertisement…
- …started using the ROI calculator…
- …clicked to fill out a website survey…
I could go on for days and never come to the end of these types of questions! People want to know this information because it helps them get inside the head of their visitors. Often times it leads to navigation or content changes. Regardless of the reason, I assure you that you will be asked this question at some point and the truth is that it is not easy to answer with out-of-the-box functionality (i.e. Pathing). The good news is that setting the Previous Page sProp is easy and will pay great dividends down the road…
How To Set the Previous Page sProp
Setting the Previous Value sProp could not be easier. All you have to do is use the Previous Value JavaScript Plug-in to pass the previous page name to a new Traffic Variable (sProp). You can even see a detailed description of the code for this in Ben Gaines’ great Summit blog post. If you need help, call your Omniture Account Manager, Omniture Consulting or ClientCare.
Once you have your JavaScript setup to pass the Previous Page Name to the sProp, you need to enable a Traffic Data Correlation to any sProp for which you want to create a breakdown. For example, if you want to see what pages visitors were on when they searched for a particular internal search term, you would correlate the Previous Page Name sProp with the Internal Search Term sProp…

…so you can see a report like this:

In addition, if you are familiar with correlations, you may recall that they are bi-directional, so in addition to seeing the pages people searched for specific terms from, you can also see the converse. In this case, that would mean seeing all of the internal search terms visitors searched for on a specific page:

As you can see here, we see the same “4″ searches for the phrase “chatter” from the selected page as we saw in the first internal search term report (in this case I am just using Internal Search as an example, but if you want to learn more check out my Internal Search post).
One Is Usually Enough
However, one word of caution, I have seen many clients implement several Previous Page sProps and I am not a fan of doing this as I will now explain. Let’s say you want to see what page people were on when the searched on a specific search term (as described above) and you also want to see what page they were on when the downloaded files on your site. A lot of people will set two Previous Page sProps in this situation – one for the search term and one for the file downloads. In my opinion, this just wastes a variable, wastes correlations and causes confusion for your users. The truth is that all you need is one Previous Page sProp to answer both questions. Since on each page there will be one and only one Previous Page value, there is really no reason to do this multiple times.
I have seen some clients who have chosen to pass the Previous Page Name to an eVar. There are some interesting uses of this. For example, if you want to see what pages visitors were on when they added a specific product to the shopping cart, you can pass the Product Name to the Products Variable, set the Cart Add Success Event and the Previous Page Name to an eVar. The main issue you will run into is that Conversion Subrelations are an “all or nothing” proposition so you can only do breakdowns by eVars that have Full Subrelations.

One final tip that I will throw out there is to consider having your developer pass a value of “[NO PREVIOUS PAGE AVAILABLE]” (or something similar) to the Previous Page sProp on entry pages (or any other time no Previous Page is available). I find that this is easier than dealing with questions around “Unspecified” in correlation reports and it is easier to remove this value using the search box than it is to hide the “Unspecified” values.
Final Thoughts
As I mentioned in the beginning, I highly recommend that you have a Previous Page sProp for all of your key report suites and add correlations as needed. If you have any questions/comments, feel free to leave them here…
In my last post, I discussed how you can see how much money you are leaving on the table when it comes to the online shopping cart. While I still have the shopping cart on my mind, I thought I would follow this up with a concept I call Product Pathing. Product Pathing answers one of the questions I get from time to time: How can I see the order in which website visitors are looking at my products or product categories? The following will provide details on why you might want to do this and its implementation.
Why Product Pathing?
So why would you want to implement Product Pathing? Here are a few reasons:
- Understanding how visitors jump between products or product categories which helps you understand how visitors navigate your products
- Seeing what products are viewed concurrently which helps you understand what cross-sell/up-sell opportunities might exist
- If one of your website goals is to get visitors to view multiple products, you can measure how you are doing against that goal
There may be more reasons, but the preceding items should help you build a case for implementing this, especially since it is not difficult to do.
Implementing Product Pathing
So the standard way to see the answers to the questions above is to use page name-based Pathing reports. You might find the page name of a particular product and then look at Pathing reports to see what visitors did after viewing the product. However, I find that this approach does not work because there are so many pages on the website that it is impossible to sift through them all and isolate just product pages. Therefore, I am going to propose the following alternative solution:
- On all Product View Pages, in addition to setting a Product View Success Event and the Products Variable, pass the Product Name (or ID if that is all you have) to a new “Product” Traffic Variable (sProp). Be sure that you pass nothing but the Product Name (or ID) to this sProp.
- After that is done, enable Pathing on this sProp
Believe it or not, that is all you have to do! By passing only the Product Name (or ID) to this new sProp, you will have a clean, new sProp that allows you to see Pathing reports on only Products like this:

Moreover, keep in mind that you have access to all Pathing reports so you get the bonus benefits of seeing the following as well:
- How often visitors looked at Product X and then didn’t look at any other Products (Exit % – 42.32% in this case)
- All paths containing Product X (Full Paths Report)
- What Products visitors see (if any) between Product X and Product Z (Pathfinder Report)
- How often did visitors see Product X and then Product Y (Fallout Report)
- Which Products were viewed first the most often (Entries) or last the most often (Exits)
A Few Other Cool Uses of Product Pathing
In addition to this, there are a few other cool things you can do:
- Instead of passing Product Names (of IDs), you can pass in Product Categories to see the same data at a higher level
- Instead of passing Product Name values at the Product View Success Event, you can set an additional sProp in which you pass Product Names when the Cart Add Event is set to see the order in which visitors add products to the shopping cart
(Estimated Time to Read this Post = 3.5 Minutes)
From time to time, I will see people talking about some of the limitations of SiteCatalyst Traffic Data Correlations on Twitter and blogs. Below is the most common request I see:

For those of you not familiar with Correlations, they are a way to break one Traffic Variable (sProp) down by another sProp, assuming that both are set on the same page (image request). Unfortunately, in SiteCatalyst, the only metric you can see for Correlations are Page Views. In the example below, I can use a Correlation to see what page a visitor was on when searching for a specific phrase in the internal search box:

While this is handy, what if I wanted to see how many Visits people searched for this phrase from each page or better yet, how many Daily, Weekly, Monthly Unique Visitors did this? Currently, the only way to get at this information is to use DataWarehouse or Omniture Discover. However, the following section will show you a handy little hack to get this information directly from SiteCatalyst…
The Hack
So in this scenario, we will say that we want to see how many Weekly Unique Visitors searched for the phrase above from each page on our website (as in the example above). Here is the trick to doing this:
- Just as in a Correlation, you must have both data points you want to correlate available on the same page. In this example, it is Previous Page Name (from the GetPreviousValue JavaScript Plug-in) and the Internal Search phrase
- Once you have the two data points available, create a new Traffic Variable (sProp) and concatenate the two values using a separator. In this example, if the user searched for the above phrase from the Japan Customers page, the value would be “キーワード検索:SFDC:jp:customers”
- After you have passed the concatenated value to the sProp, contact your Omniture Account Manager and tell him/her that you would like to enable Visits, Daily Unique Visitors, Weekly Unique Visitors, etc… on that sProp
When all that is done, using the example above, you will have a report that looks like this:

The confusing part of this hack is that you won’t actually use a Correlation report anymore. You will no longer open one report and break it down by another report, but instead you will simply open the new sProp report and add the metrics you want to see. In the report above, I have added Page Views, Visits and Weekly Unique Visitors and searched on the specific Internal Search phrase for which I am interested.
However, as you can imagine, you could have a lot of unique values in this report. One caveat is that you need to make sure you don’t exceed the SiteCatalyst variable limit which is 500,000 unique values per month. In this example, you would want to make sure that the combination of Page Name and Search Term does not exceed 500,000 per month, but for most sites this shouldn’t be a problem.
Another thing to keep in mind is that the above scenario is just one example. This “hack” is by no means limited to Internal Search Terms and Pages. Here are some other examples of what you can do with this “hack:”
- Unique Visitors/Visits who saw a specific page by visit number (i.e. Home Page:Visit 1, Home Page: Visit 2, Demo Page: Visit 1, etc…)
- Unique Visitors/Visits who searched for a term by visit number (i.e. Pricing: Visit 1, Pricing: Visit 2, Demo: Visit1, etc…)
- Unique Visitors/Visits who saw a specific page by country (i.e. Home Page:US, Home Page:UK, Demo Page:US, etc…)
- Unique Visitors/Visits viewing a specific product page by search engine (i.e. Product X:Google, Product Y: Google, Product X:Yahoo, etc…)
- Unique Visitors/Visits viewing a specific product page by search keyword (i.e. Product X:walmart, Product Y:walmart, Product X: walmart.com, etc…)
These are just a few examples and my advice is to look at whatever you are currently correlating (in Admin Console) and determine the items for which you would like to see Visits and Unique Visitors.
Advanced Users
For advanced users out there, I wanted to call out a few more things you can do with this concept:
- If you don’t have a lot of unique combinations, you can add multiple correlations to the same sProp and use the search box to find the item combinations you need. For example, you may use the Internal Search & Page example shown above, but also store Page Name & Visit Number combinations in the same sProp. As long as all of your data is underneath the 500,000 unique value monthly limit you are ok. Alternatively, you can multiple sProps assuming you have enough variables that can have Visits and Unique Visitors enabled remaining in your contract.
- With this alternative approach, you can also view Trending Reports for each of your combinations if you enable Pathing. This means that you can trend Visits or Unique Visitors for any combination (i.e. Weekly Unique Visitors who view Product Page X on Visit Number 1 over the last 90 days). This temporarily solves the following Idea Exchange item (Allow Trended Versions of Correlation Reports)
Final Thoughts
So there you have it. Just a quick “hack” that allows you to get a bit more information out of SiteCatalyst. In the future, perhaps Omniture will allow you to see Visits and Unique Visitors right form the normal Correlation interface (please vote for this here: Provide Visits and Unique Visitors in Correlation Reports), but in the meantime, hopefully this will help bridge the gap…
In the past, I have written about Bounce Rates, Traffic Source Bounce Rates and Segment Bounce Rates. Hopefully this will be my last post related to Bounce Rates, but I recently found a “hack” to calculate and trend a Site Wide Bounce Rate in SiteCatalyst so I thought I would share it. I define Site Wide Bounce Rate as the total number of Single Access Visits divided by the total number of website Visits. Unfortunately, for some reason, this metric is very difficult to wrestle down in Omniture SiteCatalyst because you cannot view Pathing metrics (i.e. Entries, Single Access) in Calculated Metrics unless you are within an Traffic (sProp) report that has Pathing enabled.
To date, the way I have reported on Site Wide Bounce Rate was by pulling Visits and Single Access data into Excel using the SiteCatalyst ExcelClient. Once there, I could divide the two and if I wanted to see it by day (or week or month), all I needed to do was to pull both metrics by day. It was straightforward, but I could not add this to my SiteCatalyst Dashboards.
The Hack
So let’s say that you want to report a daily/weekly/monthly trend of your Site Wide Bounce Rate and add it to one of your executive dashboards. Here are the steps:
- First you need to create the required calculated metric. In this case you want to divide Total Single Access by Total Visits (or Total Entries which is the same thing). I would recommend making this a Global Metric so all of your users have access to it going forward:

- Once this metric is created, open your Pages report, click the Add Metrics link and add the new Site Wide Bounce Rate metric to your list of metrics. It will be under the Calculated Metrics area. Place this new Site Wide Bounce Rate metric so it is the first metric and then add your regular Bounce Rate metric and finally add the Page Views metric and click the small triangle to sort by Page Views. When you are done, it should look like this:

- When you click OK, you will be able to see a report that shows your most popular pages, the Bounce Rate for each page and the overall Site Wide Bounce Rate. This report is handy for seeing how each page is doing in relation to the Site Wide Bounce Rate.

- However, our original objective was to see the trend of the Site Wide Bounce Rate and add it to a dashboard, so let;s get back on track. To do this, all you have to do is click the “Trended” link shown in the report above. As is always the case, trending will show you the left-most metric trended over your chosen date range (which is why it was important to put Site Wide Bounce Rate in the first metric slot!). After clicking it, you will see a report that looks like this:

So the resulting graph is your Site Wide Bounce Rate and you can now add this to any SiteCatalyst Dashboard. However, as you recall, I mentioned this is a “hack” so if you look closely you will see a bunch of pages in the data table for this report. What is strange is that the values for each row are the exact same. This is the place where you can see how much of a hack this is. This data is pretty much useless so I recommend just adding the graph to your dashboards and ignoring the data table. Perhaps in the future Omniture will let us add this type of Calculated Metric to the “My Calc Metrics” area so we don’t have to take such a convoluted path to add this trend graph to a dashboard!
Final Thoughts
So there you have it. A quick hack in case you ever need to calculate Site Wide Bounce Rate for your HIPPO’s! Enjoy!
In my last post, I covered Comparison Reports and showed the basics on how to use them. In this post, I will cover a few advanced ways that I use these reports related to Pathing reports.
Date-Based Pathing Comparisons
For many of the analyses I perform, I like to see how website visitors are navigating my site via Pathing reports. However, these reports are usually static – for a specified time period. Therefore, what I like to do is to view a few of the standard SiteCatalyst Pathing reports in a way that I can see how Pathing is changing day to day, week to week or month to month. While SiteCatalyst doesn’t let you use comparison reports in all Pathing reports, there are a few key ones that do allow you to compare date ranges – Next/Previous Page Report and Full Paths Report. The following are some examples of how you can take advantage of this.
Next/Previous Page Report
Let’s say that you have a key page like your home page and you want to see what pages visitors are going to from it in March vs. February. To do this, simply open the Next Page report (under Pathing) and select the Home Page as the page of focus. Once there, you can use the calendar as shown in my last post to select two different time periods (February & March in this case) and see the report:

When looking at this type of report, I tend to change the graph so I am looking at percentages instead of the raw numbers since that is what I care about the most. Also, you can apply Normalization to this report by selecting it in the report settings (to learn about Normalization see my previous post). Finally, the same principles apply if you want to see the above report as a Previous Page report to see how people are getting to a specific page differently between two different time periods.
Full Paths Report
In this next example, let’s say that we don’t have a specific page in mind, but rather, want to see how all of our paths are changing between two different time periods. To do this, you can use the Full Paths report (found under Pathing). This report shows all of your paths and can be quite massive, but I tend to use it to see just my top few site paths. Using the date comparison feature, you can see how the paths of the same site differ between two distinct time periods. To do this, simply open the Full Paths report and use the calendar tool to select your two date ranges and you will see a report that looks like this:

As you can see, this report allows you to look at your top paths and see if there are any significant changes you should know about. This is handy if you have a special promotion on a page and want to see how it is changing your Pathing behavior. Finally, there are some cool advanced things you can do in the Full Paths report like limiting paths to a specific number of pages and specifying an entry page, but you can explore that as needed.
Site-Based Pathing Comparisons [If you don't have multiple report suites or ASI slots you can skip this section!]
As I mentioned in my previous post, the other type of comparison report you can create is one based upon report suites/ASI slots. These comparisons allow you to see how one data set is doing compared to another. A perfect example of this is if you are part of a multinational and have basically the same website for different geographies. Other examples might be a company that has multiple divisions/products that are similar enough that they use the same type of website template. In both of these cases, you have the same page names, just different locales or products and might want to see how one is doing vs. another. In this example, we will assume that a website is basically the same except for the site geography and that we want to see how people are navigating from the home page of two different geographies. If you are clever, you will quickly realize that this might be problematic since each website might have different page names including the site locale. This why in my Page Naming Best Practices post I recommended that you set a custom sProp without the site locale (and have Pathing enabled). Here is a quick excerpt from that post:
One wrinkle that can emerge are cases where you have multiple geographic websites. For many companies, this results in a similar version of the website, but translated into different languages. If you have this situation, I recommend tweaking the above page names to include a site locale indicator. For example, each page in the UK site should have “uk:” in the page name and so on. When this is done, your page names might look like this:

[Advanced User Alert - If you have multiple site locales, I also recommend passing the page name without the site locale to a different sProp (with Pathing enabled) so you can see how a page does across all site locales (i.e. Participation). I also like to pass the site locale by itself to a separate sProp so in a global report suite I can create correlations between sProps and other variables (i.e. Internal Search Terms).]
If you have done this, then you can simply open the next page report for this custom sProp (that has no site locale) and choose the “Compare to Site” option and select the sites that you want to compare. In this example, I am looking to see what visitors from Spain and Italy do when they are on the home page. In this case, I am normalizing the data so I can get a better view of the next page differences between the two sites even if they have different amounts of traffic. As mentioned previously, you can do the same thing for Previous Page and Full Path reports…

Using Comparisons With Other Custom sProps
Lastly, if you have Pathing enabled for other custom sProps, you can take advantage of this functionality there as well. Let’s say you have Pathing enabled on what internal search terms people look for on your website. You can compare this between websites or for two different time periods. Below is an example of looking at the same internal search terms for two different time periods.
Final Thoughts
These two posts should cover pretty much all you need to know about SiteCatalyst comparison reports. If you are using them in any other creative ways, please leave a comment here. Thanks!
Often times when I used to work with clients and now internally, I am surprised to see how many SiteCatalyst users don’t take advantage of Comparison Reports within the SiteCatalyst interface. In this post I will review these reports so you can decide if they will help you in your daily analysis.
Comparing Dates
Hopefully most of you are familiar with this type of Comparison Report. This report type allows you to look at the same report for two different date ranges. To do this, simply open up an sProp or eVar report and click the calendar icon and choose Compare Dates when you see the calendar. In the example shown here, I am going to compare February 2010 with March 2010:

For this example, I have chosen the Browser report, using Visitors as the metric. After selecting the above dates, my report will look like this:

As you can see, SiteCatalyst adds a “Change” column where it displays the difference between the two date ranges. This can be handy to spot major differences between the two date ranges. In this case we can see that “Microsoft Internet Explorer 8″ had a big increase and that “Mozilla Firefox 3.5″ had a decrease (probably due to version 3.6!). You can compare any date ranges you want from one day to one year vs. another year.
However, when you compare ranges that have different numbers of days, your results can be skewed. For example, in the report above, March had three more days than February so that may account for why the differences between the two are so stark. If this ever becomes an issue, you can take advantage of a little-known feature of Comparison Reports – Normalization. In the report settings, there is a link that allows you to normalize the data. When you normalize the data, SiteCatalyst makes the totals at the bottom of each report match and increases/decreases the values of one column to adjust for the different number of days. I am not 100% sure what specific formula or algorithms are used to do this, but for the amount of times that you will use it, I would go ahead and trust it. Below is an example of the same report with Normalization enabled:

If you look closely, you will see that the March 2010 column has been normalized when we clicked the “Yes” link shown in the red box above. By doing this, SiteCatalyst has reduced the numbers in the March 2010 column to assume the same number of Visitors as there were in February. If you want to normalize such that February is increased to match March, you simply have to reverse the date ranges so when you select your dates, March is the first column and February is the second column (the second column is always the one that gets adjusted). As you can see, the “Change” column is now dramatically different! In this version, “Microsoft Internet Explorer 8″ no longer looks like it has changed much. I find that using this feature allows me to get a more realistic view of date range differences.
Finally, you may notice a tiny yellow box in the preceding report image (says “6,847″). This is a secret that not many people know about. When you normalize data, Omniture artificially reduces or increases the values in the normalized column. But if you want to see what the real value is (if not normalized), you can hover your mouse over any value and you will see a pop-up with the real number! If you look at the first version of the report (the one before we normalized), you will see the same “6,847″ number in the first row of the report… Pretty cool huh?
Comparing Suites
This second type of Comparison Report is the one that fewer people are aware of or have used. In this type of comparison, instead of comparing date ranges you compare different report suites. Obviously, this only makes sense if you have more than one report suite, but it also works with ASI slots so don’t assume this isn’t relevant to you if you have just one report suite. Much of the mechanics of this are similar to the steps outlined above. You simply open one report (in this case we will continue to use the Browser report) and then choose the “Compare to Site” link and choose a second report suite or ASI slot. In this case, I am showing an example of the Browser report for two different geographic locations. Since most report suites have different totals, I tend to use Normalization more in these types of comparison reports.

Final Thoughts
This covers the basics of Comparison Reports. Hopefully you can use this to start creating these reports and adding them as scheduled reports or even to Dashboards. In my next post, I will take this a step further and demonstrate an advanced technique of using Comparison Reports…
In the Web Analytics space, we spend a lot of time recording and analyzing what people do on our website in order to improve revenues and/or user experience. While this implicit data capture is wonderful, you should be supplementing it with data that you collect directly from your website visitors. Voice of Customer (VOC) is the term often used for this and it is simply asking your customers to tell you why your website is good or bad. There are two main ways that I have seen people capture Voice of Customer:
- Page-Based Comments – Provide a way for website visitors to comment on pages of your site. This is traditionally used as a mechanism to get direct feedback about a page design, broken links or problems people are having with a specific page. Unfortunately, most of this feedback will be negative so you need to have “thick skin” when analyzing this data!
- Website Satisfaction – Provide a way for visitors to rate their overall satisfaction with your website experience (vs. specific pages). This is normally done by presenting visitors with an exit survey where you ask standard questions that can tell you how your website is doing and compares your site against your peers.
There are numerous vendors in each of these spaces and the goal of this post is not to compare them, but rather discuss how you can integrate Voice of Customer data into your Omniture SiteCatalyst implementation. In this post, I am going to focus on the first of the aforementioned items (Page-Based Comments) and specifically talk about one vendor (OpinionLab) that I happen to have the most direct experience with (their headquarters was a mile from my home!). The same principles that I will discuss here can be applied to all Voice of Customer vendors so don’t get hung up on the specific vendor for the purposes of this post.
Why Integrate Voice of Customer into SiteCatalyst
So given that you can see Voice of Customer data from within your chosen VOC tool, why should you endeavor to integrate Voice of Customer and your web analytics solution? I find that integrating the two has the following benefits:
- You can more easily share Voice of Customer data with people without forcing them to learn [yet] another tool. People are busy and you are lucky if they end up mastering SiteCatalyst, lest you make them learn how to use OpinionLab, Foresee Results, etc…
- Many Voice of Customer tools charge by the user so if you can port their data into SiteCatalyst, you can expose it to an almost unlimited number of users.
- You can use Omniture SiteCatalyst’s date and search filters to tailor what Voice of Customer each employee receives.
- You can divide Voice of Customer metrics by other Website Traffic/Success Metrics to create new, interesting KPI’s.
- You can use Omniture SiteCatalyst Alerts to monitor issues on your site.
- You can use Omniture Discover to drill deep into Voice of Customer issues
I hope to demonstrate many of these benefits in the following sections.
How to Integrate Voice of Customer into SiteCatalyst
So how exactly do you integrate Voice of Customer data into SiteCatalyst. For most VOC vendors, the easiest way to do this is by using Omniture Genesis. These Genesis integrations are already pre-wired and make implementation a snap (though there are cases where you may want to do a custom integration or tweak the Genesis integration). You can talk to your Omniture account manager or account exec to learn more about Genesis.
Regardless of how you decide to do the implementation, here is what I recommend that you implement:
- Set three custom Success Events for Positive Page Ratings, Negative Page Ratings and Neutral Page Ratings. These Success Events should be set on the “Thank You” page after the visitor has provided a rating.
- Pass the free form text/comment that website visitors enter into an sProp or eVar. If they do not leave a comment pass in something like “NO COMMENT” so you can make sure you are capturing all comments. If you are going to capture the comments in an sProp, I recommend you use a Hierarchy variable since those have longer character lengths vs. normal sProps which can only capture 100 characters.
- Pass the actual page rating (usually a number from 1 to 5) into an sProp. I also recommend a SAINT Classification of this variable such that you classify 1 &2 as Negative, 3 as Neutral and 4 & 5 as Positive. This classification should take less than 5 minutes to create…
- Use the PreviousValue plug-in to pass the previous page name to an sProp.
- Create a 2-item Traffic Data Correlation between the Previous Page (step #4) and Page Rating (step #3). This allows you to see what page the user was on when they submitted each rating.
All in all, this is not too bad. A few Success Events and a few custom variables and you are good to go. The rest of this post will demonstrate some of the cool reports you can create after the above implementation steps are completed.
Share Ratings
As I mentioned previously, you [hopefully] have users that have become familiar with the SiteCatalyst interface. This means that they have Dashboards already created to which you can add a few extra reportlets. In this first example, let’s imagine that you want to graphically represent how your site is doing by day with respect to Positive, Negative and Neutral ratings. To do this, all you have to do is open the Classification version of the Page Rating report (can be an sProp or eVar – your call) and switch to the trended view. You should have only three valid values and I like to use a stack ranked graph type using the percentage to see how I am doing each day as shown here:

This graph allows me to get a quick sense of how my site is doing over time and can easily be added to any Dashboard.
You can also mix your newly created Voice of Customer Success Events with other SiteCatalyst metrics. For example, while you could look at a graph/trend of Positive or Negative Comments by opening the respective Success Events, a better way to gauge success is to divide these new metrics by Visits to see if you are doing better or worse on a relative basis. The following graph shows a Calculated Metric for Negative Comments per Visit so we can adjust for traffic spikes:

Find Problem Pages
Another benefit of the integration is that you can isolate ratings for specific pages. The first way to do this is to see which pages your visitors tend to rate positively or negatively. In the following report, you can open the Rating variable report (or Classification of it as shown below) and break it down by the Previous Page variable to see the pages that most often had negative ratings:

This will then result in a report that looks like this:

Alternatively, if you want to see the spread of ratings for a specific page, all you need to do is find that page in the Previous Page report and break it down by the Rating variable (or its Classification) as shown here:

Share Comments
As noted above, if you capture the actual comments that people leave in a variable, you will have a SiteCatalyst report that captures the first 256 characters of the comments visitors enter. This report duplicates scheduled reports from your Voice of Customer vendor in that it allows you to share all of the comments people are leaving with your co-workers. However, by doing this through SiteCatalyst, you gain some additional functionality that some VOC vendors don’t provide:
- You can create a Traffic Data Correlation between the Comments variable and the Previous Page variable so you can breakdown comments for a specific page. Therefore, if you have users that “own” specific pages on the website, you can schedule daily/weekly reports that contain comments only for those pages so they don’t have to waste time reading all of the comments left by visitors.
- You can use the Search filter functionality of SiteCatalyst to scan through all of the visitor comments looking for specific keywords or phrases that your co-workers may be interested in. In the example below, the user is looking for comments that mention the words “slow” or “latent” to be notified of cases where the visitor perceived a page load speed issue:

Set Alerts
Another cool thing you can do with this integration is set automated Alerts in SiteCatalyst so you can be notified when you see a spike in Negative Comments on your site. This allows you to react quickly to broken links or other issues before they affect too many visitors (and help avoid #FAIL posts in Twitter!). Here is an example of setting this up:

Review Problem Visits using Omniture Discover
Finally, if you have access to Omniture Discover, after you have implemented the items above, you can use Discover to do some amazing things. First, you can use the unlimited breakdown functionality to zero in on any data attribute of a user that is complaining about your site. For example, if you had visitors complaining about not being able to see videos on your site, you might want to see their version of Flash, Browser, OS, etc… or even isolate when the problem took place as shown here:

Additionally, you can use Discover to isolate specific comments and watch the exact visit that led to that comment. This is done through a little-known feature of Discover called the “Virtual Focus Group.” This feature allows you to review sessions on your site and see the exact pages people viewed and some general data about their visit (i.e. Browser, GeoLocation, etc…). While not as comprehensive as tools like Clicktale, it is good enough for some basic analysis. Here is how to do this:
- Open Discover and find the comment you care about in the custom sProp or eVar report
- Right-click on the row and create a Visit segment where that comment exists
- Save the segment in a segment folder
- Open the Virtual Focus Group (under Pathing in Discover)
- Add your new segment to the report by dragging it to the segment area
- Click “New Visit” in the Virtual Focus Group
- Click on the “Play” button to watch the visit

Now you can watch how the user entered your site, what pages they went to and see exactly what they had done prior to hitting the Voice of Customer “Thank You” page.
Final Thoughts
So there you have it, a quick review of some cool things you can do if you want to integrate your chosen Voice of Customer tool and Omniture SiteCatalyst. If you are interested in this topic, I have written a white paper with OpinionLab that goes into more depth about Voice of Customer Integration (click here to download it). If you have done other cool things, please let me know…
|