<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>WellonTop &#187; Data</title>
	<atom:link href="http://wellontop.com/tag/data/feed" rel="self" type="application/rss+xml" />
	<link>http://wellontop.com</link>
	<description>Internet Research in the Fields of Business, Psychology, &#38; Technology</description>
	<lastBuildDate>Fri, 26 Feb 2010 19:07:28 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Twitter&#8217;s &#8220;Link Click Count&#8221; Provides Analytics, Revenue, &amp; 503 Errors</title>
		<link>http://wellontop.com/twitter-link-click-count</link>
		<comments>http://wellontop.com/twitter-link-click-count#comments</comments>
		<pubDate>Wed, 09 Sep 2009 19:26:05 +0000</pubDate>
		<dc:creator>Sean Weigold Ferguson</dc:creator>
				<category><![CDATA[Featured]]></category>
		<category><![CDATA[Analytics]]></category>
		<category><![CDATA[Business]]></category>
		<category><![CDATA[Data]]></category>
		<category><![CDATA[Micro-blogging]]></category>
		<category><![CDATA[Social Media]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://wellontop.com/?p=329</guid>
		<description><![CDATA[Twitter is now tracking data about outbound links on their website. While this has been covered before, it is worth exploring how, why, and what effects it has on us.<p><hr />
<p><small><a href="http://wellontop.com/twitter-link-click-count">Twitter&#8217;s &#8220;Link Click Count&#8221; Provides Analytics, Revenue, &amp; 503 Errors</a></small></p>
<p><small>was brought to you by <a title="Internet Research on Business, Psychology, &amp; Technology - WellonTop" href="http://wellontop.com/">WellonTop Internet Research</a></small></p></p>
]]></description>
			<content:encoded><![CDATA[<p>Twitter is now tracking data about outbound links on their website. While this has been <a title="Twitter Wants to Track Your Clicks" href="http://www.techcrunch.com/2009/08/25/twitter-wants-to-track-your-clicks/">covered before</a>, it is worth exploring how, why, and what effects it has on us.</p>
<p>If you click an outbound link on <a title="Twitter" href="http://twitter.com/">Twitter.com</a> and immediately hit stop, your browser&#8217;s address bar will display something something similar to:</p>
<p>http://twitter.com/link_click_count?url=http%3A%2F%2Fsu.pr%2F1VF3eU&#038;linkType=web&#038;tweetId=3822962256&#038;userId=17594917&#038;authenticity_token=fa92ae1a3b002f6051a9f8d304cef09e0095ee09</p>
<p>If you allow this link to continue loading, you will be redirected to the URL on which you clicked via a 0.1 second <a href="http://web-sniffer.net/">meta refresh</a>.</p>
<p>Let&#8217;s take a look at what information Twitter is collecting.</p>
<dl>
<dt><span style="font-weight:normal">http://twitter.com/link_click_count</span></dt>
<dd>It appears fairly obvious that Twitter&#8217;s aim is to count clicks on outbound links.</dd>
<dt><span style="font-weight:normal">url=http%3A%2F%2Fsu.pr%2F1VF3eU</span></dt>
<dd>If you&#8217;re not familiar with URL encoding, don&#8217;t let the messy-looking characters scare you. This is the equivalent of <a href="http://su.pr/1VF3eU">http://su.pr/1VF3eU</a></dd>
<dt><span style="font-weight:normal">linkType=web</span></dt>
<dd>Refers to where the link was clicked. At this time, it appears that Twitter is only tracking links on Twitter.com. The existence of this parameter seems to be evidence that they are considering expanding beyond that.</dd>
<dt><span style="font-weight:normal">tweetId=3822962256</span></dt>
<dd>A unique number assigned to every Tweet. Combining this number with the username of its Tweeter will display the status update: <a href="http://twitter.com/seanwf/status/3822962256">http://twitter.com/seanwf/status/3822962256</a></dd>
<dt><span style="font-weight:normal">userId=17594917</span></dt>
<dd>This number is used to uniquely identify each Twitter user; roughly equivalent to their username.</dd>
<dt><span style="font-weight:normal">authenticity_token=fa92ae1a3b002f6051a9f8d304cef09e0095ee09</span></dt>
<dd>A unique random string value. This security measure was unfortunately exploited by the hacker behind the <a title="How the Twitter StalkDaily Worm Spread so Fast" href="http://unitstep.net/blog/2009/04/13/how-the-twitter-stalkdaily-worm-spread-so-fast/">StalkDaily Worm fiasco</a>.</dd>
</dl>
<h2>What Does Twitter Know?</h2>
<p>We can glean from this that Twitter now has access to a smorgasbord of information about links on Twitter.com. As it turns out, the &#8220;authenticity_token&#8221; mentioned above is actually a cookie-based string. What this means to us is that <strong>Twitter can track a user&#8217;s click-behavior over multiple accounts</strong>.</p>
<p>Twitter can correlate your click-behavior with all of the information related to your account including:</p>
<ul>
<li>Name</li>
<li>Location</li>
<li>Bio</li>
<li>Homepage</li>
<li>Following</li>
<li>Followers</li>
<li>Date Joined</li>
<li>Time Zone</li>
<li>Tweets</li>
</ul>
<p>The same data is available about the user who shared the link with you and any users mentioned in the tweet. All data related to the Tweet containing the link is also tied to your click such as:</p>
<ul>
<li>Date Created</li>
<li>Users Mentioned</li>
<li>Application Used</li>
</ul>
<h2>Good for Twitter, Bad for Users</h2>
<p>Personally, I have noticed that this redirection adds a noticeable lag when loading external pages. It appears that I am not the only one <a href="http://search.twitter.com/search?q=link_click_count" title="Twitter Search - Link_Click_Count">experiencing this</a> unfortunate side-effect. Another negative consequence to users is that when <a href="http://www.techcrunch.com/2009/09/09/death-taxes-broken-twitter/" title="Death, Taxes, Broken Twitter">Twitter experiences server issues</a>, the outbound links on Twitter.com may stop working.</p>
<p>Twitter has yet to announce any plans to make this data available to developers. Could this be part of a larger strategy to make Twitter.com relevant despite <a href="http://www.readwriteweb.com/archives/twitter_open_platform_advantage.php" title="Twitter's Open Platform Advantage">less than 10%</a> of the platform&#8217;s traffic passing through the website? One thing is certain. This new feature gives Twitter access to an enormous quantity of valuable information that can be used to generate revenue through their <a href="http://digital.venturebeat.com/2009/08/20/twitter-to-roll-out-commercial-accounts-this-year-co-founder-stone-says/" title="Twitter to Roll Out Commercial Accounts this Year">new commercial accounts</a>.</p>
<h3>Delving Deeper into the Data &#8211; Twitter Demographics</h3>
<p>In my next post, we will be exploring the demographics of Twitter users through a meta-analysis of about a dozen data sets. What we learn may surprise you and challenge some assumptions about the types of people using the micro-blogging platform.</p>
<h5>Notes</h5>
<p>Photo curteosy of <a title="Flickr.com" href="http://www.flickr.com/">Flickr</a> and:</p>
<div xmlns:cc="http://creativecommons.org/ns#" about="http://www.flickr.com/photos/joshsemans/3373700426/"><small><a rel="cc:attributionURL" href="http://www.flickr.com/photos/joshsemans/">joshsemans</a> / <a rel="license" href="http://creativecommons.org/licenses/by/2.0/">CC BY 2.0</a></small></div>
<h3 class='related_post_title'>Related Posts:</h3>
<ul class='related_post'>
<li><a href='http://wellontop.com/social-media-small-business-yoono' title='Social Media for Small Business &#8211; Yoono Models Best Practices'>Social Media for Small Business &#8211; Yoono Models Best Practices</a></li>
<li><a href='http://wellontop.com/competitive-intelligence-research-introduction' title='Researching the Validity of Online Competitive Intelligence Tools &#8211; Introduction'>Researching the Validity of Online Competitive Intelligence Tools &#8211; Introduction</a></li>
<li><a href='http://wellontop.com/10-reasons-you-must-attend-izeafest-2009' title='10 Reasons You MUST Attend IZEAfest 2009'>10 Reasons You MUST Attend IZEAfest 2009</a></li>
</ul>
<p><hr />
<p><small><a href="http://wellontop.com/twitter-link-click-count">Twitter&#8217;s &#8220;Link Click Count&#8221; Provides Analytics, Revenue, &amp; 503 Errors</a></small></p>
<p><small>was brought to you by <a title="Internet Research on Business, Psychology, &amp; Technology - WellonTop" href="http://wellontop.com/">WellonTop Internet Research</a></small></p></p>
]]></content:encoded>
			<wfw:commentRss>http://wellontop.com/twitter-link-click-count/feed</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Competitive Intelligence Tools &#8211; Alexa, Compete, Google Trends &amp; Quantcast</title>
		<link>http://wellontop.com/competitive-intelligence-digg-stumbleupon</link>
		<comments>http://wellontop.com/competitive-intelligence-digg-stumbleupon#comments</comments>
		<pubDate>Mon, 06 Jul 2009 01:08:05 +0000</pubDate>
		<dc:creator>Sean Weigold Ferguson</dc:creator>
				<category><![CDATA[Featured]]></category>
		<category><![CDATA[Alexa.com]]></category>
		<category><![CDATA[Compete.com]]></category>
		<category><![CDATA[Competitive Analysis]]></category>
		<category><![CDATA[Data]]></category>
		<category><![CDATA[Digg]]></category>
		<category><![CDATA[Google Trends]]></category>
		<category><![CDATA[Quantcast.com]]></category>
		<category><![CDATA[Research]]></category>
		<category><![CDATA[Social Bookmarking]]></category>
		<category><![CDATA[Statistics]]></category>
		<category><![CDATA[StumbleUpon]]></category>
		<category><![CDATA[Traffic]]></category>

		<guid isPermaLink="false">http://blog.wellontop.com/?p=3</guid>
		<description><![CDATA[Competitive analysis tools have developed a pretty bad reputation, and for some fairly valid reasons. What, if any value do they actually offer us?<p><hr />
<p><small><a href="http://wellontop.com/competitive-intelligence-digg-stumbleupon">Competitive Intelligence Tools &#8211; Alexa, Compete, Google Trends &amp; Quantcast</a></small></p>
<p><small>was brought to you by <a title="Internet Research on Business, Psychology, &amp; Technology - WellonTop" href="http://wellontop.com/">WellonTop Internet Research</a></small></p></p>
]]></description>
			<content:encoded><![CDATA[<p>The veracity of the data provided by free competitive intelligence tools is often called into question. In some cases it seems like traffic estimates are so out of line with reality that the entire industry is just bunk. What, if any value do they actually offer us?</p>
<h2>StumbleUpon v. Digg &#8211; A Case Study</h2>
<p>The purpose of this case study is to describe the predictions made by five free competitive analysis tools. We will do this by comparing estimates of unique visitors to two popular social bookmarking websites. At the end I&#8217;ll share a small but valuable secret that will allow us to test any hypotheses we form.</p>
<h3>Quantcast</h3>
<p>A cursory glance at <a title="StumbleUpon.com on Quantcast.com - US Traffic Estimate" href="http://www.quantcast.com/stumbleupon.com#traffic">Quantcast&#8217;s visitor estimates for StumbleUpon.com</a> isn&#8217;t particularly interesting. According to Quantcast, <a title="StumbleUpon" href="http://www.stumbleupon.com">StumbleUpon</a> receives less than a million unique <acronym title="United States">US</acronym> visitors/month. Even worse, the website has shown a dramatic decline in traffic since March of this year. For a website with nearly <strong>8 million</strong> members worldwide, StumbleUpon&#8217;s numbers are at best disappointing, especially compared to <a title="Digg.com on Quantcast.com" href="http://www.quantcast.com/digg.com">Digg&#8217;s <strong>12.5 million</strong> unique <acronym title="United States">US</acronym> visitors/month</a>.</p>
<p><a title="StumbleUpon.com v. Digg.com on Quantcast.com - US Traffic Estimate" href="http://www.quantcast.com/profile/trafficGraph?wunit=wd%3Acom.stumbleupon&#038;wunit1=wd:com.digg&#038;drg=us&#038;dty=pp&#038;dtr=dm&#038;gl=6mo&#038;ggt=large"><img src="http://wellontop.com/images/quantcast_stumbleupon_digg_traffic.gif" alt="StumbleUpon.com &amp; Digg.com on Quantcast.com - Unique Monthly US Visitors Estimate" /></a></p>
<h3>Compete.com</h3>
<p>Comparing <a title="StumbleUpon.com &amp; Digg.com on Compete.com - US Traffic Estimate" href="http://siteanalytics.compete.com/stumbleupon.com+digg.com/">StumbleUpon and Digg on Compete.com</a> tells a slightly different story. In strong contrast to Quantcast&#8217;s <strong>directly measured</strong> data, Compete estimates Digg receives almost <strong>39 million</strong> unique <acronym title="United States">US</acronym> visitors/month. Compete&#8217;s estimate is more than <strong>3x</strong> the actual traffic volume. Compete also comparitively exaggerates StumbleUpon&#8217;s traffic at <strong>5 million</strong> visitors; more than <strong>6x</strong> Quantcast&#8217;s estimate.</p>
<p><a title="StumbleUpon.com v. Digg.com on Compete.com - US Traffic Estimate" href='http://siteanalytics.compete.com/stumbleupon.com+digg.com/?metric=uv'><img alt="StumbleUpon.com v. Digg.com on Compete.com - Unique Monthly US Visitors Estimate" src="http://wellontop.com/images/compete_stumbleupon_digg_traffic.gif" /></a></p>
<h3>Alexa</h3>
<p>Adding another tool only makes things more confusing. Alexa estimates the <a title="StumbleUpon.com &amp; Digg.com on Alexa.com - Global Reach Estimate" href="http://alexa.com/siteinfo/digg.com+stumbleupon.com">global reach of Digg and StumbleUpon</a> to be .53% and .19% respectively. It&#8217;s important to note that we cannot directly compare <a title"About Alexa Traffic Rankings" href="http://alexa.com/help/traffic-learn-more">Alexa&#8217;s &#8220;daily reach&#8221;</a> (even averaged over 30 days) with &#8220;unique monthly visitors.&#8221; The problem is that each measure two distinct (however related) variables. In order to properly compare the two, we need to account for how many <em>visits</em> unique visitors are responsible for. If that doesn&#8217;t make sense yet, don&#8217;t worry, I still have a hard time wrapping my head around it too. Leave a comment and I&#8217;ll make sure to follow up with a post explaining it.</p>
<p>For the purposes of this limited case study we&#8217;ll assume there are approximately <a title="World Internet Usage Statistics" href="http://www.internetworldstats.com/stats.htm">1.6 billion internet users</a> worldwide, half of whom (<strong>800 million</strong>) are online on any given day. Digg should be receiving <strong>4.2 million</strong> unique global visitors/day compared to StumbleUpon&#8217;s <strong>1.5 million</strong>. We know that Alexa&#8217;s estimate for Digg is more than double the true number, but what about StumbleUpon?</p>
<p><a title="StumbleUpon.com v. Digg.com on Alexa.com - Global Reach Estimate" href="http://alexa.com/siteinfo/stumbleupon.com+digg.com"><img alt="Digg.com v. StumbleUpon.com on Alexa.com - Global Reach Estimate" src="http://wellontop.com/images/alexa_stumbleupon_digg_traffic.gif" /></a></p>
<h3>Google Trends</h3>
<p>At this point, it seems like we may as well just throw our hands up in the air and acknowledge that free competitive analysis estimates are largely worthless. Fortunately, at <acronym title="WellonTop">WoT</acronym>, the words &#8220;giving&#8221; and &#8220;up&#8221; don&#8217;t hang out together. They&#8217;re much more fun by themselves anyway. Luckily for us we stumbled upon (punny) something spectacular in the process.</p>
<p>As usual, data-superhero Google comes flying to our rescue. Comparing <a title="StumbleUpon.com &amp; Digg.com on Google Trends - Traffic Estimate" href="http://www.google.com/trends?q=stumbleupon.com%2C+digg.com&#038;ctab=0&#038;geo=us&#038;date=2009&#038;sort=0">Digg and StumbleUpon on Google Trends</a> begins to clear up this mess. At the end of March, StumbleUpon has less than half the unique <acronym title="United States">US</acronym> visitors/month of Digg. The gap closes quite suddenly in mid-April in part due via a combination of three major events:</p>
<ol>
<li>April 13<sup>th</sup> &#8211; StumbleUpon is <a title="StumbleUpon Becomes a Startup Again" href="http://stumbleupon.com/sublog/stumbleupon_is_a_start_up_again/">bought back from eBay</a> by its founders</li>
<li>April 22<sup>nd</sup> &#8211; Version 3.29 of the <a title="StumbleUpon Toolbar for Firefox on Mozilla.org" href="https://addons.mozilla.org/en-US/firefox/addons/versions/138#version-3.29">StumbleUpon Firefox toolbar</a> is released</li>
<li>April 27<sup>th</sup> &#8211; <a title="Web Stumbling Without the Toolbar" href="http://stumbleupon.com/sublog/personalized_web_stumbling/">Web Stumbling</a> (without the toolbar) receives major enhancements</li>
</ol>
<p><a title="StumbleUpon.com &amp; Digg.com on Google Trends - US Traffic Estimate" href="http://trends.google.com/websites?q=stumbleupon.com%2C+digg.com&#038;geo=US&#038;date=2009&#038;sort=0"><img alt="Digg &amp; StumbleUpon on Google Trends - Unique Monthly US Visitors Estimate" src="http://wellontop.com/images/google_trends_stumbleupon_digg_traffic.gif" /></a></p>
<h3>Competitive Analysis Tools Compared</h3>
<p>Not all of our competitive intelligence tools have data past May. To compensate we will only use the month of April, identified by the period immediately prior to StumbleUpon&#8217;s traffic spike.</p>
<p><img alt="StumbleUpon &amp; Digg Unique US Visitors/Month - Comparison of Quantcast, Compete, &amp; Google Trends" src="http://wellontop.com/images/competitive-intelligence-digg-stumbleupon/stumbleupon_digg_us_traffic_quantcast_alexa_google_trends.jpg" height="450" width="600" /></p>
<p>Immediately we see the degree to which Compete has egregiously overestimated Digg&#8217;s traffic. Google Trends is almost certainly an underestimation. What about the data on global visitors?<br />
<img alt="StumbleUpon &amp; Digg Unique Global Visitors/Month - Comparison of Quantcast, Alexa, &amp; Google Trends" src="http://wellontop.com/images/competitive-intelligence-digg-stumbleupon/stumbleupon_digg_global_traffic_quantcast_alexa_google_trends.jpg" height="500" width="600" /></p>
<p>Alexa and Google Trends both drastically underestimate Digg&#8217;s global traffic. While we don&#8217;t have any way to know for sure, I would posit that they also underestimate StumbleUpon&#8217;s data.</p>
<h3>Interpreting Results</h3>
<p>So what exactly can we take away from this case study? For one, we can be pretty confident that StumbleUpon received significantly fewer unique global visitors in the first few weeks of April than Digg. We can even take a stab at the difference. Assuming that StumbleUpon data is skewed in proportion to Digg data biases, our corrected global estimate for Google Trends is <strong>8.4 million</strong> users. Applying the same methodology to Alexa gives a global visitor estimate of <strong>7.3 million</strong>.</p>
<p>We know that about 50% of Digg&#8217;s unique users are from outside the <acronym title="United States">US</acronym>. Google Trends&#8217; estimates can account for 84% of global traffic but only 53% of <acronym title="United States">US</acronym> traffic. To me this indicates a slight measurement bias in favor of international users. If StumbleUpon&#8217;s Google Trends data is similarly biased, our corrected US traffic estimate is <strong>4.4 million</strong> users. When we apply the same technique Compete, the estimate falls from 5.9 million to <strong>3.9 million</strong> users. Quantcast&#8217;s corrected estimate seems somewhat low at <strong>2.2 million</strong> users.</p>
<h3>Forming Hypotheses</h3>
<p>It&#8217;s fairly surprising just how consistent our corrected data is. Based on the information gathered, I&#8217;m going to hypothesize that during the measured time period:</p>
<ul>
<li>StumbleUpon received between <strong>7 to 9 million</strong> unique global visitors</li>
<li>StumbleUpon received between <strong>2 to 5 million</strong> unique <acronym title="United States">US</acronym> visitors</li>
<li>Free competitive analysis tools can be useful if biases can be compensated for</li>
</ul>
<h3>A Special Bonus</h3>
<p>In this case, I can test the first two hypotheses. I found a very valuable little snippet at the bottom of StumbleUpon&#8217;s source code. I&#8217;ll give you a hint: It begins with &lt;!&#8211;Start Quantcast tag&#8211;&gt;</p>
<h4><a href="http://www.quantcast.com/p-dez5MJMQSF95o" title="StumbleUpon.com on Quantcast.com">Secret StumbleUpon Data on Quantcast!</a></h4>
<h5>Notes:</h5>
<p><small>Some charts on this page have been modified. Links to the original sources have been included.</small></p>
<p><small>Photo: <a title="Photo Courtesy of Kevinzhengli and Flickr" href="http://www.flickr.com/photos/31796655@N07/2974942783/">kevinzhengli on flickr.com</a></small></p>
<h3 class='related_post_title'>Related Posts:</h3>
<ul class='related_post'>
<li><a href='http://wellontop.com/competitive-intelligence-survey' title='Website Traffic &#8211; Are Competitive Intelligence Tools Accurate? (Survey)'>Website Traffic &#8211; Are Competitive Intelligence Tools Accurate? (Survey)</a></li>
<li><a href='http://wellontop.com/study-covey-7-habits' title='A New Study on Stephen R. Covey&#8217;s 7 Habits of Highly Effective People'>A New Study on Stephen R. Covey&#8217;s 7 Habits of Highly Effective People</a></li>
<li><a href='http://wellontop.com/competitive-intelligence-research-introduction' title='Researching the Validity of Online Competitive Intelligence Tools &#8211; Introduction'>Researching the Validity of Online Competitive Intelligence Tools &#8211; Introduction</a></li>
</ul>
<p><hr />
<p><small><a href="http://wellontop.com/competitive-intelligence-digg-stumbleupon">Competitive Intelligence Tools &#8211; Alexa, Compete, Google Trends &amp; Quantcast</a></small></p>
<p><small>was brought to you by <a title="Internet Research on Business, Psychology, &amp; Technology - WellonTop" href="http://wellontop.com/">WellonTop Internet Research</a></small></p></p>
]]></content:encoded>
			<wfw:commentRss>http://wellontop.com/competitive-intelligence-digg-stumbleupon/feed</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
	</channel>
</rss>

