{"id":32,"date":"2013-07-31T21:07:00","date_gmt":"2013-07-31T21:07:00","guid":{"rendered":"https:\/\/paulgcurran.com\/skepticalstats\/?p=32"},"modified":"2013-07-31T21:07:00","modified_gmt":"2013-07-31T21:07:00","slug":"some-data-gathering-resources","status":"publish","type":"post","link":"https:\/\/paulgcurran.com\/skepticalstats\/?p=32","title":{"rendered":"Some Data Gathering Resources"},"content":{"rendered":"<p>Hi everyone &#8211; today I wanted to put together a fairly quick post about some of the resources I&#8217;ve found in that past year that I&#8217;ve found interesting (and occasionally useful) in putting together some of the posts on this blog. &nbsp;I&#8217;ve also found a lot of resources that I haven&#8217;t fully utilized (yet), but figured it might be useful to share. &nbsp;Anyway, here you go:<\/p>\n<p><u><b>Reddit Insight<\/b><\/u> &#8211; &#8220;We downloaded the Reddit&#8221;<\/p>\n<p><a href=\"http:\/\/www.redditinsight.com\/\">http:\/\/www.redditinsight.com\/<\/a><\/p>\n<p>Who doesn&#8217;t love Reddit when you&#8217;re looking for something to kill a few minutes\/hours\/days? &nbsp;If you&#8217;re bored of Reddit, though, you can use this site to kill time while looking at data generated by and about Reddit. &nbsp;Meta time killing, if you will. &nbsp;There&#8217;s some cool tools, and who doesn&#8217;t like word clouds?<\/p>\n<table align=\"center\" cellpadding=\"0\" cellspacing=\"0\" style=\"margin-left: auto; margin-right: auto; text-align: center;\">\n<tbody>\n<tr>\n<td style=\"text-align: center;\"><a href=\"http:\/\/4.bp.blogspot.com\/-A8yWrJPBlCs\/UgJoGfGzcaI\/AAAAAAAADRE\/z1PyU2hUNDI\/s1600\/reddit+aww+wordcloud.png\" style=\"margin-left: auto; margin-right: auto;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/4.bp.blogspot.com\/-A8yWrJPBlCs\/UgJoGfGzcaI\/AAAAAAAADRE\/z1PyU2hUNDI\/s1600\/reddit+aww+wordcloud.png\" height=\"340\" width=\"640\" \/><\/a><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center;\">Aww subreddit word cloud<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><b><u>Wikipedia Statistics (Overall)<\/u><\/b> &#8211; &#8220;<span style=\"background-color: white; font-family: sans-serif; font-size: 13px; font-style: italic; line-height: 19.1875px;\">&#8220;<\/span><a href=\"http:\/\/en.wikipedia.org\/wiki\/Wikipedia:ST\" style=\"background-color: white; background-image: none !important; color: #0b0080; font-family: sans-serif; font-size: 13px; font-style: italic; line-height: 19.1875px; padding: 0px !important; text-decoration: none;\" title=\"Wikipedia:ST\">WP:ST<\/a><span style=\"background-color: white; font-family: sans-serif; font-size: 13px; font-style: italic; line-height: 19.1875px;\">&#8221; redirects here.<\/span>&#8220;<\/p>\n<p><a href=\"http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Statistics\">http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Statistics<\/a><\/p>\n<p>There is a lot of information on Wikipedia, and there is also a lot of information about that information on this page. &nbsp;I don&#8217;t know where to begin &#8211; this post could just be about this page. &nbsp;How about the top 25 Wikipedia pages from last week?<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/4.bp.blogspot.com\/-1Brb1UosyPE\/UgJpgxHAxTI\/AAAAAAAADRU\/icSYasgVuak\/s1600\/wikipedia+popular+articles.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/4.bp.blogspot.com\/-1Brb1UosyPE\/UgJpgxHAxTI\/AAAAAAAADRU\/icSYasgVuak\/s1600\/wikipedia+popular+articles.png\" height=\"309\" width=\"640\" \/><\/a><\/div>\n<p><u><b>Wikipedia Special Pages<\/b><\/u> &#8211; &#8220;<span style=\"background-color: white; font-family: sans-serif; font-size: 13px; line-height: 19.1875px;\">This page contains a list of&nbsp;<\/span><a href=\"http:\/\/en.wikipedia.org\/wiki\/Help:Special_page\" style=\"background-color: white; background-image: none; color: #0b0080; font-family: sans-serif; font-size: 13px; line-height: 19.1875px; text-decoration: none;\" title=\"Help:Special page\">special pages<\/a><span style=\"background-color: white; font-family: sans-serif; font-size: 13px; line-height: 19.1875px;\">.<\/span>&#8220;<\/p>\n<p><a href=\"http:\/\/en.wikipedia.org\/wiki\/Special:SpecialPages\">http:\/\/en.wikipedia.org\/wiki\/Special:SpecialPages<\/a><\/p>\n<p>So you think that the last page had a lot of information about Wikipedia, and there&#8217;s probably not much more that&#8217;s really interesting enough to talk about? &nbsp;Well, welcome to the sub-basement of Wikipedia, where people get together to generate lists of all sorts of things, like <a href=\"http:\/\/en.wikipedia.org\/wiki\/Special:LongPages\">Long Pages<\/a>, <a href=\"http:\/\/en.wikipedia.org\/wiki\/Special:LonelyPages\">Orphaned Pages<\/a>, and perhaps my favorite list on the internet, that of <a href=\"http:\/\/en.wikipedia.org\/wiki\/Special:UncategorizedCategories\">Uncategorized Categories<\/a>.<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/3.bp.blogspot.com\/-NSQaRdS6Z5s\/UgJrTi8hJUI\/AAAAAAAADRk\/fBZUM_Sgc5U\/s1600\/uncategorized+categories.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/3.bp.blogspot.com\/-NSQaRdS6Z5s\/UgJrTi8hJUI\/AAAAAAAADRk\/fBZUM_Sgc5U\/s1600\/uncategorized+categories.png\" height=\"438\" width=\"640\" \/><\/a><\/div>\n<p><b><u>Wikipedia Random Page<\/u><\/b> &#8211; &#8220;Do you feel lucky, punk?&#8221;<\/p>\n<p><a href=\"http:\/\/en.wikipedia.org\/wiki\/Special:Random\">http:\/\/en.wikipedia.org\/wiki\/Special:Random<\/a><\/p>\n<p>This doesn&#8217;t generate any statistics on its own, but I think it&#8217;s an interesting page nonetheless. &nbsp;You can certainly run some calculations based on the numbers from other Wikipedia pages, like what your odds are of finding the page you&#8217;re looking for on Wikipedia by simply clicking that link (it&#8217;s about 1 in 30 million). <\/p>\n<p>So if you&#8217;re feeling like learning <i>something<\/i>, give some Wiki Roulette a try. &nbsp; <\/p>\n<p>Who knows, someday it might be important that you know something about <a href=\"http:\/\/en.wikipedia.org\/wiki\/David_Alton,_Baron_Alton_of_Liverpool\">David Alton, Baron Alton of Liverpool<\/a>.<\/p>\n<p><b><u>Wikipedia Pageview Stats<\/u><\/b> &#8211; &#8220;How about you tell me in graph form?&#8221;<\/p>\n<p><a href=\"http:\/\/stats.grok.se\/en\/201306\/wikipedia\">http:\/\/stats.grok.se\/en\/201306\/wikipedia<\/a><\/p>\n<p>I swear that a few years ago Wikipedia had some tools built into their own site to look at stats from specific pages, but recently this page has been all that I could find. &nbsp;It&#8217;s great if you&#8217;re looking for patterns in data, like if people are more likely to look at articles about particular days of the week <i>on<\/i> those days of the week.<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/4.bp.blogspot.com\/-dD_goBAMt4k\/UgJvNDWIKrI\/AAAAAAAADSQ\/3V84VQITj7g\/s1600\/sunday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/4.bp.blogspot.com\/-dD_goBAMt4k\/UgJvNDWIKrI\/AAAAAAAADSQ\/3V84VQITj7g\/s1600\/sunday.png\" height=\"360\" width=\"640\" \/><\/a><\/div>\n<p><\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/1.bp.blogspot.com\/-CoaqsW_DZHM\/UgJvM7rrFFI\/AAAAAAAADR4\/FWGnuL2meT8\/s1600\/monday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/1.bp.blogspot.com\/-CoaqsW_DZHM\/UgJvM7rrFFI\/AAAAAAAADR4\/FWGnuL2meT8\/s1600\/monday.png\" height=\"360\" width=\"640\" \/><\/a><\/div>\n<p>&nbsp;<a href=\"http:\/\/2.bp.blogspot.com\/-jLiQTYWh__g\/UgJvNv4R8wI\/AAAAAAAADSM\/k8PsWhLcvJ0\/s1600\/tuesday.png\" style=\"margin-left: 1em; margin-right: 1em; text-align: center;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/2.bp.blogspot.com\/-jLiQTYWh__g\/UgJvNv4R8wI\/AAAAAAAADSM\/k8PsWhLcvJ0\/s1600\/tuesday.png\" height=\"360\" width=\"640\" \/><\/a><\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/1.bp.blogspot.com\/-D7Oilj82g1s\/UgJvN4hqN2I\/AAAAAAAADSc\/2k1hf4d-2oc\/s1600\/wednesday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/1.bp.blogspot.com\/-D7Oilj82g1s\/UgJvN4hqN2I\/AAAAAAAADSc\/2k1hf4d-2oc\/s1600\/wednesday.png\" height=\"360\" width=\"640\" \/><\/a><a href=\"http:\/\/3.bp.blogspot.com\/-3TrVB5o00q0\/UgJvNbI5sWI\/AAAAAAAADSI\/oylce86tv8Y\/s1600\/thursday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/3.bp.blogspot.com\/-3TrVB5o00q0\/UgJvNbI5sWI\/AAAAAAAADSI\/oylce86tv8Y\/s1600\/thursday.png\" height=\"360\" width=\"640\" \/><\/a><\/div>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/2.bp.blogspot.com\/-5Rhycfrh2_Q\/UgJvM5ospnI\/AAAAAAAADR8\/MC_JlO9cxXM\/s1600\/friday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/2.bp.blogspot.com\/-5Rhycfrh2_Q\/UgJvM5ospnI\/AAAAAAAADR8\/MC_JlO9cxXM\/s1600\/friday.png\" height=\"360\" width=\"640\" \/><\/a><a href=\"http:\/\/2.bp.blogspot.com\/-4NdXvHOTW-E\/UgJvMyv5wRI\/AAAAAAAADSg\/HTjwIkpmkl0\/s1600\/saturday.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/2.bp.blogspot.com\/-4NdXvHOTW-E\/UgJvMyv5wRI\/AAAAAAAADSg\/HTjwIkpmkl0\/s1600\/saturday.png\" height=\"360\" width=\"640\" \/><\/a><\/div>\n<p><b><u>Google Trends <\/u><\/b>&#8211; &#8220;Two trends enter, one trend leaves&#8221;<\/p>\n<p><a href=\"http:\/\/www.google.com\/trends\/topcharts\">http:\/\/www.google.com\/trends\/topcharts<\/a><\/p>\n<p>Google Trends seems to have two main things going on. &nbsp;The first is the stuff on the main page, which is letting you know what&#8217;s trending on Google. &nbsp;Personally, that&#8217;s really quite boring. &nbsp;The fun part of Google Trends is pitting two (or more?) topics against each other to see how search volume has compared over some space of time. &nbsp;For instance:<\/p>\n<p><a href=\"http:\/\/www.google.com\/trends\/explore?q=red%2C+blue#q=red%2C%20blue&amp;cmpt=q\">http:\/\/www.google.com\/trends\/explore?q=red%2C+blue#q=red%2C%20blue&amp;cmpt=q<\/a><\/p>\n<p>Produces a great graph of search volumes of &#8220;red&#8221; vs &#8220;blue&#8221;:<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/1.bp.blogspot.com\/-JJrb6TevzRE\/UgJwn_sdDTI\/AAAAAAAADTI\/yy8I78qycuk\/s1600\/red+vs+blue.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/1.bp.blogspot.com\/-JJrb6TevzRE\/UgJwn_sdDTI\/AAAAAAAADTI\/yy8I78qycuk\/s1600\/red+vs+blue.png\" height=\"340\" width=\"640\" \/><\/a><\/div>\n<p>Yes, I know (and you should too &#8211; that&#8217;s what legends are for!) that red is the blue line and blue is the red line. &nbsp;It&#8217;s the order they are put in that matters, and I find the prospect of them switched to be amusing for some reason. &nbsp;So, I&#8217;m keeping it. <\/p>\n<p>That said, looks like red started winning sometime around 2008. &nbsp;Some of those letters on the graph might help you pull out why that is, as it links time frames to news stories and the like. &nbsp;It also shows searches that contained these words, etc. &nbsp;It&#8217;s a fun tool, especially for those of us who always wondered why people thought it was so hard to compare apples to oranges.<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/2.bp.blogspot.com\/-8WaytRaqQuU\/UgJydhQKFVI\/AAAAAAAADTc\/v-IjaVMw3Y4\/s1600\/apples+oranges.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/2.bp.blogspot.com\/-8WaytRaqQuU\/UgJydhQKFVI\/AAAAAAAADTc\/v-IjaVMw3Y4\/s1600\/apples+oranges.png\" height=\"352\" width=\"640\" \/><\/a><\/div>\n<p><b><u>Google Correlate<\/u><\/b> &#8211; &#8220;Correlating your Googles&#8221;<\/p>\n<p><a href=\"http:\/\/www.google.com\/trends\/correlate\">http:\/\/www.google.com\/trends\/correlate<\/a><\/p>\n<p>This one is a bit newer to me, but has some cool applications. &nbsp;It lets you see what words are searched for together, or rather which search terms are correlated to any given search term.<\/p>\n<p>For instance, a search for &#8220;turkey&#8221; reveals that people are very often searching for &#8220;turkey stuffing&#8221;.<\/p>\n<div style=\"clear: both; text-align: center;\"><a href=\"http:\/\/4.bp.blogspot.com\/-pKlkvjRE0Po\/UgJ0BrgqFuI\/AAAAAAAADTs\/rnHlm31atEg\/s1600\/turkey.png\" style=\"margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"http:\/\/4.bp.blogspot.com\/-pKlkvjRE0Po\/UgJ0BrgqFuI\/AAAAAAAADTs\/rnHlm31atEg\/s1600\/turkey.png\" height=\"364\" width=\"640\" \/><\/a><\/div>\n<p>You can also export these results, and do some other stuff with it, I guess? &nbsp;Like I said, this one is relatively new to me, so I&#8217;m in the process of thinking of ways to try to use it.<\/p>\n<p><b><u>Professional Football (NFL) Stats (1940 to present)<\/u><\/b> &#8211; &#8220;All the games, and then some&#8221;<\/p>\n<p><a href=\"http:\/\/www.pro-football-reference.com\/\">http:\/\/www.pro-football-reference.com\/<\/a><\/p>\n<p>If you&#8217;ve been reading the blog for a while you recognize this site, as it&#8217;s the one that I used to look at <a href=\"http:\/\/theskepticalstatistician.blogspot.com\/2012\/09\/nfl-2012-points-blowout.html\">historic scores in the first week of the season<\/a>. &nbsp;It has all the outcomes from every NFL game ever played, and some stats from games even before that. &nbsp;There&#8217;s&#8230;a lot of information.<\/p>\n<p><b><u>Professional Baseball (MLB) Stats (1916 to present)<\/u><\/b> &#8211; &#8220;Like football, but baseball&#8221;<\/p>\n<p><a href=\"http:\/\/www.baseball-reference.com\/\">http:\/\/www.baseball-reference.com\/<\/a><\/p>\n<p>While I&#8217;ve never used it, you can also find stats on all professional baseball games played in the last century or so. &nbsp;Again, it&#8217;s a lot of information.<\/p>\n<p><b><u>Professional Hockey (NHL) Stats (1987? to present)<\/u><\/b> &#8211; &#8220;We taped over all the early games&#8221;<\/p>\n<p><a href=\"http:\/\/www.hockey-reference.com\/\">http:\/\/www.hockey-reference.com\/<\/a><\/p>\n<p>Finally, there&#8217;s also a professional hockey version of the last two pages, though for some reason it only extends back to 1987. &nbsp;Maybe they&#8217;re working on it? &nbsp;Hard to say. <\/p>\n<p><b><u>Twitter Stats<\/u><\/b> &#8211; &#8220;A constant, never ending stream of information&#8221;<\/p>\n<p>I actually had a decent amount of trouble finding any official stats on the Twitter page, as it looks like almost all of the stats generating tools are third-party. &nbsp;Maybe that&#8217;s not the case, and I&#8217;m looking in the wrong place. &nbsp;If I was going to list one third-party Twitter tool I&#8217;d rather list a ton, so maybe that will just wait until a future post. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hi everyone &#8211; today I wanted to put together a fairly quick post about some of the resources I&#8217;ve found in that past year that I&#8217;ve found interesting (and occasionally useful) in putting together some of the posts on this blog. &nbsp;I&#8217;ve also found a lot of resources that I haven&#8217;t fully utilized (yet), but &hellip; <a href=\"https:\/\/paulgcurran.com\/skepticalstats\/?p=32\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Some Data Gathering Resources<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-32","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=\/wp\/v2\/posts\/32","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=32"}],"version-history":[{"count":0,"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=\/wp\/v2\/posts\/32\/revisions"}],"wp:attachment":[{"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=32"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=32"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/paulgcurran.com\/skepticalstats\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=32"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}