Thumbs up. Been playing with pitch f/x for awhile now: http://ryrobes.com/featured-articles/moneyball-for-real-business-intelligence-data-mining-sql-server-and-major-league-baseball-part-1/
Using the data for a geo viz regarding PetCo Park and the Padres, hopefully Ill publish it today. It's a what-if scenario regarding the walls being moved in in right field... Geocoded every hit from 2010+ based on the location of PetCo and MLB's X/Y pixel grid system (yadda yadda yadda). Still have some analysis to do and viz overhaul, but I'm almost done.
Also using a free WMS server that gets WAY closer than built-in... : )
That's awesome. What's the WMS Server?
And yeah I've seen your pitchf/x blog entry. I was definitely planning on scouring your script for the logic on parsing that XML.
Ohh yeah, Ryrobes:
-You gonna let us in on whatever crazy stuff you're working on with the APIs? We know you're working on 'em. We just want to know what they are!
@Ryan - looking forward to it! In v8, how big is the TDE with, say, 5-7 years of data? I'm wondering whether the community of Tableau+baseball fans could help fund an AWS or other cloud server that could run your code to have a nightly load of the Pitch F/X data to build a TDE that could be either downloaded as needed or used as a data source.
Hey Jonathan, I think that's a good idea. Currently the latest versions of my harvest scripts (MLB Gameday changes the schema every year or so), which I will post with the Padres "data explanation" is running on an MS Azure VM pushing out to some Azure SQL databases.
I can't say the what the resulting TDE size might be, but I can tell you the data scale...
All MLB Gameday Data 2006-2012, took about a week or so to pull down completely.
atbat = 1,575,968 rows
fetch_log = 2,311 --Not MLB Gameday data (for my fetch process)
game = 20,782
hitchart = 1,157,213
pitch = 5,501,269
player = 2,710,123
All Tables ~11 Million+ rows
I also considered creating TDE output files for my "personal Facebook data harvester" ( http://ryrobes.com/data/face-harvesting-download-your-facebook-data-for-external-reporting-and-visualization/ ), but wondered if there were licensing issues with me wantonly distributing TDE data files on the web....
What is "Tableau Desktop's new cmd-line utility" which is referenced in the original post on this thread? First mention I've seen of it.
You can refresh or add files to an extract:
(I've been reading the v8 manual on the bus, I just saw this the other day).