-
1. Re: Slow execution
Alex Kerin Apr 16, 2013 8:59 AM (in response to Myles Boonstra)I recognize that date calculation....
This could easily be your issue - string calculations are notoriously labor intensive. Two things - did you optimize your extract after creating it? This should write the results of the date to the extract. 2. I wonder if there's a way to do the conversion as part of the SQL call and avoid the string issues?
-
2. Re: Slow execution
Myles Boonstra Apr 16, 2013 9:07 AM (in response to Alex Kerin)Optimize my extract? How do I do that?
I'll look into the possibility of doing the conversion as part of the SQL call with our database guy.
Thanks
-
3. Re: Slow execution
Alex Kerin Apr 16, 2013 9:47 AM (in response to Myles Boonstra)From the menu, data, source name, extract, optimize: http://onlinehelp.tableausoftware.com/v6.1/pro/online/en-us/iddccb686b-7077-48b9-a183-eb506b7d3a40.html
-
4. Re: Slow execution
Myles Boonstra Apr 16, 2013 10:10 AM (in response to Alex Kerin)Thanks for the quick replies. I found it in the help menu and am processing it right now. I'm over an hour into the optimize function.... still 'Materializing column: Date_Time'
this may not work if it's going to take an hours to optimize.
And this was just a small part of our database... How am I going to analyze 100,000 million rows of data...
-
5. Re: Slow execution
Myles Boonstra Apr 16, 2013 10:47 AM (in response to Myles Boonstra)It took 84 minutes to optimize the extract and things are much much faster. For the analysis that I'm performing today, this will work fine.
Going forward I'll need to explore options on my database end and tableau to make this faster. Ideally we would like to create dashboards for time-of-use energy consumption patterns that will update in near real time.
I'm going to download the Tableau Performance Analyzer to help determine where the slow downs are occuring.
http://www.interworks.com/services/business-intelligence/tableau-performance-analyzer
Any other resources that I can pursue? Comments welcome...
-
6. Re: Slow execution
Cristian Vasile Apr 17, 2013 2:04 PM (in response to Myles Boonstra)Myles,
100M records are a piece of cake for Tableau, if data is stored in an extract. Maybe 100,000M records could be something more serious.
If you want warp speed than try to keep the extracts on a fast disk (aka SSD)
Regards,
Cristian.
-
7. Re: Slow execution
Cristian Vasile Apr 17, 2013 2:10 PM (in response to Myles Boonstra)Myles,
The perf. analyzer is included in the Tableau v8 version. Also this new version has an improved VizQL engine, the core of Tableau's technology in charge with crunching numbers and rendering graphs.
Hope this helps.
Regards
Cristian.
-
8. Re: Slow execution
Myles Boonstra Apr 18, 2013 6:34 AM (in response to Cristian Vasile)Thanks Cristian, I'll check into the perf analyzer included in v8. I like the suggestion of possibly going to an SSD. Any optimization that can be done with hardware and/or file management is helpful.
-
9. Re: Slow execution
Alex Kerin Apr 18, 2013 7:13 AM (in response to Myles Boonstra)One comment would be: Do you need the level of detail provided by those millions of rows? Can you aggregate at a higher level using custom SQL or creating a view? I know that's kind of the point of Tableau, but worth thinking about.