Tableau extracts are not meant for this type of refresh. you probably need to go for live connection because your data is updated very frequently.
im just curious to know what type of data it is and which data source.
Here is a wonderful explanation by Mr.Ruseel christopher.
Extracts are generally not appropriate for RT or near-RT data because it's difficult to keep datasets refreshed unless you're in a near constant refresh cycle. This can lead to issues / questions like:
- I'm always refreshing, and I can see that said process is relatively expensive - I see contention between my workbook rendering and extract refreshing now. What to do? I don't want my rendering speed to suffer just cause I'm extracting 24x7 (solution: more hardware, more licensing $$, which customers don't like)
- My refresh takes more than five minutes because I'm dealing with <insert data volume here>. However I'm refreshing every 5 minutes. How do I manage this? Can I have multiple schedules operating on the same data source so I get an overlap? (no.)
- I'm refreshing my data every <x> minutes but I'm still picking up older data from the cache. How do I fix? (turn off caching, which turns into....) Hey! Now that I've turned off caching, performance is going down! (yes, you turned off caching).
Don't get me wrong - where there's a rule, there's an exception - there may be certain scenarios (small data sets which refresh really quickly and don't need for caching) where you could make this work and it might be appropriate to have a higher refresh rate than 15 minutes...but this can very quickly turn into a Gordian Knot and I suspect the developers didn't want to give users a convenient way to shoot themselves in the foot in this regard.
1. We use a lot of real time data to monitor many systems and processes, and are hoping to attach some push alerting/emailing to our data.
2. We'd like to minimize storage, and query load on our own servers through the use of extracts.
3. We look at the data 'real time' but also like to drill down and filter as we investigate potential issues.
Ideal scenario would be to have our stats incrementally update as quickly as possible, then we can use the same datasource for everything we need.
2 of 2 people found this helpful
The 5 minute option is not available within Tableau Server, however if you are willing and able, then you can setup a Task Scheduler job that runs at 5 minute increments. Task scheduler is native to windows and it can call a tabcmd refreshextracts script in order to do what you need. Do you want more details? I may have an archived example somewhere as at one point we were doing the 5 min refresh but then we reverted eventually to a live connection.
Really this was one thing where we can trigger by writing a custom script. Thanks for sharing . Really useful.
Thanks, what made you revert back to the live connection?
I think we reverted back because we convinced our DBA that refreshing the extract every 5 minutes was putting more load on the database than running it live. And we only have 4 backgrounders and didn't want the 5 minute refresh taking up one of the slots.
Can you please share the custom script and the task scheduler process to do the data refresh. We are also facing the same issue.