-
1. Re: Implementing Incremental on a "NON APPEND" only datasource..??
Jeff Strauss
Jan 30, 2017 10:26 AM
Your idea of doing a full refresh on the w/e and incrementals during the week is a good idea. This is one technique that we already deploy.
Another technique that we on occasion deploy is the concept of keeping an older copy of the published datasource extract (i.e. has a 90 day lag); we call it the immutable (unchanging) data source. Then on a nightly basis, we have a script that retrieves this old copy (via tabcmd get), and overlays the newer copy of the published datasource extract (via tabcmd publish) (which we call the incremental). And then we do an incremental refresh on this data. What this achieves is that it permits the retention of all the history, but also ensures that the past 90 days has fully up-to-date data. And it prevents having to do a full refresh.
-
2. Re: Implementing Incremental on a "NON APPEND" only datasource..??
Jeff,
Sounds Interesting!! Thanks for the insight. Appreciate it much!! I should try that one as well..
I have quick question, How do you guys implement the full refresh on weekends and incremental on weekdays? do you just use the tableau addfilefiletoextract TABCMD command?
-
3. Re: Implementing Incremental on a "NON APPEND" only datasource..??
Jeff Strauss
Jan 30, 2017 1:29 PM
Within Tableau Server, you can have a published datasource on both a full refresh schedule and an incremental schedule.
Here is an example:
