2 Replies Latest reply on Nov 1, 2018 9:30 AM by Joe Morris

    Help with incrementally updating a data source

    Joe Morris

      I have a data source around 30 million rows, that needs to be refreshed every hour.

       

      We have no deletes, but rows are frequently updated and inserted.

       

      As far as I know tableau only supports incremental updates to data sources when rows don't update, otherwise you end up with a duplicate everytime a row updates.

       

      The workaround I am using for this is the calculation:

       

      If [Update_Date] = { Fixed [Unique_ID] : Max([Update_Date]) } Then True

      Else False

      End

       

      And a data source filter that only keeps rows where the above is true.

       

      As far as I can tell this is all working as intended, but Its proving somewhat difficult to test & after googling around the issue I've seen a lot of people with similar problems and no real solutions. So I'm a tad concerned I've missed something obvious..

       

      Any reasons this wouldn't work? Or any improvements I can make?

       

      Much appreciated,

       

      Joe