2 Replies Latest reply on Jan 18, 2018 8:20 AM by Varun Singh

    Incremental Extract Duplicate Data

    Varun Singh

      Hi -

      I am sure this is not the duplicate task like before but yes it is similar and I am looking for solution to remove duplicate data after incremental extra.

      Below is the data (not marked in bold) are loaded for the first time but once I do incremental the data looks something like below. Infact this is causing me a mess where the measure is summed with old and new value based on date. ETL Date is column just used to make tableau understand that it has to look for this on incremental..

       

      At the end of the day I need data only for bold ETL Date with visualisation as Date and measure column

       

      Date
      ETL Date
      Measure
      2017-01-012017-01-013
      2017-02-022017-02-024
      2017-02-035
      2017-02-032017-02-034
      2017-02-044
      2017-02-042017-02-046