2 Replies Latest reply on Dec 7, 2018 12:06 PM by Joshua Milligan

    Prep flow taking too long to execute

    Aditya K

      Hello Guys,

          I need to join 2 datasets (Both are in Data Warehouse) after applying some filters. I then want to create few dashboards in Tableau desktop. So I created a WorkFlow(Refer to the screenshot attached) to combine 2 dataset and create a output file which I think could be used in Tableau Desktop for creating the dashboards. Problem is when I run the flow, it keeps on running. I let it run overnight before I had to stop it. Both dataset contains more than a million records. Please point out if something I have done is wrong or suggest alternate solutions. Thanks

        • 1. Re: Prep flow taking too long to execute
          mortenbodaugaard.jrgensen

          Why not just join the data directly in Tableau Desktop and apply an extract filter to it there?

           

          Depending on version, if you are on 2018.3 you could create a "multi table extract" instead which loads the tables separately and just joins them in Tableau at query time

          • 2. Re: Prep flow taking too long to execute
            Joshua Milligan

            Aditya,

             

            Is it possible that the join is duplicating records or creating some kind of Cartesian product?  If both datasets are millions of records, then you could potentially be getting millions times millions of resulting records that consume system resources to the point that it never finishes.  And, it may not be obvious in design mode, even when viewing the results of the join, because you are likely seeing sampled data that can be completed.

             

            Is it possible to verify that the key field(s) are unique for Data A?  You may have to do this outside of Tableau Prep if the data is sampled.

             

            Hope that helps!

            Joshua