2 Replies Latest reply on Sep 20, 2018 12:43 AM by saps saps

    Filter at Data Source not appearing in SQL generated - while creating extract

    saps saps

      hi All,

       

      i have connected table from database (Teradata) & applied data source filter to restrict data for a Country, when SQL is generated filter is not appearing in SQL and extract s failing due to large volume of data: it seems tableau gets all  countries data on local server then applies country filter before creating extract and due to large volume of data extract is failing:

      So i wanted to know how to restrict data at data base level itself other than creating custom SQL as we have many dimensions to connect with Fact on which country filter is applied:

       

      Thanks

        • 1. Re: Filter at Data Source not appearing in SQL generated - while creating extract
          Ritesh Bisht

          Hi Saps,

           

          It will be a good practise to see first why extract is failing . You can get that from the logs or tableau monitor window

           

          You should switch over to extract filter since data source filter shall not reduce the volume of data

           

          Anyways here is a good blog ,

           

          In Tableau 8.2 Data Source filters and Extract Filters used to work in the same manner.

          However in Tableau 9.0.4 both filters works differently.

          Extract Filter:

          As the name implies extract filters are used to filter out the data while creating the extract.

          Example: Let’s say we have database with the data for different countries as shown below

          1. USA –                    5000 rows
          2. Canada –             2000 rows
          3. India                      10000 rows
          4. Australia              1500 rows

          If we apply the Extract filters to bring the data only for USA (Country=USA), Tableau creates the Extract (.tde) just for the Country USA and ignore the data for all other countries.

          Size of the Extract is always proportionate the Extract filters.

          #of rows in the extract: 5000 rows for country USA

          Data Source Filters:

          In Tableau 9.0.4 applying Data source filters won’t change to the volume data and size of the extract. Instead data source filters applies the filters to the background query when we use any of the dimensions or measures in the visualizations.

          Example:

          If we apply the Data Source filters to bring the data only for USA (Country=USA), Tableau creates the Extract (.tde) with the full volume of the data for all countries (not only for USA) and there won’t be any relationship between the data source filters and the size of the extract.

          #of rows in the extract: 18,500 (for all countries)

           

          See more --->Difference Between Extract Filters and Data Source Filters

           

          Please m ark the answer as CORRECT / HELPFUL if it really helps you so that it can help others as well

           

          Ritesh

          • 2. Re: Filter at Data Source not appearing in SQL generated - while creating extract
            saps saps

            Thanks Ritesh,

            extract are failing with error 'No More spool space for  USED_ID' although 130 GB is allocated spool space for this user:

            we're using 10.2 version, and used extract filter only : my question is where the filter is applied is at database level or at tableau server:

            with above error its seems no filter is applied while getting data at Teradata end,  so need here is to filter out data at database level....