10 Replies Latest reply on Aug 2, 2018 12:10 PM by Marc Faber

    Scheduled tasks for Extracts are not executing

    Marc Faber

      Using Tableau Server version 10.5.0, we are using schedules to group tasks to refresh extracts.

      These schedules have been working very well, until this week.

      Schedules are planned to stop at 7pm at night and are then resumed at 4 am and 7 am in the morning.

       

      For some reason, after the schedules that run at 7 pm at night, the 4 am and 7 am schedules are not running. Tableau Server is running normally.

      Need to stop Tableau Server and restart Tableau Server to have the schedules run again.

       

      What could cause Tableau Server not to execute the scheduled tasks?

       

      Thanks for your help.

        • 1. Re: Scheduled tasks for Extracts are not executing
          Ritesh Bisht

          Hi Marc,

           

          I guess you need to check the logs to find the same.

           

          • ----> "backgrounder*.log" file in the C:\ProgramData\Tableau\Tableau Server\data\tabsvc\vizqlserver\Logs folder
          • ----- "backgrounder*.log" file in C:\ProgramData\Tableau\Tableau Server\data\tabsvc\logs\backgrounder

           

          Thanks,

          Ritesh

          Please mark the answer as correct & helpful if it really helped you so that it can help others as well.

          1 of 1 people found this helpful
          • 2. Re: Scheduled tasks for Extracts are not executing
            Marc Faber

            Hi Retesh,

             

            Thanks for pointing me out in that direction.

            The log files do indicate that the backgrounders are stopping periodically:

             

            2018-08-02 03:15:43.964 -0400 (,,,,,,) scheduled-background-job-runner-1 : INFO  com.tableausoftware.backgrounder.runner.BackgroundJobRunner - periodic shutdown

            2018-08-02 03:15:43.964 -0400 (,,,,,,) scheduled-background-job-runner-1 : INFO  com.tableausoftware.backgrounder.runner.BackgroundJobRunner - Exiting...attempting graceful exit, then if we haven't exited within 20s, unilateral exit.

            2018-08-02 03:15:43.968 -0400 (,,,,,,) Thread-7 : INFO  org.springframework.web.context.support.AnnotationConfigWebApplicationContext - Closing WebApplicationContext for namespace 'Spring MVC Dispatcher Servlet-servlet': startup date [Wed Aug 01 23:15:44 UTC 2018]; parent: Root WebApplicationContext

            2018-08-02 03:15:43.969 -0400 (,,,,,,) Thread-6 : INFO  org.springframework.web.context.support.AnnotationConfigWebApplicationContext - Closing Root WebApplicationContext: startup date [Wed Aug 01 23:15:18 UTC 2018]; root of context hierarchy

            2018-08-02 03:15:44.034 -0400 (,,,,,,) Thread-6 : INFO  org.springframework.context.support.DefaultLifecycleProcessor - Stopping beans in phase 0

            2018-08-02 03:15:44.034 -0400 (,,,,,,) Thread-6 : INFO  com.tableausoftware.backgrounder.AppLifecycle - Backgrounder stopped successfully.

             

            However, what triggers the backgrounders to restart again?

            • 3. Re: Scheduled tasks for Extracts are not executing
              Paulo Dantas

              Hi Marc,

               

              your machine have resources enough?

               

              Cheers.

              • 4. Re: Scheduled tasks for Extracts are not executing
                Marc Faber

                Hi Paulo,

                 

                Yes the machine is dedicated with for Tableau Server, 32768MB and 8 CPU running 4 backgrounders.

                It has been running for years without any problems.

                But for some reasons the backgrounders (1 through 4) stop at night and the scheduled extract refresh does not startup early in the morning.

                • 5. Re: Scheduled tasks for Extracts are not executing
                  Jeff Strauss

                  What mechanism are you using to stop the backgrounders at 7pm?  Please supply a screenprint of your schedules.

                  • 6. Re: Scheduled tasks for Extracts are not executing
                    Marc Faber

                    Hi Jeff,

                     

                    We do not have a "planned" mechanism to stop the backgrounders.

                    The last scheduled tasks are running at 7 PM. Once they're finished, the next schedule is to start at 7 AM in the morning.

                    The "3 times a day" schedule is running extract refresh tasks between 9 AM and 6 PM.

                    We never experienced any issues with backgrounders stopping.

                    Tableau Server Schedules.GIF

                    • 7. Re: Scheduled tasks for Extracts are not executing
                      Jeff Strauss

                      What release are you on?

                       

                      Also, what you show in the logs is normal, hopefully there should be a restart further in the log.  This periodic restart can be changed via "tabadmin set backgrounder.restart_interval_in_minutes".  We set ours to 1440.  Or look at the backgrounder status report for non-extracts, maybe there's a failure when trying to restart them?

                      • 8. Re: Scheduled tasks for Extracts are not executing
                        Marc Faber

                        We are on Tableau Server release 9.5.0

                        We don't have any non-extracts refreshes.

                        Believe the issue is that we don't see a restart further in the log. At 3:15 AM it shuts down, but doesn't restart.

                        • 9. Re: Scheduled tasks for Extracts are not executing
                          Jeff Strauss

                          It’s a problem if you don’t see a restart.  I just looked in one of my server instances and see this in this specific log: G:\Tableau\Tableau Server\data\tabsvc\logs\backgrounder\bacgrounder-0.log.  You may want to check why it's not restarting on its own.  Look in the windows event viewer or the clustercontroller log for more hints.

                           

                          2018-08-02 01:31:34.596 -0500 (,,,,,,) Thread-6 : INFO com.tableausoftware.backgrounder.AppLifecycle - Backgrounder stopped successfully.

                           

                          2018-08-02 01:32:34.286 -0500 (,,,,,,) localhost-startStop-1 : INFO  com.tableausoftware.backgrounder.AppLifecycle - Backgrounder started successfully

                          • 10. Re: Scheduled tasks for Extracts are not executing
                            Marc Faber

                            Hi Jeff,

                             

                            I see exactly the same for the Backgrounder stopped successfully:

                             

                            2018-08-02 03:15:44.034 -0400 (,,,,,,) Thread-6 : INFO  com.tableausoftware.backgrounder.AppLifecycle - Backgrounder stopped successfully.

                             

                            But the successful restart is not to be found in any of the backgrounder log files.

                            Verifying Windows Events and clustercontroller, seeing some issues there.

                            Do get an Windows Event: "Failed to get disk usage from localhost:8005"

                             

                            Only when stopping Tableau Server, rebooting the server, the Backgrounders start successfully.