I'm having the same problem. I am cleaning an Excel survey file. It has crashed at least 5 times this morning and I am only in the first clean step, changing field names, a few very simple calculations, and changes some aliases. The table is still quite "wide" but only has less than 800 rows of data.
1 of 1 people found this helpful
I have had multiple memory issues similar to the one you describe. I think there is a JAVA scripting issue within Prep. The problem is most predominate when adding steps to cleanse the data where Prep needs to display summarized data for each of the columns.
Although it doesn't fix the real issue, what I have been doing to overcome this is create a work flow including adding steps where I know I am going to cleanse the data, but don't cleanse anything when creating. Save the file. Close Tableau Prep and give it time to allow all the processes to close (you can watch in task manager). Then reopen the file, then begin to cleanse under the individual steps, but keep monitoring your task manager. If you top out at greater than 98% memory usage, save the file before it locks up and close Prep. Wait for processes to close and then open it again. Each time Prep closes and the processes shut down you free up memory that Prep is not releasing during normal use for some reason. Its not a great solution but it works. As example I have one flow that imports 30+ text files to create unions and joins, millions of rows, >2Gb of info. The cleanse steps kept crashing the file. I did what I described above and was able to push the flow to over 4Gb of data imported.
The final thing, and this is very important, don't create your output step until after everything else is done.
Thank you for the feedback Garth. Seems like a crappy way to have to go about it haha (no knock on your workaround, its a knock on Prep itself); I can probably build it faster within MS Access than to have to keep closing and restarting the workflows as you described. Pretty unfortunate. Guess I will just wait until its a bit further along and stable before I try using it again.
Thank you for raising this issue Ryan! We're actively looking into issues like the one you mentioned here. Would you be able to share a copy of your log files so we can see what's happening? Below are the instructions for collecting and sending your log files.
Where are the log files?
- Windows: C:\Users\<your username>\Documents\My Tableau Prep Repository\Logs
- Mac: /Users/<your username>/My Tableau Prep Repository/Logs
Steps to collect log files
- Clear out your logs: Go to your user directory and delete all files there.
- Recreate the issue: Open Tableau Prep and recreate the issue
- Close Tableau Prep
- Zip up all the new log files
- Attach the zip file and reply to this thread, or respond to me directly if you prefer
Tableau prep is driving me crazy. I have attached the prep logs. I have to keep all of the prep flows really short and do multiple flow files to keep from crashing. I think Prep could be awesome, now it's just annoying.
Logs.zip 864.0 KB