You posted this at the beginning of December. Have you found a solution to the issue? This sounds like some artificat of those records causing an issue and we do not have other customers with a similiar issue so I think this deserves the attention of a Support Engineer to assist you if the solution has not been found. Please open a ticket at https://support.tableau.com to further investigate.
Some interesting data that would be good to know - are you using lightning?