try going to the Tableau config manager on the primary. Here, you should remove the worker from the cluster and then re-add, maybe this will work.
And also you should add one worker at a time. As the primary needs to send some software to workers upon installing it. It should resolve the issue.