Sounds like a bug to me. What version of Server? I'd like to try and reproduce this.
Do you have the Tableau Server "Guest" user turned on? How is Tableau Server configured in terms of security - are you using (standard) Tableau Server security or Active Directory?
I am on 8.0.0
The guest account is turned on and I am using standard Tableau security. Thanks!