Check the actions - Clicking on University COllege again should take you back to the original view
'Show all values'
None of those options revert it back to the full chart. Also, I am using a Story not a Dashboard. I tried making a Dashboard and looking at the actions, "show all values" did not show or change anything relating to this, just about highlighting.
Sorry didnt realise you were using a story. I will test out something similar and get back to you later today