Could you share the package workbook for this? Have you defined the actions to include all values when the deselct occurs? If so, try dragging tht category set to the Filters shelf. This sort of functionality works for me but seeing your setup in a packaged workbook would allow for more assistance.
I hope this helps -