Hi Matthew. I think you are looking for the "Only Relevant Values" option in the quick filter.
I included a workbook that uses this as a quick example. Is this what you're trying to get at?
Thank you Ben!
I thought this would be the perfect place for a context filter but the "Only Relevant Values" worked perfectly.
Thank you for the help. I really appreciate it.