You can do something like this
Create a combined field of PersonName & ContactName.
Then drag this combined field into row self, then PersonName and ContactName. Put the ContactCount into label.
Sort the data using combined field in desc order.
Then hide the combined filed from the header.
See the screen shot.
e.g: when you drag the fields
when you sort the data
then hide the combined header from the view.
I hope this what you wanted.