When you add the dimension to the column shelf in Tableau, you can right click and change the aggregation to MAX, it should flatten it like you need.
That looks to have done the trick.
Is there any way I can remove the Max. from the column header outside of removing once I've exported to Excel?
You could create a calculated field with the formula MAX(QuestionA) and give it a friendly name