Instead of having duration in the rows shelf, this needs to be in text/label of the visualization.
The totals looks at these values rather than the values in the rows and columns.
Heh - yes I did discover that after posting.
I can't use that particular field as the Text visualization because 01:29:17 became 12,917, etc.
So I added the Seconds (Integer) as Text, but now I'd like them to be viewed as Time Duration and have totals... is that possible?