We have actually seen an increase in CPU consumption and less scalability with Tableau Server 10.4. Check Did you observe that Tableau Server 10.4 consumes more CPU than Tableau Server 10.1? if you want more information. We opened a ticket to Tableau support to check whether we can switch the httpd configuration back to its 10.1 value with no risk.
Hope this helps,