Yes - set up an action filter that works so that when you click the top chart, the bottom one gets filtered. In the Edit Action dialog box, you can set the behaviour when nothing is clicked. You should choose "Exclude all values"
Thank you, I don't know how I missed this. I was able to get a nice, fast loading chart be combining what you mentioned with context filters and limiting to top x. Thanks!