Howdy - I'm guessing this will be the variance between what you may be showing on the viz vs all rows. Meaning, the 20 on the server may have only returned the 20 rows it needed to display your viz.
If you are working with extracts, you can build your extract in the desktop first (showing the 100), then publish that to the server. The server will then have the same 100. Once on the server, you can then schedule a refresh of the extract.