Hello again WDC community!
TLDR: check out my post on improving WDC performance. Motivations and details below:
If you've implemented pagination on your WDC in the manner described here, you may notice that the performance of your Web Data Connector degrades as the size of your data set increases. In my case, I was connecting an API that limited the number of records retrieved per request to 25 (so I noticed the degradation very quickly).
When using that pagination method, you might say that the time it takes your WDC to return data is linear, or directly proportional to the number of requests you have to make to retrieve the full set. Here's a visual depiction of what that looks like:
If you were to take advantage of this language feature in a Web Data Connector, performance becomes sub-linear and might look something like this:
Asynchronous applications can become complex, but there are patterns out there to help manage it. I've put together a post that dives into the problem outlined above in further detail, offers a solution to the complexity problem, and provides some handy code snippets you can use as a starting point when optimizing your WDC.