The new beta of front-end PHP toolkit 1.4.0 is here:
http://22.214.171.124/wiki/index.php/XML ... kitTesting
The changelog is long...worth reading.
At this point I think we've gotten enough performance out of this both for inbound and outbound large data cases. In the cases where the operation happen asynchronously the time is not really an issue since it's just updating a cache (you might want to look at the Zend Server Job Queue capabilities for some help with asynch operations). In the cases where the use *is* waiting you even admit that it's usually a much smaller set of records to fetch so the massive data requirements are not really relevant except is unusual cases (and we've probably solved it anyway). So I'm gonig to have the guys move on to other issues that are higher priority and more broadly applicable.