How to handle multi-page Web Service requests

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

iq_etl
Premium Member
Premium Member
Posts: 105
Joined: Tue Feb 08, 2011 9:26 am

Post by iq_etl »

I've got my job working (mostly), so I'm going to mark this resolved.

Ray, I was typing it in manually because it doesn't appear that user variables show up in the menu. I had not tried #s.

However, Ernie, I went ahead and added in another stage to iterate the count in a job parameter. So inside my loop is a stage that makes a web request for #current_page#, then a stage that adds 1 to #current_page#

I still feel like it would be more efficient if I could cut that iterate stage, but it appears to run pretty quickly, so I'll stick with it unless performance gets bad.

I'm still having an issue with the size of the Web response and the default transport block size, but I'll post another topic on that.

Thanks for all your help, everyone!

Kelly
Post Reply