Webservice call for larger volume records

[bj_ds7]

In one of our business scenario, there is a requirement to call webservice for all the input records (volume 2 million). And the WebService responds data has to be stored database. What is best way to implement this scenario in terms of performance ? Will using webservice transformer be right choice ? (source --> webservice transformer --> target. ) Please suggest.

[eostic]

2 million rows? How big?

That may or may not be huge, but normally, no ..... Web service protocols (SOAP) aren't the best for large quantities of data.....one preferred method I'd to use a web service to kick off a secure ftp file transfer or other secure protocol better suited to large volumes.

Ernie

[bj_ds7]

Thanks Ernie for reply. In my scenario i have sent those records to a live running App.Will there be any other option which let us to call webservice by creating request file for batch records ,instead of calling one by one using webservice stage ?

[chulett]

That would depend entirely on the author of the service.

[eostic]

As Craig notes, the author, if expecting to receive large quantities of data, could approach it a lot of ways --- via arrays (so that at least you aren't making 2 million separate calls)....increase the reliability and reduce the "chattiness", perhaps by having you send 5,000, 10,000 or other "n" number of rows at a time (you package them beforehand in a single xml document)........or via other techniques, depending on how they want to send them, their expectations for security and performance, network reliability, etc.

Ernie

[bj_ds7]

Thanks Craig and Ernie.