Webservice call for larger volume records
Moderators: chulett, rschirm, roy
Webservice call for larger volume records
In one of our business scenario, there is a requirement to call webservice for all the input records (volume 2 million). And the WebService responds data has to be stored database. What is best way to implement this scenario in terms of performance ? Will using webservice transformer be right choice ? (source --> webservice transformer --> target. ) Please suggest.
Thanks & Regards!
BJ
BJ
2 million rows? How big?
That may or may not be huge, but normally, no ..... Web service protocols (SOAP) aren't the best for large quantities of data.....one preferred method I'd to use a web service to kick off a secure ftp file transfer or other secure protocol better suited to large volumes.
Ernie
That may or may not be huge, but normally, no ..... Web service protocols (SOAP) aren't the best for large quantities of data.....one preferred method I'd to use a web service to kick off a secure ftp file transfer or other secure protocol better suited to large volumes.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
As Craig notes, the author, if expecting to receive large quantities of data, could approach it a lot of ways --- via arrays (so that at least you aren't making 2 million separate calls)....increase the reliability and reduce the "chattiness", perhaps by having you send 5,000, 10,000 or other "n" number of rows at a time (you package them beforehand in a single xml document)........or via other techniques, depending on how they want to send them, their expectations for security and performance, network reliability, etc.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>