sending bulk records in a single webservice call

bj_ds7 · Post by **bj_ds7** » Fri Jan 17, 2014 3:14 pm

Kindly suggest a way pass bulk records in a single webservice call in datastage. The webservice operations that i am dealing with ,can accept multiple records in a single webservice call. Kindly advice me the best way to do this scenario.

eostic · Post by **eostic** » Fri Jan 17, 2014 7:59 pm

Use xml outpt stage or xml stage to build the whole soap input payload.

bj_ds7 · Post by **bj_ds7** » Fri Jan 17, 2014 8:19 pm

thanks eostic

bj_ds7 · Post by **bj_ds7** » Sun Jan 19, 2014 5:48 pm

Could you please let me know to how to aggregate multiple input rows for binding it to a single row using new 'xml' stage ?

eostic · Post by **eostic** » Sun Jan 19, 2014 9:58 pm

Do some searching here....look for posts on the web services stages and posts on sending xml stages to a single column....it's all here. Cature the soap envelope that you need from a tool like SOAPui. Also check out my blog at www.dsrealtime.com and look for posts on web services in the table of contents. You need to combine a variety of skills for this.

bj_ds7 · Post by **bj_ds7** » Mon Jan 20, 2014 10:23 am

Thanks Ernie ! I was able to implement this scenario using xml input and xml output stage. Your blog was helpful in doing the same. I also referred http://www.ibm.com/developerworks/webse ... index.html .Wanted to know if its possible to implement , same same scenario using XML stage , instead of using xml input and xml output stage. Read that data processing is faster using XML stage. I tried many assmebly stuff of XML stage ,couldnt figure out a way to bind all inputs rows to a single row xml output.Could you let me know about the link /documentation which describes to do the same.

eostic · Post by **eostic** » Mon Jan 20, 2014 10:50 am

You could use xml Stage here, but you have another learning curve on how to read and write xml using that Stage and the xsd's that you need.

All things are relative, but Web Services (SOAP/HTTP, etc.) are inherently slow.....learn the xml Stage for important reasons of learning the new technology......and then if you have the chance, apply it to this scenario....but keep in mind that for "this" use case, your bottleneck might be SOAP and you won't see any benefit whether using xml Stage or others to build or decipher the requests or responses.

Ernie

bj_ds7 · Post by **bj_ds7** » Mon Jan 20, 2014 11:15 am

Thanks Ernie for the response.Bottle neck will be SOAP. I would definitely like to learn this new xml stage and its capabilities.I was able to compose and parse xml using new xml stage and also do some basic stuff using it.But I wasnt able to create an xml aggregated output for all input rows , that we are able to produce using xml output stage.Out of curiosity, i would like to know, how to do the same using xml stage. Could do you kindly let me know how to do that using XML stage ?

eostic · Post by **eostic** » Mon Jan 20, 2014 1:16 pm

As a start, there are threads on the forum here about the XML Stage, and most importantly, there is a redbook dedicated to it.... http://www.redbooks.ibm.com/redbooks/pdfs/sg247987.pdf

Ernie

bj_ds7 · Post by **bj_ds7** » Mon Jan 20, 2014 2:34 pm

Thanks again Ernie!

chulett · Post by **chulett** » Mon Jan 20, 2014 4:35 pm

Please don't 'Reply with quote' on everything but feel free to use it when you actually need to. Otherwise, there is a perfectly loverly Reply to topic link that just lets you simply reply and saves me having to come along behind and clean things up.

Thanks!