Web services

mydsworld · Post by **mydsworld** » Thu May 01, 2008 3:01 pm

I have a scenario :

Seq File1 -> Web Services Transformer -> Seq File2

Now, if there are 10,000 rows in Seq file1, then in the Web services transformer the web service will be called 10,000 times.
Is it the efficient way to do things or there are any better method available.

Thanks

lstsaur · Post by **lstsaur** » Thu May 01, 2008 4:06 pm

All I can tell you is what a bad design of your Web Service. What's in your seq file 1, 10,000 rows? Each row is a request to the Web Service?

mydsworld · Post by **mydsworld** » Thu May 01, 2008 4:12 pm

Each of those 10,000 rows need some kind of lookup thats being offered by a web service.

So, what are the alternative solutions.

eostic · Post by **eostic** » Thu May 01, 2008 4:13 pm

Yes...it would be nicer if your service had the ability to be called with an array....and then do all the SOAP work just once, assuming the rows aren't THAT big (an array of 10,000 could create a ridiculously large SOAP envelope that will result in other problems).

Do you know the author of the service? Can you have them adjust it to support arrays on either end?

Ernie

mydsworld · Post by **mydsworld** » Thu May 01, 2008 7:44 pm

1.How to form the array in Datastage side (from the set of incoming rows)?
2.Will the array contain all columns or just the column required for lookup.

eostic · Post by **eostic** » Fri May 02, 2008 6:42 am

...first of all, give some careful thought to where you are going here...."batch" activity using Web Services is never going to be a screamer......

First of all, the author of the web service has to be ready to receive, and able to return, an array. If they haven't done that, then it doesn't matter what happens in DS -- you won't have any other options but row by row. This relates to the first question above --- do you know who the author of the service is, and whether they can set it up to handle arrays for you?

Assuming they have, then you have to build the SOAP body yourself and send it into the WSTransformer. ...and you will need all the columns that the Web Service is asking for. ...You will need to be comfortable with both the XMLInput and XMLOutput stages, and become familiar with the option in the WSTransformer to describe a "user defined message". It's fairly involved, but that should get you pointed in the right direction.

Ernie

mydsworld · Post by **mydsworld** » Fri May 16, 2008 10:19 am

If we have multiple records that need to be looked up to a web service then will it be a good design to converge these multiple records (using XML output stage) to a XML file and pass that XML to web service (designed in that way to handle the XML). Then capturing the Web service Transformer response in XML Input stage and flatten to get individual records.