DSXchange

Hi , We have requirements around loading data (coming in XML format) into a Db2 UDB data warehouse. In the past we have done it using Datastage ( XML PlugIn Stages) but we are dabbling with using pureXML instead of DataStage . I have read a couple of articles on it but wanted to see if anyone has ha...

Full Outer join and a transformer should do it.

Could it be because of MQ message segmentation for handling large message sizes?

The Change capture done in the upstream should ensure that the same tuple is not being propagated on all three links. A long as lock escalations don't happen from Row to Page to Table , deadlocks shouldn't happen. The commit frequency might also play a factor in your job set up.

Few years back I had seen a similar thing happen in one of the projects. On investigating the issue it was found that in the DataStage flow a Unix delete command was being fired rm * and it was deleting some internal set up files as it did not have the right path specified. ..Good Stuff .. :D ..i ho...

You can try using the server folder stage with MQ. I have done that with text files and know that it works. Have never done zip files though!

You can remove dups on all four keys and then just aggregate on all four. Where ever the count is greater than 1 set record as 'MULTIPLE'. If you remove duplicates, you cannot have multiple. So the count will not be more than 1. My bad. Remove duplicates of four and then aggregeate on the first thr...

You can remove dups on all four keys and then just aggregate on all four. Where ever the count is greater than 1 set record as 'MULTIPLE'.

As chulett mentioned you don't have to do anything. The XML Output stage will automatically convert the XML reserved characters.

In the XML Output Stage --> Output Tab --> Document Settings --> Check the property "Generate XML Chunk"

This will prevent the "<?xml version = "1.0" encoding = "UTF-8"?>" tag from getting generate for each output xml.

Try the following: If the number of output date columns is fixed then you could have that many output links from a transformer stage and extract and pass the date values into the output. So , if you have 10 output date field in the Table, create 10 output links from a transformer and pass one date f...

What other way did you have in mind? You can do it either using the stage Or directly on the link.

Try setting up a counter within the Transformer stage which changes its value i.e it gets incremented when the "Threshold" is reached. This Threshold can be set as a parameter that can be changed on need basis. Then use the Counter as the Trigger Column in the XML Output stage.

By duplicate column in join , you mean the same column name on the inputs to the join stage. Well..you can do it by renaming one of them

My 2 cents..Ideally you would want to have an external scheduling tool handle cross project/application scheduling and dependencies