DSXchange

The Work around we got for this is replacing the XML Assembly with the XML Transformer stage. (We had to write lot of Transformations code to achieve it though !! )

Now the jobs are not at all failing even for much higher volumes.

Hello All, I have a simple EXtract job from DB2 wherein we need to dump the entire table into a flat file. Currently I am using DB2_Connector Stage (DB2 Connector --> Copy Stage with Forced Option =True --> Sequential File ) and am able to write around 23K records per second in the target Sequential...

Its Working !! .. Thank you for your expertise.

Hi, Thanks for the reply.

Using that Property gives the Output column with the Wild card format.
It is not giving the exact file name from where the record is sourced.

I have 3 Input files having same layout. Customer_AAAA.txt Customer_BBBB.txt Customer_CCCC.txt I am using Sequential file stage to read them(File Pattern as Read Type - Customer_*.txt) The input File has 5 Columns. I need to load that to a table which has 6 Columns. The extra column in the Table is ...

Very sorry for the very late response. we did trail and error method and determined the value for Heap size and Stack size. Now the job is running fine for the current production volume. we are also working on a work around for even higher volumes which we expect to hit in a month or two. I will kee...

Do you have any record field identifier which says it is a parent/Child record ? I guess there should be some. (Lets say .. First three bytes in your example. If it is '001' it is parent record else its a child record) In that case, use Sequential file to read the file and a Filter on that Identifie...

Hi Ernie, No. I gave an example to post the issue in this forum. There are 10 Child Input links (Employee-Detail information) and 1 Parent link (Employee Parent information) I am giving to XML Assembly. 10 H-Joins inside the XML Assembly. Some more information. I have given this in the XML Assembly ...

Also, Can you please let me know the significance of Heap Size (MB) , Stack Size (KB) parameters? Does it have something to do with Job performance?

Sorry. CFI Layout is the XSD Metadata we configure in the XML Composer Library. I am not using Regroup when I use Multiple Links. Currently, the XML Assembly has multiple links and I am using H-join to create the XML struture I want. It is not working if the record count is more than 140K in my pare...

Hi Ernie, Thanks for responding. I have tried having only one input link to XML Assembly. DS1 EMPLOYEE_ID, EMPLOYEE_NM, EMPLOYEE_NUMBER,EMPLOYEE_PH_NUMBER then Regroup : DS1 Scope : top (Again .. this is only option I am left to chose as Scope) Parent List : EMPLOYEE_ID, EMPLOYEE_NM, EMPLOYEE_NUMBER...

Hello DS Masters, The Requirement is to create XML File with multiple hierarchies. Everything worked perfectly till we run performance testing. We are doing lot of H-Join Steps inside the Assembly and thats causing the issue now. I have tried all possible options to use "In Memory", Increa...

Ok got it. So What you are essentially saying is .. we cannot create a temporary table within datastage. Right ?

only after deriving column 5 .. we can refer to the other history table. Its like .. if Column 5 is 'x' then, refer to HIstory table A, other wise refer to History table B for populating the rest of the columns in the table. Its not pretty straight forward as we do joins in the queries.. fine.. let ...

Hello All, I am pretty new to Datastage 8.5 and we are working on Sybase database. we are experiencing performance issues since we deal with so much of extraction queries in every jobs. I am wondering is there a way we can use a stage in Datastage as a table and refer to that stage everytime to do a...