DSXchange

in aggregator i am doing the grouping and sum. shivan so does it exclude the duplicate. can you explain me why we get less rows. shivan To answer that question .. one would need the information regarding what exactly are you doing in aggregator. It seems that you have multiple problems .. one being ...

so does it exclude the duplicate. can you explain me why we get less rows. shivan hi, I have a job, which has a transformer , sort and an aggregator. When i run the job for 200, 000 records , i only get 199233. It says the job is finished. Why i am not getting the rest of records. thanks shivan You ...

hi, I am trying to use look up table. What i want to do is: I have a job which takes 1.7 million records. I run the job first time, so it processes all 1.7 million records. Now i have a look up table. So what when i run the job again, and there are only .08 records added or updated. I only update th...

hi, i tried to increase the buffer size from 128 to 200 kb. I also increased the time from 10 secs to 50 secs. But it didnt worked. Can you explain me what is Notify function , as i m new to datastage. thanks shivan Hi Shivan, Just want to rule out the obvious...Have you tried increasing your buffer...

Hi, the problem is : in the sequential file, i have to give an output file name. If i give an output link name there. i get an error: CopyOfCopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..DB2_UDB_API_31.IDENT1: |CopyOfCopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..Sequential_File_132.INPUT_AGGR: DSD.SEQOpen Failed t...

there are 1.7 million records. It works fine with 200,000 records or sometimes less or sometimes more. The speed is like 500 rows per sec. Then It sorts the data again in the sort. Which is like the double the time. shivan Wait a second - SQL Commit error? Looks like it is not a sort or aggregate pr...

i tried to run the job for 400,000 records. The error i got are: CopyOfCopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..AGGREGATOR2.DB2UPDATE: DSP.Close Error -100 in $DSP.Abort. CopyOfCopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..AGGREGATOR2: [IBM][CLI Driver] CLI0106E Connection is closed. SQLSTATE=08003 SQLTransa...

i do have some constraints in the transformet. It takes 200,000 records in the transformer and then from the sort, it only sends 192,323 records. The job doesnt give any warning of row rejection. So how would i do , what seem to be the problem shivan Hi Shivan, Do you have any constraints in your tr...

hi,
I have a job, which has a transformer , sort and an aggregator. When i run the job for 200, 000 records , i only get 199233. It says the job is finished. Why i am not getting the rest of records.

thanks
shivan

this is an another error i got: CopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..Link_Collector_Out: [IBM][CLI Driver] CLI0108E Communication link failure. SQLSTATE=40003 shivan it worked fine with 1000 rows. Otherwise i get this error: DB2_INVOICE_LINE_ITEM_RPT_partition1..Sort_4: Error in merging files At r...

it worked fine with 1000 rows. Otherwise i get this error: DB2_INVOICE_LINE_ITEM_RPT_partition1..Sort_4: Error in merging files At row 1, link "DSLink118" Call to output link returned numeric error code: 17 how can i do the merge? shivan Hey Shivan, What are you trying to Merge? Do it with...

i have five primary keys, I add the sort order 1 -5 in all of them. Now i get this error. CopyOfDB2_INVOICE_LINE_ITEM_RPT_part..Sort_117: Error in merging files At row 1, link "DSLink121" Call to output link returned numeric error code: 17 thanks shivan i did that. thanks shivan No, it sho...

i did that.

thanks
shivan

vinaymanchinila wrote:No, it should stick around. Did you fill out the Sort field first with a number to show which is 1, 2, etc?

_________________
Craig Hulett

Check this post by me , it was of great help.

viewtopic.php?p=138007&highlight=#138007

hi, i worked fine with small amount of data like upto 600 thousand records. So if it is a memory issure, how i can increase the buffer. I turned the inter-processor on, and set the default buffer of 128kb. thanks shivan Did you reset and check the error? I think it is due to memory issue that the ag...

hi, it is same. One more thing i noticed is that when i assign ascending order to primary key inv_id in the aggregator. It doesnt save it. Because when i go back, the ascending sort order is not there. shivan Can you checl to see if it is the same order of columns you have mentioned in the aggregato...