DSXchange

@Craig Not able to view your whole response, but I am doing what you are saying. My target is DB2 Connector and I have selected auto generated query. The query i see in the director logs is correct and is according to my requirement. Still its not working, I m out of options now. By the way, who is ...

Hi, I have a small query, one of my table doesn't has any PK. Initially the mode of writing was only Insert. Now due to a new requirement updates can also be possible. So I asked my DBA not to define any PK column as I thought I can handle in my job itself. So in the target stage, I tick marked the ...

According to your requirement if KEY1 is null then value of KEY2 column should be mapped, then the data type of both KEY1 and KEY2 should be same. So will work but will not work.

Is handle_null a system function ?
The KEY1 column should contain date value, any other data type values will throw error.

My bad , I read incorrectly.
I thought the grouping key is DUMMY column.
But now I have checked its the AgeGroup column itself.
But I don't understand that why the need for extra column, for counting purpose I can use AgeGroup column too, can't I ?

While reading the date value from the file, mark the column as NOT NULL and in the transformer check for empty only. If Trim(date_column) = '' Then StringToDate("12/31/9999",'%mm/%dd/%yyyy') Else StringToDate(date_column,'%mm/%dd/%yyyy') Or Use the "Null Field Value" property in ...

I am dealing here with 520 million records :wink: . I join two sets of 260 million records each and then pass it to Aggregator. My minimum throughput I get is around 200000 rows/sec. But my database is not on a remote server and my job finishes within 30 mins. Performance is not an issue for me. But...

I think it is a better practice to do all inserts in 1 job and updates(or upserts) in other job to avoid locking at the table.

@Zulfi/Prasson, Thanks for your replies. I got what you are suggesting, but as I said these are round way solutions and I wanted a straight forward solution like enabling some properties or using Environmental variable. I have tried one more way where I generate a column "CODE" and for eve...

Looks like a vertical pivot to me with an extra step to contatenate the new columns into a single one, perhaps with a newline between them

I think Craig has given you the solution.

@Zulfi
Can you elaborate a bit ?

I know my answer will sound stupid but even then try it.
Copy all the contents of your job and paste it in a new job.
Then try running it.

Sorry Ray, not able to view your whole response. But got the idea so here it is; My data is like AgeGroup Balance 18-20 100.0 18-20 200.0 20-25 1000.0 20-25 2000.0 20-25 3000.0 30-35 300.0 O/P data will look like AgeGroup Count SumOfBalance 18-20 2 300.0 20-25 3 6000.0 30-35 1 300.0 Now I have tried...

Thanks for the reply. Actually the SUM is on a decimal field but the group column is a varchar(like a name). I have tried a lot of things but getting errors Error when checking operator: It is not legal to set a reducer (AGE_GRP) to be the same as a key field, when the type of that field (int32) is ...

Hi All,
I want to calculate SUM and COUNT on varchar field in Aggregator.
I have searched many posts and found out that "Preserve Type" option is present but it works only for MIN and MAX functions.
Can any one suggest how to accomplish this ?