DSXchange

Another way you could check the effects of enabling the various options (explicit sort stage, sort on partition, auto partition, hash partition, etc.) would be create jobs with the various alternatives, compile the job and then check the "Generated OSH". Of course, the ability to view the ...

Is your node 2 working properly? I remember once when we had this issue, we were told it was because of a problem with the node and it had to be removed from the config file node pool. Creating a new config by eliminating this node got rid of the problem. i think it's worth a try.

HTH.

It looks like your job might have been locked.

You will need to execute uvsh, LOGTO your project and execute the LIST.LOCKS command.

If you see your job listed there, then it is locked.

You will have to get the job unlocked. Generally the DS admin has the right to unlock jobs.

Thanks

Alternatively you can do it in a single job using the sql below. SQL is written for oracle. Should also work for db2. Not sure of other databses. src-------xfm------seq1 | | seq2 with duplicate_rows as (select cola, colb, count(1) as cnt from srcTable group by cola, colb having count(1)>1) select sr...

For example you have a,b a,b x,y y,x c,d c,d select col, col2, count(1) from table group by col1, col2 having count(1) > 1. Load these into a hash file by specifying col1 and col2 as keys. thsi will yield a, b, 2 c, d, 2 This you will load in a hash file specifying col1, col2 as he keys In step 2 yo...

Did you try both steps?? Step 1 identifies the the values of col1 and col2 that are duplicates. select col, col2, count(1) from table group by col1, col2 having count(1) > 1. Load these into a hash file by specifying col1 and col2 as keys. For the example you have given a,b a,b x,y y,x c,d c,d thsi ...

This might help

http://dsxchange.com/viewtopic.php?t=10 ... b6e1c09bc8

Thanks,
Shekar

Step 1. Identify the duplicate rows using the following sql select col, col2, count(1) from table group by col1, col2 having count(1) > 1. Load these into a hash file by specifying col1 and col2 as keys. Step 2. Read the source again. Use the hash file created above as a lookup. For each row see if ...

Transformer:StringToDate(lkup_cust_out.OHEDAT,"%yyyy-%mm-%dd")-- Output is *********. Since you said your date is in the format YYYYMMDD you will need to specify StringToDate(lkup_cust_out.OHEDAT,"%yyyy%mm%dd") in you transformer I also has a Julian date YYYYDDD (2006207) need to...

In a parallel transformer right(left(column_name,5),2)??

Shekar

My 2 cents, I would not do it using Datastage, simply because it will be too tedious and the job very cumbersome. I would rather use a shell script (perl script / a java program) to achieve what you want to. A simple algorithm would be as follows Preferably (but not necessary) Sort the data based on...

This is a question that was lingering in my mind for a long time and thought it best to take the opinions from the forum. This question is related to stages like Join/Aggregator where the data need to be partitioned and sorted. In the chapter pertaining to the Join stage for the parallel job develop...

ray.wurlod wrote:Yes and no. There isn't a collection method in the Link Collector stage that permits "all from source A then all from source B". The (parallel) Funnel stage has a "Sequence" method that permits this ...

Ooops! Misread the requirement. Will work on that. Thanks

ray.wurlod wrote:Unless, of course, one were to write one's own server Funnel stage... ...

Can't we use the Link Collector stage to achieve the functionality of a funnel stage?

dsdesigner

FYI I am using 7.1 version of Datastage
Thanks,
Shekar