DSXchange

I precisely have the same settings. Is there any intermediate buffer is becoming the culprit ?

Exhibit I am having for this job as below :

Right DataSet -> Sort \
Join -> Output DataSet
Left DataSet -> Sort /

Before both the sorts, I have data Hash partitioned on the key col1+col2 for right dataset & col1 for left dataset.

Output which I am getting, is something similar to this -

B,C
C,D
D,E
E,F
E,F
E,F
F,G
F,G
H,I
H,I
M,N
N,O
N,O
O,P
Q,E
Q,E

You may notice, there is duplication of records.

Thanks it helps.

Just a Qn when I checked DataSet as against Sequential File. I found file size in unix env for DataSet is greater than Sequential file. Is it normal to have DataSets remain bigger in size than Sequential file for the same Data contents?

Data I am having is in the DataSets. Also I checked the Sequential files, before they are passed on to DataSet.

Checked with cat -v filename in AIX. File seemed to be Ok, didnt find any hidden chars.

Any other hint .... ?

To the Join stage : I have left set as - B C D E F H M N O Q I have right set as - A,B B,C C,D D,E E,F F,G F,H H,I H,J E,K E,L A,M M,N N,O O,P N,Q Q,E Q,R After Join I expect data as - B,C C,D D,E E,F F,G F,H H,I H,J E,K E,L M,N N,O O,P N,Q Q,E Q,R i.e. Retrieving those records which has common valu...

Yaa, without that I felt like the blind man, hitting tall pillars

Check advpx.pdf, comes with your DataStage installation. Therein check the chapter for "Specifying your own parallel stages".

Thanks, it worked.

If you are checking for Duplicate records and trying to divert to other file, ...This has been discussed several times in forum. No I am not checking for duplicate records. In my file anywhere I can have col2 value of previous record could be same as col1 value of current processing record. Also ca...

How can I compare 2 records at the same time? Prev rec A,B Current rec B,C col1 of current record if equals to col2 of prev record, I would like to redirect that value (in this case it is B) to other file. How can we achieve this functionality using DataStage? I thought of using lookup file stage, c...

Thanks, it helps Ray.

DSguru2B wrote:dsenv contains environment variables. For more info refer to the DataStage help manuals that are shipped with the product.

Hi DSGuru,

Will I get detailed information regarding those files in a PDF for DataStage Administrator / Parjdev / advpx ?

We come across different kinds of configuration files in DataStage, such as dsenv, uvconfig, default.apt, DSParams. Can someone explain me what is their main intention, & what is their scope (project wide or server wide)? I believe each project must have its own default.apt which is referred by ...