DSXchange

dear fri,

when using this stage, do we must do the sorting in the input link? Means tick the 'perform sort' check box, if we don't tick, will it possibility output the incorrect result ? Please kindly advise, thanks so much.

walter/

it's transfomer after lookup.
I already note the problem. It's because the reference link of the lookup stage has too many records, the job is hang in the stage. it's better to use join instead of lookup.

When I force abort the job. This log appear immediately the then job abort.
hmftpattr_cut_out,0: Import complete; 6547564 records imported successfully, 0 rejected.

I have no idea why this will happen.

I use another set of data to process the same job, it could complete. after checking the director, I found another intersting thing. The job is hold on below log. hmftpattr_cut_out,0: Progress: 90 percent. normally after that there is hmftpattr_cut_out,0: Import complete; 6547564 records imported su...

dear all, I meet a wierd situation that the parallel job stop processing in a lookup stage. according to the performance statistics, I can see the 2 input links of the lookup stage have records pass in. However the output links(output and reject links) keep 0 rows all the time. I have no idea what's...

Yes, it takes long time to sort the input links. So is there a solution to tune the sorting

In business requirement, we need to join 2 file by 2 keys: key_a and key_b,
each file contains more than 10,000,000 records.

is there any good idea to tune the performance ?

thanks all.

it's better if have some simple explaination.

Hi friend,

Which of the following is used to pickup values set in the operating system outside of datastage?

$env
$projdef
$unset
$dshome

Please help to give the answer.thanks so much.

I search in the network but still cannot get the answer.

hi friends, I have queries about using join stage.
is it necessary to SORT both links using the keys we want to join?

in parallel job, does the partition wll impact the join result ?

Thanks.

It's impossible to tell from what you've provided. It might be a glitch in your I/O subsystem, maybe a badspot on the disk. Can you reproduce it? What precisely do you mean by "cut"? ... Hi Ray, Please refer to below detail. I didn't change anything, just rerun the job, but the result are...

Dear all, How are you! Our DS job output a file contains a strange record! This is the output file detail: 1VAA,29660,VN05020642,29660,300073,65011,IFRS,2141200001,,USD,1463347,1VA,*ITL XLN143429999TDG 042,001,AL,1VA,3260,300073,65011,,FN, 00005436495060.000000, 00000000000000.000000, 00005436495060...

ray.wurlod wrote:Join stage needs sorted inputs for efficiency. With sorted inputs it only needs to deal with a single key value at a time. Depending on your settings, if you don't sort your data DataStage will inse ...

Thanks for your reply but "inse" means ???

Hi dear friend, would you please help to clarify the usage of join stage and lookup stage ? I have below questions. 1, in join stage, is it necessary to sort both input links ? what will happen if we don't sort but just patition the input data by the keys? 2, sometimes the join stage and lookup stag...