Search found 29 matches

by deswhk
Wed Sep 17, 2008 1:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: copy hashed file
Replies: 8
Views: 2850

It has to exist. Look in a "proper" hashed file directory. Note that it has a leading "." and a capital "T". UNIX is case sensitive. The leading "." means that it is a hidden file so you would nee ... You are right. I can view the hashed file after copying ov...
by deswhk
Wed Sep 17, 2008 12:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: copy hashed file
Replies: 8
Views: 2850

You don't have to copy .Type30 - it's empty. But it does need to be there. It signals to DataStage that this directory is a hashed file. Without it DataStage treats it as an ordinary directory, and ... Where is this .type30 file located? I don't find it in the hashed file directory. I am using a dy...
by deswhk
Tue Sep 16, 2008 11:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: copy hashed file
Replies: 8
Views: 2850

Yes, provided that the hardware is compatible (primarily byte order). For example, copying from a non-Intel chip to an Intel chip would cause difficulties, because every pair of bytes in the hashed ... Ok, but after I copied the hashed file cannot be read. It gives me junk characters. This is how I...
by deswhk
Tue Sep 16, 2008 9:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: copy hashed file
Replies: 8
Views: 2850

copy hashed file

Can I copy the hashed file directory and its dictionary file in binary mode from one location to another loaction?
by deswhk
Thu Jul 24, 2008 2:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: erroneous link collector output
Replies: 6
Views: 2373

Yup, am using round robin. The output link turns green as soon as one of the input links turn green when the other input links are still in progress.
by deswhk
Thu Jul 24, 2008 1:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: erroneous link collector output
Replies: 6
Views: 2373

I think I have figured it out why. The 2 links into the LC complete at different time. One link is faster than the other. When one of the links has completed and the other is still in progress, the output link of LC will complete irregardless of the other link(s) that are still in progress. Therefor...
by deswhk
Wed Jul 23, 2008 11:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: erroneous link collector output
Replies: 6
Views: 2373

the transformer picks certain fields to be propagated and some simple transformation.
tried to recompile, reset and waited for at least 15 minutes.
I am really running out of clue as to this weird behavior.
by deswhk
Wed Jul 23, 2008 10:01 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: erroneous link collector output
Replies: 6
Views: 2373

erroneous link collector output

Hi, I have the following job. Oracle1 ---> Xfm1 ---> link collector ---> sequential file ^ | Oracle2 ---> Xfm2 -------------| The output from link collector is always from the previous run's output of Xfm1, which is not expected. Example:- 1) Run 1 Output from Xfm1: 200 rows Output from LC: 100 rows...
by deswhk
Sun May 25, 2008 11:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

I turned on the trace only for debugging purposes. Else, there is no reason why I should do so as it will take up more resources. Anyway, even without the trace turned on, it is still as slow if not slower. The job doesn't do any sorting. Anyway, there is no sort option in the merge stage. The trans...
by deswhk
Fri May 23, 2008 5:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

Re: slow performance while merging 2 files in merge stage

job 1:-
file A ~2.4million
file B ~1.6million

job 2:-
output from job1 ~2.4 million
file C ~2.1million

from the number of records, they are almost the same. Job 1 flies but job 2 crawls...
by deswhk
Fri May 23, 2008 5:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

Re: slow performance while merging 2 files in merge stage

both files are about the same size ~2.4million. Would pure inner join be much much faster? thks.
by deswhk
Fri May 23, 2008 5:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

Re: slow performance while merging 2 files in merge stage

both files are about the same size ~2.4million. Would pure inner join be much much faster? thks.
by deswhk
Thu May 22, 2008 2:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

Re: slow performance while merging 2 files in merge stage

I have 2 jobs with exactly the same design: merge ---> xfm ---> sequential file One job does about 20k rows/sec but another is only doing 100 rows/sec I check the log with trace level 1 could not get anything out of it. Would appreciate if anyone can advise. To add to the above:- job 1 merges file ...
by deswhk
Wed May 21, 2008 11:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow performance while merging 2 files in merge stage
Replies: 13
Views: 4982

slow performance while merging 2 files in merge stage

I have 2 jobs with exactly the same design:
merge ---> xfm ---> sequential file

One job does about 20k rows/sec but another is only doing 100 rows/sec
I check the log with trace level 1 could not get anything out of it.
Would appreciate if anyone can advise.
by deswhk
Wed Jan 09, 2008 8:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reset / restart of multiple layers of sequences
Replies: 6
Views: 1937

chulett wrote:All Aborted/Restartable ones, yes. ...
ok, thanks :)
seems like I have to do it in a wrapper to do the reset of all the sequences for a fresh start of the job.