Search found 45 matches

by jiegao
Fri Aug 10, 2007 7:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

Run stopped after 100 rows can only be caused by one thing; when the job run request is issued, a limit of 100 rows is imposed. Check the Limits tab on your Job Run Options dialog. ... No limit is set. It is very werid that when I run the batch from the designer, there is no problem. But when I run...
by jiegao
Thu Aug 09, 2007 7:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

Run stopped after 100 rows can only be caused by one thing; when the job run request is issued, a limit of 100 rows is imposed. Check the Limits tab on your Job Run Options dialog. ... I will check the Run Options when I get back office tomorrow morning. But I run the sequence job from the director...
by jiegao
Thu Aug 09, 2007 3:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: rows per transaction setting
Replies: 4
Views: 1723

rows per transaction setting

Hello, I have a job likes the following Source Stage -> TFM ---->(link1) Delete From Table 1(OCI Stage) -----> (link 2) Insert into Table 1(OCI Stage) I knows that the rows per transaction setting has big impact on the performance. Setting to 1 is much slower than setting it to 0. My question is if ...
by jiegao
Thu Aug 09, 2007 10:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

Re: Hash File Probem

I seperate the job into 2 jobs. A simple job loading from hashed file to Oracle table. I got the following log today:
Run stopped after 100 rows

No warning.
by jiegao
Wed Aug 08, 2007 9:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

Just occasionally. But It happened today and last week.
ArndW wrote:Also, do you re-create the hashed file each run or append to it? Is the error visible on each run or just occasionally? Do other jobs use the same hashed file? If you turn off buffering on the write d ...
by jiegao
Wed Aug 08, 2007 9:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

The file is used only in one job. File is recreated every job run. No write cache is used.

ArndW wrote:Also, do you re-create the hashed file each run or append to it? Is the error visible on each run or just occasionally? Do other jobs use the same hashed file? If you turn off buffering on the write d ...
by jiegao
Wed Aug 08, 2007 9:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

No constraint used. The hashed file stage is used only for removing duplicate records.

ArndW wrote:Do you have a SELECT on your hashed file read or any warnings in the log file? ...
by jiegao
Wed Aug 08, 2007 9:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

Thanks Ray. There is no warning.

ray.wurlod wrote:Look in the job log for Oracle warnings.

It's hashed file, not hash file. ...
by jiegao
Wed Aug 08, 2007 9:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

No eror. only 100 rows went into OCI stage but has 10000 rows in the hash file
ArndW wrote:How many rows went "into" the OCI stage - perhaps you are getting insert errors due to constraints. Add a reject link in the job to ensure that this isn't causing your dropped records. ...
by jiegao
Wed Aug 08, 2007 8:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing and reading a hash file in same stage problem
Replies: 18
Views: 3925

writing and reading a hash file in same stage problem

I have a job like this Folder stage -> XML stage -> Hash File stage(with input and output on the same file) -> OCI The reason I use Hash file stage is to remove duplicate data. Most of times it works fine and I have used a lot in my jobs with a hash file stage having input and output link for the sa...
by jiegao
Tue Jul 31, 2007 9:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Locking of Table
Replies: 13
Views: 4988

Re: Locking of Table

I have the same lock issue. Most of the times it works fine. But sometimes it just hangs there waiting for lock to release. I am wondering if array size afffects the locks. Currently my array size is larger than 0 and rows per transaction are all set to 1. Thanks in advance. Hi , While doing Update/...
by jiegao
Thu Mar 08, 2007 10:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: call stored procedure repeatly
Replies: 11
Views: 3282

Re: call stored procedure repeatly

I have a bunch of records to be inserted into an informix database. But before the insertion, I need to call a stored procedure to generate an id and add the id to the records. Of course, each record will have a different id. How can I get this done? Thanks in advance for your help. I have not work...
by jiegao
Fri Nov 10, 2006 8:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to mail out the job that fails
Replies: 6
Views: 1506

Thanks all. I will try Kim's suggestion. But I am not sure if my Datastage admin will allow me to deploy some third party components to the production server. I will look into this first. Craig's method does not suit me because it will send out too many emails in one schedule run and I prefer to sen...
by jiegao
Fri Nov 10, 2006 2:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to mail out the job that fails
Replies: 6
Views: 1506

how to mail out the job that fails

Hello, I have many jobs, including sequence jobs, in my projects. There are 4 layers of sequence jobs, that is one sequence calls other sequences and call call other sequences. If job failed in any of jobs down the road, I want to mail the user the reason of the failure in the top layer of sequence ...
by jiegao
Thu Nov 09, 2006 8:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Procedure calling problem
Replies: 4
Views: 1388

Re: Procedure calling problem

Hi everybody, My objective is that i have to call Sqlplus statement using User & Pwd, once logged in i have to execute Pl/Sql procedure from that. For this I have called a script in before job subroutine which takes UserId,Pwd,Schema,Dsn & Date as parameter.this script actually calls sqlplu...