Search found 88 matches

by yiminghu
Thu Apr 26, 2007 10:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Upgrade Question
Replies: 4
Views: 1034

Could 7.5 and 6.0 be installed on the same server?
by yiminghu
Fri Apr 20, 2007 9:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Upgrade Question
Replies: 4
Views: 1034

Upgrade Question

Hi, Finally our company agrees to upgrade DataStage from 6.0 to 7.5. Because we have so many processes that use datastage, we plan to do it process by process instead of migrate everything at once. I have a question, if does upgrading datastage from 6.0 to 7.5 require any job change? (Of course, we ...
by yiminghu
Fri Jun 23, 2006 8:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance in Extraction
Replies: 12
Views: 3422

if no function is performed on user defined SQL, why use it. Simple just use the generated sql and then see the difference in performance. Tried that. Still does not work. And I also notice a very strange thing. If I don't specify order by in my query, the datastage job starting to write to sequent...
by yiminghu
Wed Jun 21, 2006 9:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance in Extraction
Replies: 12
Views: 3422

DSguru2B wrote:How many rows are you extracting? Do you have user defined sql?
Are you performing any functions in the user defined sql?
The number of row I'm extracting is around 300,000. It is used defined sql, but no function is performed in user defined sql.
by yiminghu
Wed Jun 21, 2006 9:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance in Extraction
Replies: 12
Views: 3422

kris007 wrote:What did you set your Array size to, in the OCI Output Tab? Increase it and see if it helps.
My initial size is 1000, later, I increase to 10000. The speed is 30 row/second now. Still not good.
by yiminghu
Wed Jun 21, 2006 8:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance in Extraction
Replies: 12
Views: 3422

Performance in Extraction

Hi, I have a very simply ds job. It has one Oracle stage and one Sequential file stage. I was trying to extract records from Oracle server and write to sequential file, since there is no transformation needed, I omitted the transform stage. The problem I am getting is that when I ran the query on Or...
by yiminghu
Sun Feb 26, 2006 8:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Synchronization error Resource
Replies: 3
Views: 1355

Thanks. As I could see from past posts, reseting the job could fix the problem next time. My question is whether I need to re-run this time? All the record count looks fine to me.
by yiminghu
Sun Feb 26, 2006 7:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Synchronization error Resource
Replies: 3
Views: 1355

Synchronization error Resource

Hi, I'm encountering a very strange warning message I have never seen before. I was running a job which reads from one table, and update existing rows/insert new rows of another table. The job finished OK with logs. The log shows following message: JObname..Trans1: Synchronization error Resource = J...
by yiminghu
Sun Feb 26, 2006 7:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job stuck for no reason
Replies: 4
Views: 1430

I just found that after I re-compiled the job, everything is OK now.
by yiminghu
Sat Feb 25, 2006 6:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job stuck for no reason
Replies: 4
Views: 1430

Job stuck for no reason

Hi, I have this job which has a container inside it. This job has been running fine since it was created. Today, this job got stuck for no reason, when I looked the performance statistics, it seems it got stuck in one of the transformer in the container. Has anyone encountered such problems before? ...
by yiminghu
Mon Jan 02, 2006 9:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ETL auditing
Replies: 9
Views: 3281

ETL auditing

Hi, Just wonder how do you implement ETL auditing in your company? In our company, we have some high level auditing, like how many input rows, how many output rows and how many rejected rows. In each table, we also have DW_UPDATE_BATCH_KEY, DW_CREATE_BATCH_KEY auditing fields. But business wants mor...
by yiminghu
Wed Nov 09, 2005 2:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: snapshot too old
Replies: 4
Views: 1505

snapshot too old

Hi, I'm having this job. OCI stage--> Transformer --> OCI stage The first OCI stage reads from a table, the second one updates the same table. The problem is one the volum of data is small, everything is OK. Now the job is trying to update nearly 20 millon records, it aborted because of following er...
by yiminghu
Wed Aug 10, 2005 6:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Aggregate problem
Replies: 3
Views: 1118

I enabled the 'In process' row buffer, the buffer size is 1024 K. Is that the problem?
logic wrote:Hi,
Did you try enabling or disabling the row buffer?
by yiminghu
Tue Aug 09, 2005 2:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Aggregate problem
Replies: 3
Views: 1118

Aggregate problem

Hi,

I have a job that has following design

Oracle Stage --- Tranform -- Aggregate -- Oracle Stage

When I running the job, I encountered following error:

ToAggr: ds_intput() - row too big for inter stage rowbuffer

What does that mean?

Anything I could do to prevent this happening?

Thanks,

Carol
by yiminghu
Mon Jul 25, 2005 12:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Delete a job that has no design time information
Replies: 4
Views: 1120

kduke wrote:Try to delete it in Manager.
It did not work. The error message I got is
'Cannot open executable job file RT_CONFIG3187'. 3187 is the job number.