Search found 73 matches

by xli
Fri Jun 10, 2005 1:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fail to create a new project
Replies: 5
Views: 3612

Hi, Ray So nice to talk to you here, I am just fine if you help me get this issue resolved. here is my answer : a) I did log in as a DBA user. b) How can I find a corrupted hashed file, as you know, we've got heaps hashed files. c) As the project creation failed, we don't have project to delete. Tha...
by xli
Thu Jun 09, 2005 10:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fail to create a new project
Replies: 5
Views: 3612

Fail to create a new project

Hi, I was trying to create a new project using DataStage Administrator, it failed along with a error message : DSR.ADMIN: Error creating a schema Some users will not have access to this schema. Read operation failure. Internal file corruption detected. File must be repaired. What does it mean and ho...
by xli
Tue Apr 05, 2005 1:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: performance issue
Replies: 2
Views: 914

performance issue

Hi,

To apply a complex logic on a transformation, I am able to code in transformer directly, alternatively, I can create a routine called by transformer. I am wondering, from performance perspective, which approach is more efficient.

Thanks in advance

xli
by xli
Mon Feb 21, 2005 11:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Performance
Replies: 8
Views: 3278

For a single job, it takes 12 hrs to process 9 million rows, I think you'd better do something to improve the performance first.

Since you have stored you data in staging area, I guess your job have many complex lookups, try to reduce the number of lookups, and use hashed files as lookups.

xli
by xli
Mon Feb 07, 2005 7:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to join huge flat files together
Replies: 7
Views: 4978

How to join huge flat files together

Hi, I have 7 big flat files, each contains 24 million records which have been sorted by the first numeric field delimitered by Ctrl B (002). I want to join them together side by side, for example : File A: 1^Ba^Bb 2^Bx^By .... File B: 1^Bc^Bd 2^Bm^Bn .... After merged, it should look like : File C :...
by xli
Tue Feb 01, 2005 4:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to merge multiple sequencial files together effectively
Replies: 6
Views: 3525

How to merge multiple sequencial files together effectively

Hi, I have four huge flat files needed to be merged together. They have the same records number of 24 millions with the same key fields key1, key2, key3. each file has average 50 fields. These files are required to be sorted by key1, key2 and key3 first, and being merged together, then output to app...
by xli
Thu Oct 21, 2004 1:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameter in job sequence
Replies: 3
Views: 992

parameter in job sequence

Hi, Is it possible to generate a value in one Job Activity and use that value to set the value of a job parameter in subsequent Job Activities in a Job Sequence? It's easy enough to do in code, but my current client wants to avoid code as much as possible. Scenario is that job #1 generates a batch I...
by xli
Thu Aug 26, 2004 5:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Add month to a given date
Replies: 4
Views: 2575

denzilsyb, what I mean is add/minus n months to a given date, it's exactly what the oracle add_months() function does. jclin777, thanks for your post, I know I can created a routine to handle it. I was just wondering if there is a simple built-in funciton I haven't discover to do it. However, it see...
by xli
Thu Aug 26, 2004 1:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Add month to a given date
Replies: 4
Views: 2575

Add month to a given date

hi

I am wondering if DataStage has a simple function to do the same thing as oracle function ADD_MONTHS()

Thanks

xli :roll:
by xli
Tue Aug 10, 2004 3:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: date comparison issue
Replies: 1
Views: 992

date comparison issue

Hi, There is a hash file with 3 keys, cust_id, record_start_date, record_end_date. By using this hash file as lookup, I wonder whether or not there is a way to find cust_id with record_date existing between the record_start_date and record_end_date ? I mean, I want find a cus_id with record_date gre...
by xli
Wed Dec 17, 2003 2:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: NOTFOUND link variable curious behaviour
Replies: 10
Views: 6915

I have already noticed this issue even from DataStage version4.0 to version6.0. Also, I noticed that in most of jobs, the NOTFOUND function works. But in some jobs, even very simple jobs, for no particular reason, It produced wicked logic result. Now, I have changed all my jobs to use ISNULL or NOT(...
by xli
Thu Oct 23, 2003 11:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: SORT stage issue
Replies: 2
Views: 1730

SORT stage issue

Hi, experts

I have a job using sort stage, it runs well many times. However, today, it always issued a error message today as below :

SORT: ds_ipcgetnext - timeout waiting for mutex

and stopped at sort stage processing.

Can anybody tell me what this problem is ?

Thanks in advance

xli
by xli
Thu Oct 09, 2003 3:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS server restart question
Replies: 2
Views: 1168

Thank you, craig

xiong
by xli
Thu Oct 09, 2003 2:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS server restart question
Replies: 2
Views: 1168

DS server restart question

Hi, Folks In terms of DataStage document, when we try to restart server, to avoid an open connection, ensure that all client connections are closed before shutting down the DataStage server. the following unix command is used to check: # netstat | grep unirpc this command produces no output when all...
by xli
Thu Oct 02, 2003 10:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trim Functions
Replies: 6
Views: 1694

If you just want to identify a blank string containing one or more space, there is a built-in tranform function StringIsSpace under Tranformssdk directory in DataStage Manager. If you cannot find it, the basic code to check a blank string is like : If Not(IsNull(Transform_Full_File.FNAME) or Transfo...