Search found 46 matches

by eldonp
Tue Sep 16, 2008 12:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Funny characters in Sequential file columns of a paralell jo
Replies: 4
Views: 2896

Funny characters in Sequential file columns of a paralell jo

We are re-writing a certain job into parallel. The job creates a pipe-delimited flat file. Problems is, for all varchar fields - for cases that there is less data than the field length, that DataStage is not trimming the data, as per our trimb(column) function, and is in fact inserting 'place holder...
by eldonp
Wed Sep 10, 2008 1:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Informix Database connectivity Issue
Replies: 7
Views: 9849

what we usually do is the following - although we have informix and datastage on seperate machines: 1. Install the informix software on the datastage server 2. Set up the /etc/hosts file on the datastage server to see the informix machine 3. Set up the sqlhosts file somewhere in the informix softwar...
by eldonp
Wed Jul 16, 2008 7:17 pm
Forum: General
Topic: Shell script to start a job using dsjob
Replies: 13
Views: 42189

Thanks keshav0307 - very insightful - especially considering that the initial post is 5 years old!
by eldonp
Sun Jul 13, 2008 9:50 am
Forum: General
Topic: Updating fact data / modify aggregate
Replies: 1
Views: 1652

Updating fact data / modify aggregate

When loading fact tables in Redbrick, there was a modify aggregate mode that would update existing fact table measures if the dimension keys existed, or inserted new records if they did not. In addition, because loads were done from flat files, there was a way to skip records (in the event of a cras...
by eldonp
Fri Jul 11, 2008 2:00 am
Forum: General
Topic: Updated auto-export script as per kDuke
Replies: 3
Views: 2418

Ray:
By manual I mean using the Designer Client - as this gives us the ability to select only the components that we want to back up. We would be happy to use a script to do the same thing - that would mean that it can be automated again!
by eldonp
Thu Jul 10, 2008 3:53 pm
Forum: General
Topic: Updated auto-export script as per kDuke
Replies: 3
Views: 2418

Updated auto-export script as per kDuke

Before our move to 8.0.1, we used the automatic export script from the honorable kDuke's website. This experly performed full exports of all the projects on our server and filed these beautifully in date-stamped folders. After the upgrade, DataStage seems to take hours to do a full project export (s...
by eldonp
Thu Jul 10, 2008 3:42 pm
Forum: General
Topic: South Africa
Replies: 3
Views: 2190

My honour sire. Lets get in touch!
by eldonp
Wed Jun 11, 2008 3:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel lookup best practise
Replies: 2
Views: 1975

Thanks. I thunk it through and tiggered something out...

Best practise for doing a lookup into a lookup into a lookup in enterprise?
by eldonp
Mon Jun 09, 2008 4:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Get job status after using UtilityRunJob
Replies: 1
Views: 1957

Get job status after using UtilityRunJob

I have a requirement to pass down runtime parameters from a file to a job. I have this working in a sequencer by using the UtilityRunJob(jobname,param1=value1|param2=value2,rowlimit,warnlimit) notation inside a routine activity. In this sequencer, I need to evaluate the success of the job and handle...
by eldonp
Sat Jun 07, 2008 8:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel lookup best practise
Replies: 2
Views: 1975

Parallel lookup best practise

Having just had the first cup of enterprise.... We always did server job lookups using hashed files. We found that lookups from ODBC stages seemed to do full table scans - or take much longer. What is the best practise for lookups in enterprise? We have varying volumes - from less than 100 rows to b...
by eldonp
Mon Jun 02, 2008 10:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Scheduling DataStage jobs in HP Sitescope
Replies: 2
Views: 1607

Scheduling DataStage jobs in HP Sitescope

We have 15 DataStage projects and probably close to 1000 jobs in total. Scheduling and monitoring jobs is becoming a problem. Has anyone started scheduling DataStage jobs in an external scheduler...? How does this work for you? How have you implemented this? Specifically, has anyone done this in HP ...
by eldonp
Wed May 07, 2008 3:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clear job log from command line
Replies: 1
Views: 1303

Clear job log from command line

Is there a way that I can clear a job log from the command line?
by eldonp
Fri Feb 22, 2008 3:52 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: $ReturnValue behaviour in sequencer
Replies: 2
Views: 2199

$ReturnValue behaviour in sequencer

I am trying to implement a dependency in a sequencer. I am required to wait until a certain count is equal or greater than 34 before running a dependent job. I have some uncertainty about the way the 'Custom' Expression Type inside the Nested Condition stage of the sequencer is evaluating the value....
by eldonp
Wed Jan 16, 2008 3:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange behaviour of multiple instances
Replies: 10
Views: 6485

chulett : I have checked the "Allow Multiple Instance" box in Job Properties to make it multiple instance. ds : I said that I do not have an error message. ray.wurlod: I do not run the job - only the instances, each with a unique invocation id, and parameters to ensure that the sources and...
by eldonp
Tue Jan 15, 2008 9:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange behaviour of multiple instances
Replies: 10
Views: 6485

Strange behaviour of multiple instances

In an effort to reduce the number of jobs that do the same thing, i enabled multiple instances. I see some unexpected behaviour. 1. Only 2 instances of the job appear in the director - irrespective of how many are kicked off. 2. If more that 2 instances are run, only 2 run succesfully. Others abort....