DSXchange

Here is my performance bottleneck. Input = 2 billion records. Reference Data = 10 million records. We currently are using a lookup stage as opposed to a join stage to avoid having to sort the input 2 billion records from the mainframe file. The Lookup Stage is set to sequential to not load 10 millio...

After Job Routine only seems to be available from a job, not a sequencer. Is that correct?

I really don't want to use ExecSh script from Sequencer since the job log will not be complete because the job is still running. Is my only choice to call this from the aix script that runs the job?

Boom!!! Gosh that is simple. Thanks a ton.

Hello. I have written a .ksh script which will invoke several dsjob commands, but in general, it will accept project name, job name, email address as its arguments, and will retrieve the job log and email the job log, as well as any dependent job in an aborted states log to the email. I currently ru...

Don't do this. It fills up your logs with a new instance for every file and its a real pain. you could feasible go in and delete these instances then to clean the log but then you lose a clean visibility into your log. For example, say you start and then leave. You come back and you have run 100 fil...

uHey All, I am just curious your general perceptions on Aggregate performance in DataStage. If I had comparable cpu/memory on a DB2 Database and on a DataStage Server --- which should win(keep in mind you have to get the data off of DB2 to start with anyways? I currently am aggregating 232,164,602 i...

permission denied for me to do that and can't get ahold of a DBA right now

All in all I will be loading the above size at least 8 times

I am loading approx 15 - 25 million rows at a time.

Loading 18 columns, 9 ints, 2 char 1's, a timestamp, and 5 decimal 15,3, and a Varchar 20

Hello, I am so frustrated. How the heck does the DB2 Load work against partioned tables. Here is my deal. When I load a non-partitioned table and specify non-recoverable --- everything is fine and I can immediatly select, update, insert and delete from table. When I load a partionted table and speci...

My problem actually ended up not being the format. The issue is DataStage cannot handle the following timestamps before 01-03-0001 :00.00.00 or after and including 12-31-9999 24:00:00 My problem was DB2 sets the timestamp to 12-31-9999 24:00:00 which one could argue is actually into the year 10,000....

I am having trouble formatting the timestamp in the manner I need. In the database, the timestamp is being formatted as %yyyy-%mm-%dd %hh:%nn:%ss.6 THe datastage project default is %yyyy-%mm-%dd %hh:%nn:%ss I have tried overriding the timestamp format at the job level(Job properties/defaults tab) to...

So here is my problem. I have to bring a file that is stored on a MVS mainframe server and load it into a DB2 table. I have FTP'd the file over directly onto the UNIX box. I have a Cobol copybook directly from the mainframe that the mainframe uses to interpret the File. Part of the copybook reads as...