Search found 127 matches
- Wed Apr 26, 2006 8:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Issues regarding Notification Activity
- Replies: 7
- Views: 2359
Hi I am trying to develop the Job control routine to track the status from the calling job and send a mail. I am trying to get the log details by the following code. Is it the correct way of trapping the status from a Datastage job. I have never used Job control before. Sorry if there are any silly...
- Sat Apr 22, 2006 9:15 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Issues regarding Notification Activity
- Replies: 7
- Views: 2359
Issues regarding Notification Activity
Hi I have two Notification Activity in my Job sequencer- one which send mail in case of Success and one in case of Failure to different email address. I have the option to add the job status in th email enabled: In case of success of the Job sequencer run, I am getting this message Description : Loa...
- Thu Apr 20, 2006 9:57 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
The hashed file needs only two columns (Account_Num and Account_ID), so it's not going to be that large even with a few million rows. Yes- I have faith in Hashed file for one key column for lookup-like (Account_Num and Account_ID) . But most of them have three or four lookups to the dimensions befo...
- Thu Apr 20, 2006 9:30 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using sequence in Datastage Sequencer
- Replies: 3
- Views: 1291
- Thu Apr 20, 2006 9:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
Rubbish. You can perform a lookup using the text file as stream and the table (or a hashed file containing appropriate columns from it) to feed the reference input. You don't have to join. Ok..... I felt dimension like say Account would be very big for loookup through Hashed File. Again those table...
- Thu Apr 20, 2006 7:38 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using sequence in Datastage Sequencer
- Replies: 3
- Views: 1291
Using sequence in Datastage Sequencer
I have a question on Datastage sequence. Just for information- we are working on Datastage server edition 7.5 Say I have designed a job sequence in this fashion: ---------->Job A ----------->Job B Job 1 --------> Sequence ----------->Job C ----------->Job D My first question is should Job A, Job B, ...
- Thu Apr 20, 2006 7:07 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
Appending a line to a text file is WAY faster than upserting a row into a database table, and WAY WAY faster if that table has constraints to be checked and/or indices to be maintained. Hence my suggestion to use files for staging. (You can also use these as data files for bulk loading.) But Ray I ...
- Thu Apr 20, 2006 6:11 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
Not much to explain. Simply replace your staging tables with sequential files, swap your OCI stages for Sequential File stages. Landing the data to flat files instead of loading them up into staging tables cuts out all the overhead of the database, which it seems like you are not needing. Now, if t...
- Thu Apr 20, 2006 5:50 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
Try using staging files rather than staging tables. You'll be amazed how much difference it makes. Hi Ray could you please explain the process. Do you mean working in the file system. Manipulating them in file system. I am basically need the idea so that I can project the proof of concept on this. ...
- Thu Apr 20, 2006 4:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue in Datastage Server Edition
- Replies: 13
- Views: 3519
Performance Issue in Datastage Server Edition
Hi We have a problem in our hands out here. We would be loading certain tables in Oracle Database from files coming from mainframes. Our job structure looks like: Job 1: Infile -----Datastage-----> Staging Tables ! ! V Error Table Job 2: Staging table -----Datastage-----> Tmp Tables ! ! V Error Tabl...
- Wed Apr 19, 2006 10:28 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: something about date
- Replies: 19
- Views: 4007
Now can you help me to figure out a way So I can upload a constant string type in date type OCI stage. You just... do it. :? Make sure it is in the format the datatype is expecting. For example, declared as a Timestamp it would need to be in the format YYYY-MM-DD HH24:MI:SS to 'upload' correctly, a...
- Mon Apr 10, 2006 12:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Valid Date function
- Replies: 3
- Views: 1720
Validate Date Function
In my project I needed a routine to check whether a date is in valid format. We need to give the input format which has been specified as CCYYMMDD. I am describing the functionality and the code below. Please suggest any improvement that can be incorporated Arguments : Arg1 = aINDATE : Input date Ar...
- Fri Apr 07, 2006 9:46 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Datastage logic vs SQL
- Replies: 14
- Views: 14034
Thats true Ray can't help- just as DSGuru2B said.....they just bought it Even they are not really have any guy knowing Datastage well- they hired me but after joining this project I am pretty bored writing silly jobs(only simple load jobs). Anyway I can't do anything more than suggesting......... So...
- Fri Apr 07, 2006 12:46 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Datastage logic vs SQL
- Replies: 14
- Views: 14034
Sorry for being late in replying to your valued mails. I would like to provide the following information on what we plan: We are working on two things-Coversion(Initial Load) and Update on Unix platform having 8 CPU Our conversion would be really big (4 tera bytes !!!) but I think it really does mat...
- Tue Apr 04, 2006 8:28 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Datastage logic vs SQL
- Replies: 14
- Views: 14034
Datastage logic vs SQL
Hi I am working in a project having strong fan following for SQL and PL/SQL. Still as a Datastage developer I want to use Datastage in most of my logic. But sometimes there is often a functional overlap between SQL and DataStage stages. My Question is when to use Datastage logic and when to use SQL?...