Search found 127 matches

by avi21st
Wed Apr 26, 2006 8:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Issues regarding Notification Activity
Replies: 7
Views: 2359

Hi I am trying to develop the Job control routine to track the status from the calling job and send a mail. I am trying to get the log details by the following code. Is it the correct way of trapping the status from a Datastage job. I have never used Job control before. Sorry if there are any silly...
by avi21st
Sat Apr 22, 2006 9:15 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Issues regarding Notification Activity
Replies: 7
Views: 2359

Issues regarding Notification Activity

Hi I have two Notification Activity in my Job sequencer- one which send mail in case of Success and one in case of Failure to different email address. I have the option to add the job status in th email enabled: In case of success of the Job sequencer run, I am getting this message Description : Loa...
by avi21st
Thu Apr 20, 2006 9:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

The hashed file needs only two columns (Account_Num and Account_ID), so it's not going to be that large even with a few million rows. Yes- I have faith in Hashed file for one key column for lookup-like (Account_Num and Account_ID) . But most of them have three or four lookups to the dimensions befo...
by avi21st
Thu Apr 20, 2006 9:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using sequence in Datastage Sequencer
Replies: 3
Views: 1291

chulett wrote:And yes. :wink:
I had to raise this question- as I needed support for my concept to show my team. Thanks for the help.
by avi21st
Thu Apr 20, 2006 9:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

Rubbish. You can perform a lookup using the text file as stream and the table (or a hashed file containing appropriate columns from it) to feed the reference input. You don't have to join. Ok..... I felt dimension like say Account would be very big for loookup through Hashed File. Again those table...
by avi21st
Thu Apr 20, 2006 7:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using sequence in Datastage Sequencer
Replies: 3
Views: 1291

Using sequence in Datastage Sequencer

I have a question on Datastage sequence. Just for information- we are working on Datastage server edition 7.5 Say I have designed a job sequence in this fashion: ---------->Job A ----------->Job B Job 1 --------> Sequence ----------->Job C ----------->Job D My first question is should Job A, Job B, ...
by avi21st
Thu Apr 20, 2006 7:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

Appending a line to a text file is WAY faster than upserting a row into a database table, and WAY WAY faster if that table has constraints to be checked and/or indices to be maintained. Hence my suggestion to use files for staging. (You can also use these as data files for bulk loading.) But Ray I ...
by avi21st
Thu Apr 20, 2006 6:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

Not much to explain. Simply replace your staging tables with sequential files, swap your OCI stages for Sequential File stages. Landing the data to flat files instead of loading them up into staging tables cuts out all the overhead of the database, which it seems like you are not needing. Now, if t...
by avi21st
Thu Apr 20, 2006 5:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

Try using staging files rather than staging tables. You'll be amazed how much difference it makes. Hi Ray could you please explain the process. Do you mean working in the file system. Manipulating them in file system. I am basically need the idea so that I can project the proof of concept on this. ...
by avi21st
Thu Apr 20, 2006 4:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3519

Performance Issue in Datastage Server Edition

Hi We have a problem in our hands out here. We would be loading certain tables in Oracle Database from files coming from mainframes. Our job structure looks like: Job 1: Infile -----Datastage-----> Staging Tables ! ! V Error Table Job 2: Staging table -----Datastage-----> Tmp Tables ! ! V Error Tabl...
by avi21st
Wed Apr 19, 2006 10:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: something about date
Replies: 19
Views: 4007

Now can you help me to figure out a way So I can upload a constant string type in date type OCI stage. You just... do it. :? Make sure it is in the format the datatype is expecting. For example, declared as a Timestamp it would need to be in the format YYYY-MM-DD HH24:MI:SS to 'upload' correctly, a...
by avi21st
Mon Apr 10, 2006 12:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Valid Date function
Replies: 3
Views: 1720

Validate Date Function

In my project I needed a routine to check whether a date is in valid format. We need to give the input format which has been specified as CCYYMMDD. I am describing the functionality and the code below. Please suggest any improvement that can be incorporated Arguments : Arg1 = aINDATE : Input date Ar...
by avi21st
Fri Apr 07, 2006 9:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage logic vs SQL
Replies: 14
Views: 14034

Thats true Ray can't help- just as DSGuru2B said.....they just bought it Even they are not really have any guy knowing Datastage well- they hired me but after joining this project I am pretty bored writing silly jobs(only simple load jobs). Anyway I can't do anything more than suggesting......... So...
by avi21st
Fri Apr 07, 2006 12:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage logic vs SQL
Replies: 14
Views: 14034

Sorry for being late in replying to your valued mails. I would like to provide the following information on what we plan: We are working on two things-Coversion(Initial Load) and Update on Unix platform having 8 CPU Our conversion would be really big (4 tera bytes !!!) but I think it really does mat...
by avi21st
Tue Apr 04, 2006 8:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage logic vs SQL
Replies: 14
Views: 14034

Datastage logic vs SQL

Hi I am working in a project having strong fan following for SQL and PL/SQL. Still as a Datastage developer I want to use Datastage in most of my logic. But sometimes there is often a functional overlap between SQL and DataStage stages. My Question is when to use Datastage logic and when to use SQL?...