Search found 376 matches

by jerome_rajan
Tue Jun 10, 2014 11:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Timestamp Format Changes In Hash File
Replies: 2
Views: 3155

Timestamp Format Changes In Hash File

Hi, I have a simple job that reads from my date dimension and writes into a hash file. One of the fields of Date datatype is read as a timestamp in my oracle connector using the mask YYYY-MM-DD HH24:MI:SS. I'd expect the timestamp to read something like 2014-06-11 00:00:00 But when I see the hash fi...
by jerome_rajan
Tue Jun 10, 2014 5:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage not optimized out of the job
Replies: 4
Views: 1731

FYI, the Copy Stage will not get optimized out during compilation but only after the score is composed which is post job run. Now that you mention that you ran the job and the score still contains the copy operator, remember that by setting the option to 'false' you are giving the optimizer an optio...
by jerome_rajan
Tue Jun 10, 2014 4:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage not optimized out of the job
Replies: 4
Views: 1731

Try running the job and check the job score (set APT_DUMP_SCORE environment variable) to see if the copy operator appears there
by jerome_rajan
Tue Jun 03, 2014 7:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using a Function In The Insert Statement
Replies: 2
Views: 3109

Thanks Craig.
The error I was getting was because of incorrect bind variables and not because of the comma. Got through it. Thank you
by jerome_rajan
Mon Jun 02, 2014 10:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using a Function In The Insert Statement
Replies: 2
Views: 3109

Using a Function In The Insert Statement

Hi, We have an Oracle stage with a custom insert SQL. To fulfill some requirements, we are modifying the insert to include a function so that my insert will look something like : INSERT INTO XYZ_EDI_852_DLY_FACT (EDI_SNDR_KEY,......,BU_CODE,OPER_WK_END_DT) VALUES (:1,...., GET_BU_CODE_X(:11,:2),GET_...
by jerome_rajan
Wed Apr 30, 2014 3:32 am
Forum: General
Topic: Multiple parameterized instances in parallel
Replies: 5
Views: 2382

Thank you Ray for taking time to answer my query. Agreed. The dummy job stage is really not required. Here is the updated design. The nested condition stage would trigger 2 links as mentioned in my earlier post. I think that this would trigger the actual_sequence for different BUs in parallel albeit...
by jerome_rajan
Wed Apr 30, 2014 1:32 am
Forum: General
Topic: Multiple parameterized instances in parallel
Replies: 5
Views: 2382

Then the processing would become sequential. Here, the dummy job(which would basically do nothing) would run as part of the loop in every iteration. On successful completion, the dummy job will trigger the 2 subsequent links - the actual_sequence with eh start loop counter variable as a parameter an...
by jerome_rajan
Wed Apr 30, 2014 1:21 am
Forum: General
Topic: Multiple parameterized instances in parallel
Replies: 5
Views: 2382

Multiple parameterized instances in parallel

Hi, We have a set of multi-instance jobs that form a master sequencer. These jobs currently process data for multiple business units(BU) at one go. We are trying to separate the process for each BU and have them run in parallel through the same existing logic. The names and number of BUs will decrea...
by jerome_rajan
Wed Apr 16, 2014 2:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Target as Lookup
Replies: 2
Views: 2748

Target as Lookup

Hi, We have a job that looks up from the same table that the job is loading into. Something like this. Table A | | | Hash File | | SrcFile---->Transformer-------->Table A Is this a good/correct practice? Won't the target keep changing even while it is being used as reference due to the pipe-lining o...
by jerome_rajan
Tue Apr 15, 2014 10:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job Concepts
Replies: 1
Views: 2847

DataStage Server Job Concepts

Hi, I am currently reviewing some decade old server jobs. Having worked with parallel jobs all the while, I'm running into a few conceptual road-blocks. Please help me understand the following: 1. There's a job that uses a Universe table as a reference for a lookup. Why and why not a hash file? 2. W...
by jerome_rajan
Thu Apr 10, 2014 2:53 am
Forum: General
Topic: DataStage Process Control
Replies: 3
Views: 1851

Code: Select all

1. Check if same job is already running
2. Check how many jobs are simultaneously running. Set a threshold value and do not allow the number of jobs to cross the threshold
What else?
by jerome_rajan
Thu Apr 10, 2014 2:28 am
Forum: General
Topic: DataStage Process Control
Replies: 3
Views: 1851

DataStage Process Control

Hi, We are in the process of defining a framework through which each of our DataStage jobs should flow through before finally executing. What are the things to look out for while defining such a framework? For starters, I am planning to check for other instances of the same job with the same invocat...
by jerome_rajan
Fri Feb 28, 2014 7:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CheckSum Stage in datastage
Replies: 13
Views: 10074

What have you tried? Did you read through the parallel developers guide?
by jerome_rajan
Fri Feb 28, 2014 4:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CheckSum Stage in datastage
Replies: 13
Views: 10074

Hi,
I think the Change Capture Stage would serve your purpose. Suggest using the Checksum approach if you are dealing with huge reference data.
by jerome_rajan
Mon Dec 30, 2013 4:43 am
Forum: General
Topic: DataStage Job Generation using FastTrack mappings
Replies: 3
Views: 1987

I don't think FastTrack is yet capable of generating complex jobs. FastTrack would be able to generate fairly straight forward jobs. Why don't you check it for yourself? Would definitely love to be proved wrong :)