Search found 88 matches

by vick
Thu Mar 15, 2007 1:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Data Capture
Replies: 12
Views: 5000

Change Data Capture

Hello, I have 2 sequential files with 6000 & 6500 records respectively. I need to do an upsert into Oracle Table. I have to capture the changes in the input files and set the flag namely Unchanged, Insert, Update or Delete. This is what I m doing presently. The input flat files are previous day ...
by vick
Fri Mar 09, 2007 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Create Log file for DSEE job
Replies: 5
Views: 1364

Create Log file for DSEE job

How do you create a log file for each DSEE job run. I looked for an option in DSAdministrator but its only for sequence. I use the CLI dsjob command (dsjob -logsum $projectname $jobname > filename.txt) and append it to a file after each run. Is there a way to create a log file by default after every...
by vick
Fri Mar 09, 2007 10:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Reject file
Replies: 8
Views: 1742

I think I could resolve the issue. I am not writing the reject records to a file. I use an intermediate COPY stage to pass the reject records from LOOK_UP1 to LOOK_UP2. The null_handling is taken care of in the COPY stage OracleEnt_Stage | | OracleEnt-->Lookup_stage----------> Funnel---->SeqFile_Sta...
by vick
Fri Mar 09, 2007 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Performance
Replies: 3
Views: 985

Look Up Performance

Hello, I have a job that looks like this. A lookup stage with two reference tables. I was wondering if the design is better than having two lookup stage for each reference table. OracleRef1_Tbl OracleRef2_Tbl | / | / | / SeqFile_Stage------>LOOK_UP_STAGE---------->OracleEnt_Stage Which one would bet...
by vick
Thu Mar 08, 2007 3:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Reject file
Replies: 8
Views: 1742

Thanks. The null handling part is taken care of. I put an intermediate stage as Ray suggested and write out the reject records to a file. The first lookup is against a table and has 2 key fields (say col1 & col2) and it has 1300 reject records. The reject records are then loked up against the sa...
by vick
Thu Mar 08, 2007 1:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Reject file
Replies: 8
Views: 1742

Thanks a lot Ray. After I get the reject records (capturing in a SeqFile_stg) I need to do a lookup on a table (LkUp2) and use a funnel stage and apppend to the output SeqFile. OracleEnt_Stage | | OracleEnt-->Lookup_stage----------> Funnel---->SeqFile_Stage | | | | SeqFile_Rejects_Stage------->LkUp2...
by vick
Thu Mar 08, 2007 1:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Reject file
Replies: 8
Views: 1742

Thanks a lot Ray.

But the options are greyed out when I open the EDIT COLUMN METADATA.
by vick
Thu Mar 08, 2007 12:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Look Up Reject file
Replies: 8
Views: 1742

Look Up Reject file

Hello, I have 6500 records with 20 columns as my source. I m doing a lookup to capture rejects (in a sequential file). All the 20 columns in the source are nullable and I have set the Null-Handling properties (edit column meta data------>Nullable----->NullfieldValue = ' '). OracleEnt_Stage | | Oracl...
by vick
Wed Feb 28, 2007 3:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: InitCap in Transformer
Replies: 4
Views: 1974

InitCap in Transformer

Hello, I want to do an initcap on a particular column in transformer. I m doing it using CONVERT function for columns that has fixed values For instance in.Col has fixed values like 'web number' CONVERT ("wn", "WN", in.col) How do I go about for columns whose values are not fixed...
by vick
Tue Feb 27, 2007 4:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: External Function
Replies: 4
Views: 1355

Thanks DSguru2B. Script should be fine I guess.

Guys here feel its (C-routine) a lot of maintenance or they are "C-haters" :).

This is a typo. Sorry about that.
"5,439-cc" to "5438 cc

Thanks a lot for your inputs.
by vick
Tue Feb 27, 2007 2:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: External Function
Replies: 4
Views: 1355

External Function

Hello folks, I have been trying to get an issue resolved that has various data formats. 1. "3.5 L V6 24-Valve DOHC" ---------------------> 3.5 L 2. "3.8 Liter V-6 24-Valve DOHC" ---------------------> 3.8 L 3. "4.6 Liter V8 w/4 valve per CYL" -------------------> 4.6 L ...
by vick
Tue Feb 27, 2007 1:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle User-Defined Function
Replies: 14
Views: 5069

Hello folks, Is it possible to do the following using PL/SQL user-defined function. 1. "3.5 L V6 24-Valve DOHC" ---------------------> 3.5L 2. "3.8 Liter V-6 24-Valve DOHC" ---------------------> 3.8L 3. "4.6 Liter V8 w/4 valve per CYL" -------------------> 4.6L 4. &quo...
by vick
Tue Feb 27, 2007 11:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle User-Defined Function
Replies: 14
Views: 5069

Sorry folks my bad. I resolved the issue.

I want to kick myself for my previous post. I did'nt include XYZ_DESCRIPTION in my Select statement.

Again I apologise.
by vick
Tue Feb 27, 2007 11:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle User-Defined Function
Replies: 14
Views: 5069

Thanks DSguru2B. This what I m doing. Oracle_Ref_Tbl | | | Oracle_Source_Tbl------->LookupStage------->Tfr--------->Seq_File_Stage Oracle Ref Tbl has following SQL query and I do a sparse look-up SELECT GET_FUNCTION(XYZ_DESCRIPTION) FROM ABC In the source table ABC(same table as the one used in the ...
by vick
Tue Feb 27, 2007 9:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle User-Defined Function
Replies: 14
Views: 5069

Thanks Ray, DSguru2B! The function gets compiled with NO errors. I run the following query in TOAD and it runs just about fine. SELECT GET_FUNCTION(XYZ_DESCRIPTION) FROM TBL_NAME WHERE ROWNUM < 2 But if I use the DUAL table (as Ray suggested) it gives me an error saying XYZ_DESCRIPTION:Invalid ident...