Search found 126 matches

by vskr72
Thu Jan 12, 2012 9:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector Usage
Replies: 2
Views: 1206

Oracle connector Usage

We have certain jobs that use Oracle connector. I just want to understand if the it can handle the following: - Table being loaded ran out of extents or the tablespace ran out of room? - Network disconnect, database outage, or other issue that prevents data from being loaded? The question is whether...
by vskr72
Thu Jan 12, 2012 12:49 am
Forum: General
Topic: Lookup output AS as parameter
Replies: 3
Views: 1423

Lookup output AS as parameter

I have a lookup table which has a structure like this: Ref_File Master_File ---------- ------------- a.txt Ref_a.txt b.txt Ref_b.txt c.txt Ref_c.txt hen I lookup onthe table a.txt, the output is Ref_a.txt. I want to use this value as a parameter and pass it to a seq file stage which will fetch the d...
by vskr72
Tue Jan 10, 2012 11:07 pm
Forum: General
Topic: DS job load validation
Replies: 7
Views: 2585

If at any point the validation fails, then we just get notified by email. We will take it up to the source people
by vskr72
Mon Jan 09, 2012 10:54 am
Forum: General
Topic: DS job load validation
Replies: 7
Views: 2585

DS job load validation

We have a lot of jobs that load data from flat file to an oracle table. Each src file also has a control file that contain a count of the records. After the data is loaded to the table, I need to validate if the control file count and records that are loaded is same. I know this is a pretty common s...
by vskr72
Sun Jan 08, 2012 10:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Integer Validation issue
Replies: 4
Views: 1822

Integer Validation issue

I have a column (loast column) coming from a flat file (fixed width). I am doing an integer validation for it using the below statement: If IsValid("int32", Col) then 'Valid' else 'invalid' The values in the source file are between 0 to 5. I was expecting the output to be 'Valid'. But surp...
by vskr72
Sat Jan 07, 2012 8:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling spaces
Replies: 7
Views: 1887

Awesome. Thank you Ray/Eric. This saves a lot of time.
by vskr72
Sat Jan 07, 2012 11:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling spaces
Replies: 7
Views: 1887

Handling spaces

There are lot of source files which are fixed width and I am using 'CHAR' to read them and it works well. It also turns out that I get spaces in certain columns because of this. There are more than 80 files and each file has 200+ columns. Is there any way to handle these other than using a Trim in t...
by vskr72
Fri Dec 30, 2011 12:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Decimal Validation
Replies: 5
Views: 1601

All the values are set to 0.000.
by vskr72
Fri Dec 30, 2011 11:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Decimal Validation
Replies: 5
Views: 1601

Decimal Validation

I have a oracle target table column with data type as Decimal and its precision is 12,3. SO, it can accomodate 3 digits after the decimal. I have an input coming from a flat file with the following values : 100 200.1 300.123 10A IsValid("decimal[12,3]", SrcCol) then SrcCol else SetNull() I...
by vskr72
Fri Dec 23, 2011 1:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help in building a simple parallel routine
Replies: 3
Views: 1302

Help in building a simple parallel routine

I need to build a simple routine to handle a logic like this. I went thru the option of creating a enw parallel routine. But, I am lost as to where I need to put this logic. There doesnt seem to be a place to add this code. If IsValid('date', ToTfm.AS_OF_DATE,"%yyyy%mm%dd") then StringTODa...
by vskr72
Wed Dec 21, 2011 11:53 pm
Forum: General
Topic: Attach YYYYMMDD to file name
Replies: 3
Views: 1589

Thank you. I will pass the date as a parameter and handle this.
by vskr72
Wed Dec 21, 2011 11:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date and Number validations
Replies: 6
Views: 3057

Thank you for all your inputs. So, I guess I will have to manage this cumbersome process. I will at least try to develop a routine to reduce the lengthy if-then-else statements
by vskr72
Wed Dec 21, 2011 8:30 pm
Forum: General
Topic: Attach YYYYMMDD to file name
Replies: 3
Views: 1589

Attach YYYYMMDD to file name

I am creatting a file that is captuting BAD records on a daily basis. I need to name is as FileName_YYMMDD. I cannot use the After_Job routine because that is used for creating the Log file usign the DSJobReport. I used the built in marco like this FileName_#DSJobStartDate#. But thatis creationg it ...
by vskr72
Wed Dec 21, 2011 8:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date and Number validations
Replies: 6
Views: 3057

But, I still need to call thsi routine in the derivtion in the Tfm stage right? Hope I am not missign anything here.
by vskr72
Wed Dec 21, 2011 5:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date and Number validations
Replies: 6
Views: 3057

Date and Number validations

I have a job that loads data from a SEQ file to Ora table. While loading I need to check the following conditions for Date and Number columns: 1. If its a valid date, then insert the value else set it to NULL 2. If its a valid number, then insert the value else set it to NULL. Implementing them is n...