Search found 55 matches

by aramachandra
Tue Jul 01, 2008 11:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Previous row value
Replies: 14
Views: 3567

The source file is a simple text file with one column

COLUMN1

Test1
Test2
Test3


Arvind
by aramachandra
Tue Jul 01, 2008 11:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Previous row value
Replies: 14
Views: 3567

Previous row value

Hi All I am using the 8.0 version and have the following logic in the transformer to get the previous row value checked to raise unique sequence numbers Mapping as viewed in transformer <B>Derivation -------------------------> stage variable</B> SOURCE COLUMN ------------------------------ > current...
by aramachandra
Wed May 21, 2008 5:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Triggering DS jobs to process outbound IDOCS from SAP
Replies: 1
Views: 1317

Triggering DS jobs to process outbound IDOCS from SAP

We have defined a simple job that is using the IDOC Extract stage to extract IDOC from SAP. We have followed the documentation to define the listerner on the server and the rfc port on the SAP side and can view the IDOC getting received by datastage as per the IDOC log in the DataStage Administrator...
by aramachandra
Mon Nov 05, 2007 2:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Double quotes in data
Replies: 5
Views: 3534

Thanks for your suggestions

Hi Thanks for your responses Actually in our situation since we have | as a delimiter and the fact that we can get pipe's in our data means, I cannot set the quotes to none The quotes attribute set to double allows us to have pipes in the data But it looks like i have to do some transformation of th...
by aramachandra
Mon Nov 05, 2007 12:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Double quotes in data
Replies: 5
Views: 3534

Double quotes in data

Hi All My sample file qtest.csv in unix has two lines ( though it is CSV it really is delimited by a |) "arvind"|"tes"ting" "newtest"|"testing" I am trying to read it via a sequential file stage in a PX job The record delimiter is set to be a Unix new lin...
by aramachandra
Fri Jul 20, 2007 7:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Compilation hangs forever
Replies: 8
Views: 2812

Actually it is a bit of both the compilation hangs in my opinion in that it runs for foreever Due to concurrent licensing issues we have a process that goes and kills sessions that are not active for over 2 hours So while i work i am looking at it on my other screen still saying it is compiling plea...
by aramachandra
Thu Jul 19, 2007 10:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Compilation hangs forever
Replies: 8
Views: 2812

Compilation hangs forever

Hi I have simple job which does the following 1) reads from the dataset 2) does remove duplicates to retain unique headers 3) does a lookup to pull in all the details for the headers 4) transforms each looked up column with if IsNull(Link.Col) then '' else Link.Col 5) Writes to an ouptut dataset WE ...
by aramachandra
Wed Dec 13, 2006 10:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job Statistics
Replies: 8
Views: 4742

ETL stats

Thanks for all your responses

I will try out these suggestions and report back on how it went

Ray.. currently our scheduling tool is ActiveBatch but there is an effort to find a another scheduling tool.

Will report back in the morning


thanks
arvind
by aramachandra
Wed Dec 13, 2006 6:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job Statistics
Replies: 8
Views: 4742

ETL Job Statistics

Dear all +++++++++++++++++++++++++++ Main objective : To capture metrices or stats for all the jobs running on production and or test. +++++++++++++++++++++++++++ The last two weeks or so i have been working the Kim's ETLSTATS program. Kim has been very kind with his time in responding to my emails ...
by aramachandra
Thu Feb 23, 2006 1:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallelism in oracle
Replies: 6
Views: 1971

Hi According to the orachestrate manual "By default the oraread operator runs sequentially. However, you can direct it to read from multiple partitions and run on all processing nodes in the default node" Typically most reads from oracle are sequential. I tested out a simple job which take...
by aramachandra
Tue Feb 21, 2006 11:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: staging
Replies: 10
Views: 3639

Just another debugging tip, try hanging a reject link off your oracle enterprice stage and set the reject flag to true inthe stage. This captures any rows that were rejected by the database for some reason. The best way is to see truely what your source query returns, ensure there are no constraints...
by aramachandra
Fri Feb 17, 2006 1:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in Surrogate key stage
Replies: 5
Views: 2311

I was going to say the same as the previous poster..

It looks like you might want to review your metadata to ensure there is not mismatch there...

I have not seen this in the surrogate key generator error..

arvind
by aramachandra
Thu Feb 16, 2006 12:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Doubt in Surrogate key
Replies: 5
Views: 1657

Surrogate key generator is not persistant in px jobs. It expects you to remember your last generated number. YOu could write last sequence into a seqencial file , so in your case you will write 70 to a sequential file. On the next run you will read it from the sequential file and pass it as a pareme...
by aramachandra
Thu Feb 16, 2006 11:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to trap NULL record
Replies: 4
Views: 1879

Have you tried to handle the null value by setting the null field value with empty quotes in the extended properties of the column where you have null in the source files.

arvind
by aramachandra
Mon Feb 13, 2006 4:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Set File
Replies: 8
Views: 2455

I would think, that
With your nullable=yes for one and nullable=no for the other, if the column names are same going through funnel stage you would still get an error at run time if the compile goes through.

Arvind