Search found 500 matches

by ag_ram
Wed Jul 04, 2007 2:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Best way to start developing using parallel jobs
Replies: 11
Views: 2763

No need to avoid the transformer stage as its performance has been greatly increased in 7.x versions. No doubt, modify stage still leads the two, but transformer is faster than filter stage and a few other stages. IBM released this information sometime back. Hi DSGuru Can you share the link where I...
by ag_ram
Fri Jun 29, 2007 7:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sparse lookup in TeraData Enterprise
Replies: 6
Views: 2044

Sparse lookup in TeraData Enterprise

Hi Folks

Is it possible to have Sparse lookup on TeraData Enterprise stage ?
Is there a Workaround :?:
by ag_ram
Wed Jun 27, 2007 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: implement a scenario in DS
Replies: 1
Views: 820

implement a scenario in DS

Hey Folks Ran into an implementation that has requirement as follows 2 DataSets to be looked up against each other 2 Conditions a) Reference link is empty Pass all records from Stream link (no look-up) b) Reference is not empty Match records and pass the matched rows How it is implemnted now is usin...
by ag_ram
Sat Jun 23, 2007 11:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading and Deleting in a Single Unit of Work
Replies: 7
Views: 1688

Hi

The OPEN/CLOSE is indeed available , and we used the same in solving the problem. It is available with Load/Append mode in Oracle Enterprise , but is not available for use with UPSERT mode.

Sorry for the confusion !
by ag_ram
Sat Jun 23, 2007 4:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading and Deleting in a Single Unit of Work
Replies: 7
Views: 1688

Re: Loading and Deleting in a Single Unit of Work

Hi Folks Is it possible to load data into an oracle table and delete some records based on a certain condition on the same table , and maintain these as a single Unit of work ? You can create userdefined SQL and place inside the After tab page. This will work. There is no before and After Tab in a ...
by ag_ram
Wed Jun 20, 2007 6:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading and Deleting in a Single Unit of Work
Replies: 7
Views: 1688

Hi

When Oracle Enterprise is used as a Target Stage we dont have that option of open/close command..Correct me if iam wrong
by ag_ram
Tue Jun 19, 2007 8:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading and Deleting in a Single Unit of Work
Replies: 7
Views: 1688

Loading and Deleting in a Single Unit of Work

Hi Folks

Is it possible to load data into an oracle table and delete some records based on a certain condition on the same table , and maintain these as a single Unit of work ?
by ag_ram
Sun May 27, 2007 8:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is Sort stage before Remove-Duplicate stage mandatory?
Replies: 9
Views: 7389

hi

The sorting before the remove duplicates is necessary. In your case it is working because the auto partitioning is taking care of the sorting. it is doing an inline sort on the keys based on which it is doing the remove duplicates.

Thanks,
Ram.
by ag_ram
Sat May 19, 2007 4:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Sort and RemoveDuplicates
Replies: 3
Views: 1602

Parallel Sort and RemoveDuplicates

Hello Folks The following are the stages in a Job DataSet--------->Sort ---------->RemoveDuplicates------------>DataSet There are 6 keys and 1 value column , I need the lease value column among these 6 keys and unique keys , so the input to the Sort is a HashPartition on the 6 keys and 1 value colum...
by ag_ram
Thu May 17, 2007 2:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Query on Sort / Remove Duplicates
Replies: 4
Views: 1681

Query on Sort / Remove Duplicates

Hello All I have a parallel job , the input with a set of 5 Keys and 2 value columns. There is a Parallel Sort Stage and a Remove Duplicate follows. The query is i sort the data on all 5 keys and then on value columns , and i remove duplicates on the first 3 Keys . The expected behavior is to get &q...
by ag_ram
Sun May 13, 2007 8:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using File-pattern and Column names
Replies: 2
Views: 914

It is easy !

sed -e '1d' filepattern* > file.csv
by ag_ram
Sun May 13, 2007 7:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using File-pattern and Column names
Replies: 2
Views: 914

Using File-pattern and Column names

Hi Folks I use file pattern to read a set of .csv files. In each of these files , the first name is column names. I have set the "First row is column names" to true , It works when there is one file with that pattern name and fails when there are many files matching that pattern. Any ways ...
by ag_ram
Wed May 02, 2007 8:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating Next val from table lookup
Replies: 2
Views: 1025

Generating Next val from table lookup

Hello Folks Here is a brief background of the the problem that we have . We have 2 links , an dataset input link that contain some key values and a database that stores a sequence number . The requirement is get the sequence for the first record in the dataset , and for each subsequent row from the ...
by ag_ram
Wed Apr 25, 2007 10:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Comparing 2 dates in a Filter stage
Replies: 5
Views: 2300

Folks thanks for your comments first ! But seems that there is something missing altogether , i tried to parameterise the date passed from a shell script and compare Something like ROWDATEFIELD > #shellScriptDate# This is not working at all ! The where clause does not get a boolean parameter to eval...
by ag_ram
Tue Apr 24, 2007 9:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Comparing 2 dates in a Filter stage
Replies: 5
Views: 2300

Comparing 2 dates in a Filter stage

Hi Folks I'm passing date in a a preset format to a filter stage from a unix script, this is a constant for a particular day . I am comparing this date with data coming into a Filter . The comparison seems to yield some results that are not consistent . Do i have to use a transformer to compare the ...