Search found 8 matches

by nvdlrao
Fri Jul 30, 2010 8:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading data into Oracle DB is slow
Replies: 6
Views: 4465

The correct and best solution would be loading the data into some temporary stage tables first. Then using ODBC/Oracle stage run a PL/SQL procedure which dumps the data from stage tables to Actual tables. This would be pretty fast. I have worked with 60 millions records using the same concept but wi...
by nvdlrao
Thu Jul 29, 2010 12:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum Record Limit For lookup stage
Replies: 11
Views: 10754

Actually, no - it wasn't a mistake. It was designed to provide the same exact functionality as SQL joins - none of which support a "reject" capability. And at this point there is no such thing as 8.2, my understanding is that the next major release (currently in beta) may be called 8.5 wh...
by nvdlrao
Thu Jul 29, 2010 12:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: any information on Pre partitions techniques in datastage
Replies: 3
Views: 2319

There are two partition techniques in DataStage. 1) Pipeline Partition 2)Data Partition. There's another level of partition called Component Partition, which is not been supported by DataStage where as its supported in Ab Initio(in addition to the above 2 partition techniques). Pipeline and Data Par...
by nvdlrao
Thu Jul 29, 2010 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum Record Limit For lookup stage
Replies: 11
Views: 10754

I disagree. What does a "reject" mean in the context of a join? When I join tables using SQL there are no rejects! ... The "reject" link in JOIN Stage means, the records which don't have the common key will go to reject link. Its the mistake of IBM Software Labs' Tester, for joi...
by nvdlrao
Thu Jul 29, 2010 7:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to remove duplicates in transformer stage..?
Replies: 6
Views: 6070

You could remove duplicates using transformer stage 1) with the help of stage variables 2) by doing unique/stable sort.
by nvdlrao
Thu Jul 29, 2010 12:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum Record Limit For lookup stage
Replies: 11
Views: 10754

Sreenivasulu wrote:Instead of join stage you can use Merge stage. It has reject links.

Regards
Sreeni
The Join Stage in DataStage will have the reject link from 8.2 on wards. Its the IBM Software Labs Tester mistake for Join Stage not having the reject link.
by nvdlrao
Wed Jul 28, 2010 12:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: did not consume entire input, at offset: 159
Replies: 5
Views: 3419

Its my bad, I mean unicode not unique.
by nvdlrao
Tue Jul 27, 2010 8:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: did not consume entire input, at offset: 159
Replies: 5
Views: 3419

Change the Data type to NVARCHAR followed by Unicode. It will work.

[* Above line corrected from unique to Unicode - Andy *]