Search found 30 matches

by sgubba
Fri May 29, 2009 10:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Stage Speed
Replies: 20
Views: 6392

Actually all are inserts because i need to capture rejects. I am using upsert, As reject option is not available in Write

Shyam
by sgubba
Fri May 29, 2009 9:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Stage Speed
Replies: 20
Views: 6392

Yep, I need to capture rejects so i am using upsert. The target is ORACLE 11g Since we dont have drivers we are using ODBC

Shyam
by sgubba
Fri May 29, 2009 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Stage Speed
Replies: 20
Views: 6392

ODBC Stage Speed

I am tryin to load data using ODBC stage. I am wusing Upsert mode and what i realise is its extremely slow some times close to 37 rows per second is there any way i can improve the speed

Thanks

Shyam
by sgubba
Fri Feb 13, 2009 7:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashing Issue
Replies: 6
Views: 2168

Mike wrote:Join requires sorted inputs. You haven't mentioned whether you are sorting... hash partition by key and sort.

Mike
Nope i am not sorting them ....i didnt do it coz i thought it would add an over head ....Is it a hard and fast rule that we need to hash and sort before join

Thanks
by sgubba
Fri Feb 13, 2009 4:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashing Issue
Replies: 6
Views: 2168

Hi, You have to clear the previous partitioning before giving it to a new partition. In the second join which is on key2, you should clear the previous partiton which is out of key1. Also the next consecutive joins is also based on key2 alone, if so then use same partition else clear in 3rd join an...
by sgubba
Fri Feb 13, 2009 10:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashing Issue
Replies: 6
Views: 2168

Hashing Issue

Hi Everybody I am having a wired Issue. In my job I am using close to 5 joins basically i have a driver tables and i am joining to another table on key1 before joining i am hashing on key 1 on both the links .now from the joined table i get key2 using this key2 i join to another table based on key2....
by sgubba
Mon Oct 13, 2008 2:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Migration Issue
Replies: 8
Views: 2181

First of all thank you all ...u guyz for ur time Let me Explain lil bit more this is the transformer constraint TrimLeadingTrailing(DSLink47.COUNTRY2)='USA' AND (TrimLeadingTrailing(DSLink47.GRADE)='1A' OR TrimLeadingTrailing(DSLink47.GRADE)='1B' OR TrimLeadingTrailing(DSLink47.GRADE)='1C' OR TrimLe...
by sgubba
Mon Oct 13, 2008 6:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Migration Issue
Replies: 8
Views: 2181

ArndW, I am little confused....if i had and configuration issues how will it affect the logic .....all i am doing is reading from sequential file and performing transformations and writing to a file ....i Had no issues running it in dev and preprod ......but its screwed up in prod.....i thought conf...
by sgubba
Sun Oct 12, 2008 10:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Migration Issue
Replies: 8
Views: 2181

Migration Issue

I have designed a parallel job .. It reads from a file does transformations and writes to a file ..... i ran it in pre-prod works fine ........when i move it into prod it runs but gives a different output .....i think its a data issue ....checked for control characters ...but no success ...there is ...
by sgubba
Wed Oct 01, 2008 12:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we specify partitions for SMP
Replies: 2
Views: 894

Got it

For non-grid environment, your partitioning paralellism is based on the processing nodes defined in your configurations file. Unlike grid, you can use grid_partition parameter. For example, you have defined 4 processing nodes in your configurations file and you have 100 records to process, then eac...
by sgubba
Tue Sep 30, 2008 5:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we specify partitions for SMP
Replies: 2
Views: 894

How can we specify partitions for SMP

Hi, I used to work on grid environment. There we used to mention number of nodes and partitions where as right now i am on smp, when defining config file i dont find any thing where i can specify the partitions ......I am little surprised now ....... when we do partitioning in our data stage jobs ho...
by sgubba
Wed Jun 11, 2008 7:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Fixed length record file
Replies: 9
Views: 6890

Re: Reading Fixed length record file

Yeah i am able to do it now...Assume In a fixed file lenght format column NAME is at position from 1-10 for one source data file ....and the same column "NAME" is at position 200-210 for another source data file ....i should be able to read any kind of source data file by just changing the...
by sgubba
Mon Jun 09, 2008 3:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Fixed length record file
Replies: 9
Views: 6890

How to read fixed width from a schema file

I want to know if we can read a fixed widht file using the schema file ..........my problem is i get data from different locations and the schema for each of them is different.......i want to read data from any source just by changing the schema file ....i could do that for a comma delimited file .....