Search found 30 matches
- Fri May 29, 2009 10:22 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Stage Speed
- Replies: 20
- Views: 6392
- Fri May 29, 2009 10:07 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Stage Speed
- Replies: 20
- Views: 6392
- Fri May 29, 2009 9:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Stage Speed
- Replies: 20
- Views: 6392
- Fri May 29, 2009 9:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Stage Speed
- Replies: 20
- Views: 6392
ODBC Stage Speed
I am tryin to load data using ODBC stage. I am wusing Upsert mode and what i realise is its extremely slow some times close to 37 rows per second is there any way i can improve the speed
Thanks
Shyam
Thanks
Shyam
- Fri Feb 13, 2009 7:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hashing Issue
- Replies: 6
- Views: 2168
- Fri Feb 13, 2009 4:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hashing Issue
- Replies: 6
- Views: 2168
Hi, You have to clear the previous partitioning before giving it to a new partition. In the second join which is on key2, you should clear the previous partiton which is out of key1. Also the next consecutive joins is also based on key2 alone, if so then use same partition else clear in 3rd join an...
- Fri Feb 13, 2009 10:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hashing Issue
- Replies: 6
- Views: 2168
Hashing Issue
Hi Everybody I am having a wired Issue. In my job I am using close to 5 joins basically i have a driver tables and i am joining to another table on key1 before joining i am hashing on key 1 on both the links .now from the joined table i get key2 using this key2 i join to another table based on key2....
- Mon Oct 13, 2008 2:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Migration Issue
- Replies: 8
- Views: 2181
First of all thank you all ...u guyz for ur time Let me Explain lil bit more this is the transformer constraint TrimLeadingTrailing(DSLink47.COUNTRY2)='USA' AND (TrimLeadingTrailing(DSLink47.GRADE)='1A' OR TrimLeadingTrailing(DSLink47.GRADE)='1B' OR TrimLeadingTrailing(DSLink47.GRADE)='1C' OR TrimLe...
- Mon Oct 13, 2008 6:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Migration Issue
- Replies: 8
- Views: 2181
ArndW, I am little confused....if i had and configuration issues how will it affect the logic .....all i am doing is reading from sequential file and performing transformations and writing to a file ....i Had no issues running it in dev and preprod ......but its screwed up in prod.....i thought conf...
- Mon Oct 13, 2008 5:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Migration Issue
- Replies: 8
- Views: 2181
- Sun Oct 12, 2008 10:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Migration Issue
- Replies: 8
- Views: 2181
Migration Issue
I have designed a parallel job .. It reads from a file does transformations and writes to a file ..... i ran it in pre-prod works fine ........when i move it into prod it runs but gives a different output .....i think its a data issue ....checked for control characters ...but no success ...there is ...
- Wed Oct 01, 2008 12:24 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How can we specify partitions for SMP
- Replies: 2
- Views: 894
Got it
For non-grid environment, your partitioning paralellism is based on the processing nodes defined in your configurations file. Unlike grid, you can use grid_partition parameter. For example, you have defined 4 processing nodes in your configurations file and you have 100 records to process, then eac...
- Tue Sep 30, 2008 5:21 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How can we specify partitions for SMP
- Replies: 2
- Views: 894
How can we specify partitions for SMP
Hi, I used to work on grid environment. There we used to mention number of nodes and partitions where as right now i am on smp, when defining config file i dont find any thing where i can specify the partitions ......I am little surprised now ....... when we do partitioning in our data stage jobs ho...
- Wed Jun 11, 2008 7:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading Fixed length record file
- Replies: 9
- Views: 6890
Re: Reading Fixed length record file
Yeah i am able to do it now...Assume In a fixed file lenght format column NAME is at position from 1-10 for one source data file ....and the same column "NAME" is at position 200-210 for another source data file ....i should be able to read any kind of source data file by just changing the...
- Mon Jun 09, 2008 3:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading Fixed length record file
- Replies: 9
- Views: 6890
How to read fixed width from a schema file
I want to know if we can read a fixed widht file using the schema file ..........my problem is i get data from different locations and the schema for each of them is different.......i want to read data from any source just by changing the schema file ....i could do that for a comma delimited file .....