Thanks for the your input.
I agree it'd nice to find out what caused the error. Our Project which had this error was also using Parameter set but that we never deleted, and reimported.
To this day what resolved our issue is a mystery.
Search found 78 matches
- Mon Mar 25, 2013 3:10 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
- Sun Mar 24, 2013 10:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
- Sun Mar 24, 2013 9:39 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
- Sun Mar 24, 2013 6:02 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
IBM suggested to use Partition with min and max values, which only hit around 6K rows with 4 nodes and did not reach the legacy DS version throughput 10,000 rows/sec. Previously, I had hit 7500 rows/sec with partition Modulus option, and later on with 8 nodes, I hit around 13k rows/sec. Recently IBM...
- Sun Mar 24, 2013 5:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
I tested one node configuration writing to multiple file system (for Lookup fileset/Dataset only) since sequential file was created in a separate folder and do not use configuration file. Data was spread out across all four file systems (/isdataset0/1/2/3) in 32k size. It seemed DataStage was writin...
- Wed Feb 13, 2013 3:19 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
- Wed Feb 13, 2013 11:40 am
- Forum: General
- Topic: cannot compile
- Replies: 12
- Views: 6587
Updates: apparently, dont know what resolved the issue but its resolved. We removed the connection information, recreated all the connections, imported metadata in IA, and boom its working. IBM doesnt know the answer what was the reason this issue occurred. Thought I should post this in case someone...
- Wed Feb 13, 2013 11:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Configuration file with multiple scratch/dataset
- Replies: 11
- Views: 5608
Configuration file with multiple scratch/dataset
Question on configuration file. In first example, one node has one dataset and scratch space available but in second example, it has 4 dataset, and 4 scratch spaces. What determines that data is partitioned? I thought it was number of nodes, and having more dataset or scratch means redundancy. Based...
- Fri Jan 25, 2013 9:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
I see two entries in .odbc.ini file. one is [DB2 Wire Protocol] and the other one created by Admin called [CDXA]. Is first one IBM template ? I am providing both in case first is relevant. Here is the info: uvodbc.config: ------------------ [ODBC DATA SOURCES] <localuv> DBMSTYPE = UNIVERSE network =...
- Thu Jan 24, 2013 11:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
I asked and it seems like connection to the boxes are same. I could not verify on my own. Tested query on command line (from same unix box to DB2 without using Datastge) and respones time for ~35mil records were about 53 min. So I am guessing connetion/network is correct, and I can match this with 8...
- Wed Jan 23, 2013 7:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
Thank you Aartlett for taking time to discuss potential issues about bottleneck and putting that in words. We noticed job that was migrated to 8.7 from 8.0 was taking 6 hrs as oppose to 2 hr extracting ~35 Mil records. After trying few points from my first note I posted question here on the forum. W...
- Wed Jan 23, 2013 2:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
- Wed Jan 23, 2013 10:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
Hi Ray, Correction to #7 [odbc.ini file has same entries, and pointing to exact same object.] Driver is different; DS 8.0 had VMdb222.so and DS 8.7 has /VMdb225.so I searched DSX and found this link that talks about slowness in read/write but since guy posted quesiton was using ODBC connector I did ...
- Tue Jan 22, 2013 2:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 10089
slower ODBC Enterprise stage
There is an issue with one job that is reading from DB2 table. Job is very simple, and there is no fancy transformation just straight mapping but DS 8.0 is reading at 10 times faster than DS 8.7. 30 mill records in DS 8.0 are 11,000 rows/sec where as DS 8.7 doesnt go above 1600 rows/sec. Just so you...