Search found 221 matches
- Fri May 30, 2008 7:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multiple readers per node loading into ODBC
- Replies: 10
- Views: 14147
Hi Ray, Thanks for the reply. That helps in clearing up a few items. A few additional question regarding the nodes especially, in the GRID world. I am trying to understand how some of the PX GRID parameters boil down into code during execution and would greatly appreciate your feedback if i am not c...
- Fri May 30, 2008 1:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multiple readers per node loading into ODBC
- Replies: 10
- Views: 14147
Multiple readers per node loading into ODBC
Hi Group, My job design is as follows. This is in a 4 node GRID environment Seq_File ==> Transformer ==> ODBC || || \/ Rejected records The job was using a default one node config file and some of our larger files are loading for a longggg time. I am trying this with different values for the number ...
- Thu May 29, 2008 7:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs getting into a wait state for a long time...
- Replies: 6
- Views: 3998
Hi lstsaur, I have some good news from my first tests. Increasing the partitions per node to 4 helped a good number of jobs to complete faster. Here is the config file that i pulled from the director log for this execution. <Dynamic_gird.sh> SEQFILE Host(s): ctpcqabdsc02p: ctpcqabdsc02p: { node &quo...
- Wed May 28, 2008 9:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs getting into a wait state for a long time...
- Replies: 6
- Views: 3998
Thanks lstsaur. I will definitely try the increased partition value and post the results. Meantime, SGE is the resource manager tool in this shop. Let me know if there are additional steps to find the resource allocation steps. Right now, i can see which computing node got allocated for a particular...
- Wed May 28, 2008 12:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs getting into a wait state for a long time...
- Replies: 6
- Views: 3998
- Wed May 28, 2008 7:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: 'Chunk' XML Files before parsing
- Replies: 12
- Views: 6902
- Wed May 28, 2008 7:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs getting into a wait state for a long time...
- Replies: 6
- Views: 3998
Jobs getting into a wait state for a long time...
Hi Group, In our Linux GRID environment we are often running into a situation where jobs end up waiting for a longggg time to be allocated a node. The Head Node has 3 computing nodes at its service and all our jobs are using the default GRID configuration parameter values as follows $APT_GRID_ENABLE...
- Tue May 27, 2008 6:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: REJECT LINK IN XML INPUT STAGE
- Replies: 12
- Views: 11282
Could you provide a simple representation of your job design please? E.g.... External Source ==> XMLInput ==> Transformer ... Your original post says XML Input, but your message log has the stage name as XML_Output_78,0. Is it just a naming convention error or are you working with XML output stage i...
- Tue May 27, 2008 5:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: REJECT LINK IN XML INPUT STAGE
- Replies: 12
- Views: 11282
- Tue May 13, 2008 6:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Newline character getting loaded into DB Column
- Replies: 15
- Views: 7410
Thanks ArndW. I checked all the params and values and they look correct. I have submitted a ticket to IBM on this and also trying to do a back-end script in the database to fix the newline in a post job as we are running out of time. I will keep this thread open and keep trying options that might co...
- Mon May 12, 2008 9:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Newline character getting loaded into DB Column
- Replies: 15
- Views: 7410
The diff returns one line as a difference - for the header row. Strangely the header seems to have converted to a mixed case on the target and I have no idea how and why. The header is completely lower case in the source, whereas the target is mixed. E.g Source is as follows empid|~empname|~address1...
- Mon May 12, 2008 1:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unable to generate a node map
- Replies: 18
- Views: 16634
Thanks lstsaur. One additional question:- If the source file is on the head node, will the use of the variable $APT_GRID_SEQFILE_HOST interfere with the source file location if it did not get the head node as the Host name during the exeuction? Does the error message I received point to such a sympt...
- Mon May 12, 2008 1:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Newline character getting loaded into DB Column
- Replies: 15
- Views: 7410
- Mon May 12, 2008 1:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Newline character getting loaded into DB Column
- Replies: 15
- Views: 7410
- Mon May 12, 2008 12:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Executable file of a DS Job
- Replies: 26
- Views: 21826