thanks for the reply but it really does not address my question at all.
I'm not attempting to run sequencer.sh but rather an in house developed shell script. The priimary goal is to get the script to run on a compute node rather than the head node.
Search found 195 matches
- Fri Mar 08, 2013 8:12 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to submit a shell script on a grid?
- Replies: 10
- Views: 7756
- Fri Mar 08, 2013 1:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to submit a shell script on a grid?
- Replies: 10
- Views: 7756
How to submit a shell script on a grid?
When running on a grid, what is the best way to execute a shell script to ensure that it will run on an available compute node rather than the head/conductor node? I tried using the exec_command activity in a sequencer, but that executes the script on the head node and never even calls the load leve...
- Wed Jan 02, 2013 3:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP
- Replies: 3
- Views: 2404
- Wed Dec 26, 2012 9:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can't read Variable Block Mainframe file
- Replies: 7
- Views: 6058
Unfortunately I've not used the CFF stage much either, but like Craig have quite a bit of experience with mainframe and variable lenght files. My only contribution to the conversation at this point is to say that the 4 bytes at the beginning of the variable length record are not always apparent when...
- Wed Dec 19, 2012 2:41 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Stop jobs on a grid
- Replies: 5
- Views: 3815
Ray, Thanks for the reply. I agree the stop button in Director should normally work; but in those rare cases like sometimes happens in small retail companies like you work in, I'm sure there are times when what normally or should work... simply doesn't work. In one of those cases, what steps should ...
- Wed Dec 19, 2012 2:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Which partition type I need to use in the JOIN stage
- Replies: 7
- Views: 6090
Personally, I prefer the method you are taking instead of using the auto partitioning that has been previously recommended. Yes, Auto normally works, but I like to be as explicit as possible. It ensures that the developer has considered sorting and partitioning thoroughly. As to why your job suddenl...
- Wed Dec 19, 2012 2:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Stop jobs on a grid
- Replies: 5
- Views: 3815
How to Stop jobs on a grid
Are there any special considerations when sttempting to stop jobs on a grid? I've seen several posts on here regarding how to stop and how not to stop DataStage jobs. And, I know kill-9 falls in the center of how NOT to stop a job. What I have not seen is anything that mentions if there are special ...
- Tue Dec 11, 2012 11:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to kill a Grid job
- Replies: 2
- Views: 1969
How to kill a Grid job
Are there any special considerations when killing a job that is runnning on a grid?
What is the proper sequence of steps to use to kill a job running on a grid that seems to be hung? (i.e. does not respond to a stop request from Director)
What is the proper sequence of steps to use to kill a job running on a grid that seems to be hung? (i.e. does not respond to a stop request from Director)
- Tue Oct 09, 2012 2:48 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: datastage warning
- Replies: 4
- Views: 2420
- Tue Oct 09, 2012 2:30 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Connector Invalid password
- Replies: 3
- Views: 2651
- Thu Feb 23, 2012 5:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: field from input dataset '-1' is NULL. Record dropped
- Replies: 0
- Views: 1139
field from input dataset '-1' is NULL. Record dropped
I've just received the following error in a Trasnsform stage: Xfm,5: Field 'HOURS_FLAG' from input dataset '-1' is NULL. Record dropped. The problem was resolved with a simple restart of the job, but, I don't recall seeing "dataset '-1'" before. What would the '-1' represent The job is a s...
- Mon Feb 13, 2012 10:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What happens in Pre-compilation?
- Replies: 11
- Views: 4930
I did not try the local fix as suggested yet, however, I am at the client site today and connected directly to their network as opposed to via VPN and the jobs are now precompiling and compiling within seconds as one would typically expect. Not sure that helps to answer my question or solve anything...
- Wed Feb 08, 2012 5:15 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What happens in Pre-compilation?
- Replies: 11
- Views: 4930
Bob, Do you have XML stages (with plenty of columns defined) in those jobs? Nope, no XML I also tried a force compile earlier today and though I did not time it the precomp still took a long time. And, I looked at the tech note referenced earlier. It seems that one was related to the actual compile...
- Fri Feb 03, 2012 12:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: blob,clob data types
- Replies: 5
- Views: 6629
- Fri Feb 03, 2012 8:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What happens in Pre-compilation?
- Replies: 11
- Views: 4930
What happens in Pre-compilation?
I am sure this is a loaded question, but, generally speaking, what occurs during the pre-compilation of a parallel job? The reason I ask is that most of our jobs go through precompilation in just a few seconds. However, I have seen several jobs that consistently take several minutes for precomp and ...