DSXchange

Even if I just run the command dsjob, the last line is an error. dsjob Command Syntax: dsjob [-authfile <authfile> | -file <file> <domain> <DataStage server> | [-domain <domain> | -url <url>] -user <user> -password <password> -server <DataStage server>] | -domain <domain> [-user <user>] -server <Dat...

dear fri, in my old ds environment, when i run the command , it's able to list out the projects. now I upgrade to 11x, I don't know if anything is missing, I encounter error when I try to list the projects. and this is the error message below. I tried to search in the forum but nothing found . could...

thanks for ur long response. The job was failed with a message I could not understand, eventhough I get the explaination in the IBM website, I could not make it clear, that's why I send the post here. I suspect this is a server resource issue, but who knows. After the rerun the job resumed, I just w...

[info]a..JobControl (DSRunJob): Waiting for job index1 to start
[warn]Job control process (pid 28967492) has failed

After the log, nothing special but shows the sequence job is abort.

Yes recently the DS env encounter out of resource problem sometimes.

The error msg will have some words like "resource", however the error msg above is not easy to understand.

I simply rerun the job ,without change. Now it's processing job 1-9. no error.

I design a seq job, which only contains a routine. In the routine, firstly I trigger job A, B, C, D to run one by one.(use a for loop) And then I have a for loop from 1-9, to submit job index1...index9 to run parallelly. This is the log where it abort. [info]a..JobControl (DSRunJob): Waiting for job...

I met a warning msg "job control process (pid xxxx) has failed" and then the job abort. After search in the IBM, I found this. Problem(Abstract) Sequence job control process (pid xxxx) has failed Cause Sequence job run continuously in a loop, appends to the dsenv after each run, causing th...

very useful. Thanks all.

I don't want to run DSWaitForJob every time. the jobs could run at the same time.

I think the "abort after rows" in transfomer could help. you may try.

Hi all. In a routine, I use a for loop to trigger parallel jobs. I would like these jobs to run in parallel instead of in sequentially. But how can I detect the status of the jobs at the end of the routine? I need to make sure the parallel jobs completed successfully and then finish the routine proc...

Hi is there a function in the sequtialFile stage, to auto split file. e.g. I output records to the sequtial file. set the file's max record number is 1000000. then the stage will help me to output F1.txt, F2.txt, F3.txt,etc. every file contains 1000000 records. because the output file is about 30 mi...

The machine I am using, has 16 CPU ------ System configuration: lcpu=16 mem=27648MB ent=1.94 ------ In the DS apt file, I set 4 nodes. like below text. How could I make use of the 16 CPUs? Set 16 nodes? To make the job faster. { node "node1" { fastname "HKxxxxx" pools ""...

For easy reading I would like to add annotation to the parallel job. for example, I would like to help the reader to understand the usage of a transfomer, so I create an annotation panel cover the transformer stage. and input words in it. After I finish, I found the job looks bad, is there any good ...