Need Help to debug the DUMP_SCORE

[DSDexter]

Hi Gurus,

I have a job design like this (2 - Node System)

Code: Select all

Extersource------>XML I/P------>Transformer------->OracleTbl
                        |                              |
                        |                              |
                   Transformer                     Transformer
                        |                              |
                   SequentialFile                SequentialFile

The reject transformers are used to abort the job if I identify any reject.
The job is taking to much time to execute. I examined the score, And it shows that the job is running on a single node.

APT_DISABLE_COMBINATION : FALSE

main_program: Startup time, 0:11; production run time, 2:30.

main_program: This step has no datasets.
It has 1 operator:
op0[1p] {(sequential APT_CombinedOperatorController:
(APT_LicenseCountOp in APT_LicenseOperator)
(APT_LicenseCheckOp in APT_LicenseOperator)
) on nodes (
node1[op0,p0]
)}
It runs 1 process on 1 node.

APT_DISABLE_COMBINATION : TRUE

main_program: Startup time, 0:07; production run time, 2:48.

main_program: This step has 1 dataset:
ds0: {op0[1p] (parallel APT_LicenseCountOp in APT_LicenseOperator)
->eCollectAny
op1[1p] (sequential APT_LicenseCheckOp in APT_LicenseOperator)}
It has 2 operators:
op0[1p] {(parallel APT_LicenseCountOp in APT_LicenseOperator)
on nodes (
node1[op0,p0]
)}
op1[1p] {(sequential APT_LicenseCheckOp in APT_LicenseOperator)
on nodes (
node2[op1,p0]
)}
It runs 2 processes on 2 nodes.

Why is my job running in sequential mode and when i disable operator combination although it runs on two nodes it's taking much more time to execute. Gurus can you tell me what's going wrong?

[just4geeks]

Please provide :

1. Source data details (how many column, how many rows, how many bytes of source data in total)
2. Using job monitor, provide row/sec for each stage
3. What is your source ?

Thanks!

[ray.wurlod]

The scores you've posted are for license checking, not for job execution. With more operators, there is more license checking to do.

[DSDexter]

The scores you've posted are for license checking, not for job execution. With more operators, there is more license checking to do. ...

Thanks ray, I was looking at the unappropriate log line. Well the jobs dump seems fine now , Ray can I operate the XML input stage in parallel mode? Sequentially Its taking a lot of time to parse the records. Currently there are about 46k records only, And at prod runtime this will be in Lacs. When I tried to operate the XML input stage in Parallel, the job hanged.

[ArndW]

I'm having trouble visualizing how an XML input stage could work in parallel - but the designer object allows the execution mode to be specified as "parallel" so perhaps it does work Have you tried that setting?

[DSDexter]

The scores you've posted are for license checking, not for job execution. With more operators, there is more license checking to do. ...

Thanks ray, I was looking at the unappropriate log line. Well the jobs dump seems fine now , Ray can I operate the XML input stage in parallel mode? Sequentially Its taking a lot of time to parse the records. Currently there are about 46k records only, And at prod runtime this will be in Lacs. When I tried to operate the XML input stage in Parallel, the job hanged.

Sorry about unable to read your whole post, But just gussing what u have asked,The job basically was showing in running state forever . I had to kill it (I know its not good practice Ray, But had no other option)