Page 1 of 1

compilation taking long time

Posted: Mon Mar 24, 2008 8:45 am
by IBMDS
Hello,

i am extracting data from sequential file(comma delimiter), it contains 120 columns. I am checking the (if Len(trim(column1)) = 0 then setnull() else trim(column1)) for all the 120 columns. The compilation is taking almost 20 minutes sucessfully. why its taking long time?, is there any possibility of cut the compilation time.


Thanks
IBMDS

Posted: Mon Mar 24, 2008 8:56 am
by kcbland
Describe your job design. Also, compilation is a server activity, if your DS instance is on a node that is heavily utilized that will affect client side response.

Posted: Mon Mar 24, 2008 9:05 am
by IBMDS
There are no process running on server. we have two nodes.

I verified with ps -ef | grep osh command.

Here is the design:

Sequential file -----> Transformer -------> Teradata(table)

in transformer checking for the len(trim(column1) = 0 then setnull() Else trim(column1)

Thanks
IBMDS

Posted: Mon Mar 24, 2008 9:23 am
by ArndW
Transform stages can take a long time to compile. This time can also depend upon how many concurrent users your c++ is licensed for.

Posted: Mon Mar 24, 2008 9:44 am
by IBMDS
This time its compiled very fast less than 1 minute. Thanks you all for the help.

Thanks

Posted: Mon Mar 24, 2008 3:38 pm
by ray.wurlod
When a job is re-compiled and no changes have been made to a Transformer stage that has previously been compiled successfully, the Transformer stage is not re-compiled. This may be what you are seeing. There is a Force Compile option in the menu if you want to force re-compilation of the Transformer stage.