compilation taking long time

IBMDS · Post by **IBMDS** » Mon Mar 24, 2008 8:45 am

Hello,

i am extracting data from sequential file(comma delimiter), it contains 120 columns. I am checking the (if Len(trim(column1)) = 0 then setnull() else trim(column1)) for all the 120 columns. The compilation is taking almost 20 minutes sucessfully. why its taking long time?, is there any possibility of cut the compilation time.

Thanks
IBMDS

kcbland · Post by **kcbland** » Mon Mar 24, 2008 8:56 am

Describe your job design. Also, compilation is a server activity, if your DS instance is on a node that is heavily utilized that will affect client side response.

IBMDS · Post by **IBMDS** » Mon Mar 24, 2008 9:05 am

There are no process running on server. we have two nodes.

I verified with ps -ef | grep osh command.

Here is the design:

Sequential file -----> Transformer -------> Teradata(table)

in transformer checking for the len(trim(column1) = 0 then setnull() Else trim(column1)

Thanks
IBMDS

ArndW · Post by **ArndW** » Mon Mar 24, 2008 9:23 am

Transform stages can take a long time to compile. This time can also depend upon how many concurrent users your c++ is licensed for.

IBMDS · Post by **IBMDS** » Mon Mar 24, 2008 9:44 am

This time its compiled very fast less than 1 minute. Thanks you all for the help.

Thanks

ray.wurlod · Post by **ray.wurlod** » Mon Mar 24, 2008 3:38 pm

When a job is re-compiled and no changes have been made to a Transformer stage that has previously been compiled successfully, the Transformer stage is not re-compiled. This may be what you are seeing. There is a Force Compile option in the menu if you want to force re-compilation of the Transformer stage.