TrimLeadingTrailing() function usage in Transformer

satish_valavala · Post by **satish_valavala** » Mon Jul 07, 2008 1:53 pm

We have job, in which we are using TrimLeadingTrailing() function twice in the derivation for about 200 fields.
Is there any limitation on usage of TrimLeadingTrailing() function in Parallel job Transformer stage.

ray.wurlod · Post by **ray.wurlod** » Mon Jul 07, 2008 3:13 pm

There shouldn't be. Why might you believe that there is?

satish_valavala · Post by **satish_valavala** » Wed Jul 09, 2008 9:17 am

Job can able to compile upto certain number of columns with TrimLeadingTrailing function, after that its throwing the following warning.

1500-008: (S) COMPILER LIMIT EXCEEDED in APT_TransformOperatorImplV0S2_xyz_stage_xyzload_X_del_inst_upd::processInputRecord(int): Program too complicated to be compiled. Compilation ended. Reduce the complexity of the program and recompile, or lower the level of optimization and recompile.

ArndW · Post by **ArndW** » Wed Jul 09, 2008 10:15 am

I think TrimLeadingTrailing is a macro and not its own function, try using TRIM(InColumn,'B') to see if the complexity is reduced.

satish_valavala · Post by **satish_valavala** » Wed Jul 09, 2008 10:35 am

Sure we can try TRIM(InCol,'B'). Is this macro usage of multple times a limitation to the compiler. Are there any Environment variable realted to compiler to set it. I am not sure.

ArndW · Post by **ArndW** » Wed Jul 09, 2008 10:50 am

This looks like an IBM c++ compiler problem that you can search on the internet. Turn off optimization in the stage-specific compiler options for the transform stage, that should do the trick as well.

satish_valavala · Post by **satish_valavala** » Wed Jul 09, 2008 1:28 pm

How to turn off optimization in the stage-specific compiler options for the transform stage. Will it effect the particular job or entire project.

ArndW · Post by **ArndW** » Thu Jul 10, 2008 1:04 am

Open up your transform stage details and set the compiler flags, including the "-O0" option, in the "Compiler Flags" line f the "Build" tab.
I don't think that there is much of a penalty if you remove the optimization at the project level (through the Administrator tool), since much of transform processing is simple if-then-else that cannot be optimized much.

satish_valavala · Post by **satish_valavala** » Thu Jul 10, 2008 8:46 am

We have tried -O0 option in Compiler Flag of the Transformer Stage properties Build tab, but no luck. Does the Workstation memory(RAM) matters at the time of DS Job compilation.