Compiler Logs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
info_ds
Charter Member
Charter Member
Posts: 88
Joined: Thu Feb 10, 2005 4:36 am
Location: B\'lore

Compiler Logs

Post by info_ds »

Hi,

We were not ble to compile parrallel jobs when investigated the directory where the APT__COMPLIER Path pointing has been removed recently .Is there any log in DSEngine to find the log entries of previous compiled jobs?


comments appreciated
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Hello info_ds,

I am not sure what you mean by "log entries of previous compiled jobs". Do you wish to know which jobs were compiled at what time? The DS_AUDIT hashed file lets you see when changes were made via the designer, but no track is kept of actual compilations.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If you still have the old job log entries, you can look at the second event of any job run to view the environment variable values with which it ran.

Do you archive your job logs before they are purged? If so, consult the archives. Unfortunately, restoring a job log from a system backup is a non-trivial exercise.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
info_ds
Charter Member
Charter Member
Posts: 88
Joined: Thu Feb 10, 2005 4:36 am
Location: B\'lore

Post by info_ds »

Thanks for the replies

Will there be any C++ code generated whena job is compiled? will the job c++ code contain the timestamp ?

Thanks in advance
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:? Is your problem the fact that you can no longer 'compile' jobs? If so, why don't you explain the problem you are having rather than asking about logs and timestamps?

Only jobs with Transformer stages actually invoke the C++ compiler during compilation, otherwise you are generating OSH script.
-craig

"You can never have too many knives" -- Logan Nine Fingers
info_ds
Charter Member
Charter Member
Posts: 88
Joined: Thu Feb 10, 2005 4:36 am
Location: B\'lore

Post by info_ds »

Hi,

I have designed a job which has a transformer stage and when i try to compile a job it is giving me the following error


=============================================
Output from transformer compilation follows:

##I TFCN 000001 09:28:34(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.1A
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved


##I TUTL 000031 09:28:34(001) <main_program> The open files limit is 1000; raising to 65536.
##I TOSH 000002 09:28:35(000) <main_program> orchgeneral: loaded
##I TOSH 000002 09:28:35(001) <main_program> orchsort: loaded
##I TOSH 000002 09:28:35(002) <main_program> orchstats: loaded
##I TFSC 000001 09:28:35(005) <main_program> APT configuration file: /opt/dsSoftware/Ascential/DataStage/Configurations/default.apt
##W TCOS 000049 09:28:35(006) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E TBLD 000000 09:28:36(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E TFSR 000019 09:28:36(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 09:28:36(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 09:28:36(003) <main_program> Error when checking composite operator: Output from subprocess: sh
##W TBLD 000000 09:28:36(004) <main_program> Error when checking composite operator: Output from subprocess: : /opt/SUNWspro/bin/CC: not found

##I TFCP 000000 09:28:36(005) <transform> Error when checking composite operator: /opt/SUNWspro/bin/CC -KPIC -O -I/opt/dsSoftware/Ascential/DataStage/PXEngine/include -dalign -O -PIC -library=iostream -c /datastage/Projects/DataStageTest/RT_BP78.O/V0S20_UpdateLoadDate_Transformer.C -o /datastage/Projects/DataStageTest/RT_BP78.O/V0S20_UpdateLoadDate_Transformer.tmp.o.
##E TCOS 000029 09:28:36(006) <main_program> Creation of a step finished with status = FAILED. (UpdateLoadDate.Transformer)

*** Internal Generated Transformer Code follows:
0001: //
0002: // Generated file to implement the V0S20_repos_Transformer transform operator.
0003: //
0004:
0005: // define our input/output link names
0006: inputname 0 DummyData;
0007: outputname 0 LoadSourceAndDate;
0008:
0009: global {
0010: // Job parameter declaration
0011: string DATA_SOURCE;
0012: }
0013:
0014: initialize {
0015: // define our row rejected variable
0016: int8 RowRejected0;
0017:
0018: // define our null set variable
0019: int8 NullSetVar0;
0020:
0021: }
0022:
0023: mainloop {
0024: // initialise our row rejected variable
0025: RowRejected0 = 1;
0026:
0027: // evaluate columns (no constraints) for link: LoadSourceAndDate
0028: LoadSourceAndDate.DATA_SOURCE = DATA_SOURCE;
0029: LoadSourceAndDate.LAST_LOAD_DATE = current_timestamp();
0030: writerecord 0;
0031: RowRejected0 = 0;
0032: }
0033:
0034: finish {
0035: }
0036:
*** End of Internal Generated Transformer Code
===================================================

After investigation we found that the compiler has been removed .For further more investigation we just want to find the log of previously compiled jobs and make sure that the compiler has been removed .
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Is this just to check if the compiler is not there? If yes then i would say that the compiler, has been infact, removed as the job is not getting compiled. Why dont you go to the environment variable APT_COMPILER, check out its path, go to that path and verify it there.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

or go to the UNIX command line with the same userid and set your dsenv environment variables and enter the command
opt/SUNWspro/bin/CC -KPIC -O -I/opt/dsSoftware/Ascential/DataStage/PXEngine/include -dalign -O -PIC -library=iostream -c /datastage/Projects/DataStageTest/RT_BP78.O/V0S20_UpdateLoadDate_Transformer.C -o /datastage/Projects/DataStageTest/RT_BP78.O/V0S20_UpdateLoadDate_Transformer.tmp.o
and see what error you get from the compiler.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... with a leading slash: /opt/SUNWspro/bin/CC
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply