Datastage log overflow limit setting
Posted: Thu Apr 27, 2006 5:11 am
Question:
---------------
1.There is a possibility while running a job we may get the over flow of log for the current run. So how to capture the current log in the output log file?
Reason:
------------
We need not want any thing to set options like log only for the current run in the DS- Director. And along with the cumulative log we have to capture the current log, while capturing the current log we have two scenarios out of that one is maintaining less than say 2 billions of log for this we adopted script, same as been attached below and for the other overflow of log take place (say more than 2 billions of log) we need to know how to capture and the logic?
More Description:
-------------------
We are trying to capture the generated "Event Id" from the Datastage Director using unix shell script for the last log and the "Event Id" after the job ran.We have figured out the shell script logic for the same.Please find the logic below:
(logstrt=`/apps/Ascential/DataStage/DSEngine/bin/dsjob -lognewest $Project $JobName`
IFS=" "
set $logstrt
stlp=$4
IFS="~"
$Command >> $TMP_LOG_NAME ("$Command to run the Datastage Job)
ReturnCode=$? ; export ReturnCode
logend=`/apps/Ascential/DataStage/DSEngine/bin/dsjob -lognewest $Project $JobName`
IFS=" "
set $logend
endlp=$4
IFS="~"
cnt=$stlp
touch $tmplog
while [ $cnt -le $stlp ]
do
/apps/Ascential/DataStage/DSEngine/bin/dsjob -logdetail $Project $JobName $cnt >>$TMP_LOG_NAME
cnt=`expr $cnt + 1`
done)
But we are facing the problem of Event id "Overflow" in Datastage Director.
---------------
1.There is a possibility while running a job we may get the over flow of log for the current run. So how to capture the current log in the output log file?
Reason:
------------
We need not want any thing to set options like log only for the current run in the DS- Director. And along with the cumulative log we have to capture the current log, while capturing the current log we have two scenarios out of that one is maintaining less than say 2 billions of log for this we adopted script, same as been attached below and for the other overflow of log take place (say more than 2 billions of log) we need to know how to capture and the logic?
More Description:
-------------------
We are trying to capture the generated "Event Id" from the Datastage Director using unix shell script for the last log and the "Event Id" after the job ran.We have figured out the shell script logic for the same.Please find the logic below:
(logstrt=`/apps/Ascential/DataStage/DSEngine/bin/dsjob -lognewest $Project $JobName`
IFS=" "
set $logstrt
stlp=$4
IFS="~"
$Command >> $TMP_LOG_NAME ("$Command to run the Datastage Job)
ReturnCode=$? ; export ReturnCode
logend=`/apps/Ascential/DataStage/DSEngine/bin/dsjob -lognewest $Project $JobName`
IFS=" "
set $logend
endlp=$4
IFS="~"
cnt=$stlp
touch $tmplog
while [ $cnt -le $stlp ]
do
/apps/Ascential/DataStage/DSEngine/bin/dsjob -logdetail $Project $JobName $cnt >>$TMP_LOG_NAME
cnt=`expr $cnt + 1`
done)
But we are facing the problem of Event id "Overflow" in Datastage Director.