abnormal termination of transformer stage

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
mctny
Charter Member
Charter Member
Posts: 166
Joined: Thu Feb 02, 2006 6:55 am

abnormal termination of transformer stage

Post by mctny »

first of All I searched the forum but it didnot help me resolve my problem.

I am getting the following error in our QA environment, the job is running fine in our dev environment.

The error is

Abnormal termination of stage O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job..Format_Actuals_Like_Forecast_Stage_1 detected.

when I reset and rerun, the logs show this. abort for the same reason as above.

Job name:O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job
.
.
Message:
From previous run
DataStage Job 90 Phantom 20409
jobnotify: Unknown error
DataStage Phantom Finished.
[20414] Done : DSD.StageRun O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job. O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job.Actual_Forecast_Combined.IDENT1 1 0/50
[20415] DSD.StageRun O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job. O2c_Int_Avenue_20_Transform_or_Rejects_Data_Job.Format_Actuals_Like_Forecast_Stage_1 1 0/50 - terminated.

any thoughts?
Thanks,
Chad
__________________________________________________________________
"There are three kinds of people in this world; Ones who know how to count and the others who don't know how to count !"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No, not really. How about explaining what your job does, how it is designed? Let's start there. IDENT1 would be a transformer that it added between two passive stages, btw.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mctny
Charter Member
Charter Member
Posts: 166
Joined: Thu Feb 02, 2006 6:55 am

Post by mctny »

the name of the transformer is Format_Actuals_Like_Forecast_Stage_1


the job design is as follows



Source( Ora9i) has two output link both of which has user defined SQL, one go to a hash file( Actual_Forecast_Combined which runs fine), the other goes to the transformer stage above, and there are two output of this transformer one is going to another hash file the other is going to an aggregator (SUM) stage.

The problem is in one of the output of the source oracle stage which is going into the transformer stage.
Thanks,
Chad
__________________________________________________________________
"There are three kinds of people in this world; Ones who know how to count and the others who don't know how to count !"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Then you need to track down what's different between dev and test. Are they two different DataStage environments or are both projects on the same server? What about the data itself? Same source? Is there a significant delta in the volumes?

If not, first check could be to copy the job, pop off the Agg and whatever comes after it and replace it with a Sequential stage, see what your data actually looks like and if there is anything... unusual or different... about it in test.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mctny
Charter Member
Charter Member
Posts: 166
Joined: Thu Feb 02, 2006 6:55 am

Post by mctny »

Thanks for the answer again.

The environment are two different ones, the source data is same though, the source queries are exactly same ( they are both taking data from production database as we don't have data in our dev or test). The amount of data ( the User defined SQLs can be considered significant.) one is 170000 rows the other is around 7000 both has around 20 columns)
Thanks,
Chad
__________________________________________________________________
"There are three kinds of people in this world; Ones who know how to count and the others who don't know how to count !"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I was wondering about a difference in volume in the link that goes to the Aggregator, dev versus test. 'Large' volumes can make it fall over dead. However, it sounds like everything would be identical there.

So, are you saying that your dev and test DataStage servers are separate server? If so, what differences are there between them? Database client software version is the first thing I'd check in your shoes.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mctny
Charter Member
Charter Member
Posts: 166
Joined: Thu Feb 02, 2006 6:55 am

Post by mctny »

chulett wrote:....
So, are you saying that your dev and test DataStage servers are separate server?...
Yes.

I am not very sure about the difference but I will try to check,

oracle client should be same in both env.
Thanks,
Chad
__________________________________________________________________
"There are three kinds of people in this world; Ones who know how to count and the others who don't know how to count !"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I agree - it *should* be. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
mctny
Charter Member
Charter Member
Posts: 166
Joined: Thu Feb 02, 2006 6:55 am

Post by mctny »

chulett wrote:I agree - it *should* be. :wink:
Both of the clients are same Oracle 9.2.0.7.0, the server version is Oracle9i Enterprise Edition Release 9.2.0.5.0 for both environments.

I haven't seen any differences yet.
Thanks,
Chad
__________________________________________________________________
"There are three kinds of people in this world; Ones who know how to count and the others who don't know how to count !"
Post Reply