aggregator stage hangs and job aborts

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
knowledge
Participant
Posts: 101
Joined: Mon Oct 17, 2005 8:14 am

aggregator stage hangs and job aborts

Post by knowledge »

I have a job which uses aggregator stage , It runs fine for small data but when it reaches 3.9 mil it aborts , without specific warning just 'Abnormal Termination'

I am not sure what is going wrong .....

I tried same logic in sql query which runs fine in toad but giving problem in OCI stage :


SELECT M.ARD_CNTY_CODE, M.ARD_MNCPLTY_CODE, M.ARD_ACDNT_YR_NUM,
M.ARD_ACDNT_CASE_NUM, M.ARD_VHCL_ID, M.ARD_VIN_ID,
MAX(M.TEST_DATE)
FROM (SELECT B.VHCL_IDNTFCTN_NUM,
TO_CHAR (B.TEST_START_DATE, 'YYYY-MM-DD HH24:MI:SS') TEST_DATE,
A.ARD_CNTY_CODE, A.ARD_MNCPLTY_CODE, A.ARD_ACDNT_YR_NUM,
A.ARD_ACDNT_CASE_NUM, A.ARD_VHCL_ID, A.ARD_VIN_ID,
TO_CHAR (A.ARD_ACC_DATE, 'YYYY-MM-DD HH24:MI:SS')
FROM CRASH_PROD.ARD_VEHICLE_INSPECTION A,
CRASH_PROD.CRASH_INSPECTION B
WHERE TRIM (A.ARD_VIN_ID) = TRIM (B.VHCL_IDNTFCTN_NUM)) M
GROUP BY M.ARD_CNTY_CODE,
M.ARD_MNCPLTY_CODE,
M.ARD_ACDNT_YR_NUM,
M.ARD_ACDNT_CASE_NUM,
M.ARD_VHCL_ID,
M.ARD_VIN_ID


........................

Please suggest either one , why aggregator stage is not working or how to retrieve data from OCI stage with the above query, i have included all columns in the inner query , do we have to give column derivation too , it does not return any data but it works very fine in toad....
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Moderator: please move to Server forum

Server Aggregator stage does have limitations with the amount of unsorted data it can handle. Search for more information.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

did you tried writing the query in oracle stage as user defined query.
what error you get?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

What you'll find when you search is the need to sort your data properly and then assert that sorted order in the Aggregator. Then you'll find it can support pretty much any volume of data.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply