Process abort with a warning

Archive of postings to DataStageUsers@Oliver.com. This forum intended only as a reference and cannot be posted to.

Moderators: chulett, rschirm

Locked
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Hi Nuno,

Is the record sorted on the field where you apply the "Group By"?

If arent try to sort it.
Ive had similar problem and Ive solve it in this way.

Best rgds

Giovanni Boccia
Sales Engineer
Direzione Industria e Servizi
Datamat - Enabling Your Future

----- Original Message -----
From: "Nuno Pimenta"
To: "LIST-DataStage (E-mail)"
Sent: Thursday, October 18, 2001 1:33 PM
Subject: Process abort with a warning


>
> Hi all,
>
> I have a process that aggregates some data from a table A. This table
> is the source for three aggregates:
>
> Table A ----> Transform A ----> AggregateA1 ----> Table A1
> ----> AggregateA2 ----> Table A2
> ----->AggregateA3 ----> Table A3
>
> But the process abort when he has 21.703.032 in each aggregate, and in
> log it gives us only the following warning:
>
> Type: Warning
> Event:Abnormal termination of stage DSCFAGG.AGG_A1 detected
>
> Can anyone have any suggestions??
>
> Thanks in advance.
>
> NP
>
>
>
>
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Process abort with a warning

Post by admin »

Hi all,

I have a process that aggregates some data from a table A.
This table is the source for three aggregates:

Table A ----> Transform A ----> AggregateA1 ----> Table A1
----> AggregateA2 ----> Table A2
----->AggregateA3 ----> Table A3

But the process abort when he has 21.703.032 in each aggregate, and in log it gives us only the following warning:

Type: Warning
Event:Abnormal termination of stage DSCFAGG.AGG_A1 detected

Can anyone have any suggestions??

Thanks in advance.

NP
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

No, but the source table have 70 milions of records.
Do i have to order 70 milion of records?

Do you mean order in DS Aggregator?

Thanks Giovanni.

NP

-----Original Message-----
From: Giovanni Boccia [mailto:boccia@datamat.it]
Sent: quinta-feira, 18 de Outubro de 2001 12:33
To: datastage-users@oliver.com
Subject: Re: Process abort with a warning


Hi Nuno,

Is the record sorted on the field where you apply the "Group By"?

If arent try to sort it.
Ive had similar problem and Ive solve it in this way.

Best rgds

Giovanni Boccia
Sales Engineer
Direzione Industria e Servizi
Datamat - Enabling Your Future

----- Original Message -----
From: "Nuno Pimenta"
To: "LIST-DataStage (E-mail)"
Sent: Thursday, October 18, 2001 1:33 PM
Subject: Process abort with a warning


>
> Hi all,
>
> I have a process that aggregates some data from a table A. This table
> is the source for three aggregates:
>
> Table A ----> Transform A ----> AggregateA1 ----> Table A1
> ----> AggregateA2 ----> Table A2
> ----->AggregateA3 ----> Table A3
>
> But the process abort when he has 21.703.032 in each aggregate, and in
> log it gives us only the following warning:
>
> Type: Warning
> Event:Abnormal termination of stage DSCFAGG.AGG_A1 detected
>
> Can anyone have any suggestions??
>
> Thanks in advance.
>
> NP
>
>
>
>
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Yes, the aggregator expects the records to be presented in the order that matches the grouping performed by the aggregator.

Either add a sort clause to your input query or add a sort plug-in stage between your input and the aggregator stage.

-----Original Message-----
From: Nuno Pimenta [mailto:nuno.pimenta@tmn.pt]
Sent: Thursday, 18 October 2001 11:29 PM
To: datastage-users@oliver.com
Subject: RE: Process abort with a warning

No, but the source table have 70 milions of records.
Do i have to order 70 milion of records?

Do you mean order in DS Aggregator?

Thanks Giovanni.

NP

-----Original Message-----
From: Giovanni Boccia [mailto:boccia@datamat.it]
Sent: quinta-feira, 18 de Outubro de 2001 12:33
To: datastage-users@oliver.com
Subject: Re: Process abort with a warning


Hi Nuno,

Is the record sorted on the field where you apply the "Group By"?

If arent try to sort it.
Ive had similar problem and Ive solve it in this way.

Best rgds

Giovanni Boccia
Sales Engineer
Direzione Industria e Servizi
Datamat - Enabling Your Future

----- Original Message -----
From: "Nuno Pimenta"
To: "LIST-DataStage (E-mail)"
Sent: Thursday, October 18, 2001 1:33 PM
Subject: Process abort with a warning


>
> Hi all,
>
> I have a process that aggregates some data from a table A. This table
> is the source for three aggregates:
>
> Table A ----> Transform A ----> AggregateA1 ----> Table A1
> ----> AggregateA2 ----> Table A2
> ----->AggregateA3 ----> Table A3
>
> But the process abort when he has 21.703.032 in each aggregate, and in
> log it gives us only the following warning:
>
> Type: Warning
> Event:Abnormal termination of stage DSCFAGG.AGG_A1 detected
>
> Can anyone have any suggestions??
>
> Thanks in advance.
>
> NP
>
>
>
>
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Greetings,

Im new to this list, so a little late with a reply but the last piece of advice isnt quite correct. The Aggregator only expects the input rows to be sorted if *you* tell it they are sorted. You tell it by filling in the Sort column. This lets the stage know the data is already sorted in the order you specified, if the sort matches the group by then the aggregator will not need to sort the data, otherwise it will perform the sort in order to fulfill the conditions of the group by.

Your problem sounds more like a lack of temp space in which to perform the aggregator sort. Check your dsenv file, Im pretty sure thats where the sort location and sizes are set... you may need to bump it up considerably.

-craig




"David
Barham" To:
Subject: RE: Process abort with a warning

10/18/01
07:42 AM
Please
respond to
datastage-use
rs





Yes, the aggregator expects the records to be presented in the order that matches the grouping performed by the aggregator.

Either add a sort clause to your input query or add a sort plug-in stage between your input and the aggregator stage.

-----Original Message-----
From: Nuno Pimenta [mailto:nuno.pimenta@tmn.pt]
Sent: Thursday, 18 October 2001 11:29 PM
To: datastage-users@oliver.com
Subject: RE: Process abort with a warning

No, but the source table have 70 milions of records.
Do i have to order 70 milion of records?

Do you mean order in DS Aggregator?

Thanks Giovanni.

NP

-----Original Message-----
From: Giovanni Boccia [mailto:boccia@datamat.it]
Sent: quinta-feira, 18 de Outubro de 2001 12:33
To: datastage-users@oliver.com
Subject: Re: Process abort with a warning


Hi Nuno,

Is the record sorted on the field where you apply the "Group By"?

If arent try to sort it.
Ive had similar problem and Ive solve it in this way.

Best rgds

Giovanni Boccia
Sales Engineer
Direzione Industria e Servizi
Datamat - Enabling Your Future

----- Original Message -----
From: "Nuno Pimenta"
To: "LIST-DataStage (E-mail)"
Sent: Thursday, October 18, 2001 1:33 PM
Subject: Process abort with a warning


>
> Hi all,
>
> I have a process that aggregates some data from a table A. This table
> is the source for three aggregates:
>
> Table A ----> Transform A ----> AggregateA1 ----> Table A1
> ----> AggregateA2 ----> Table A2
> ----->AggregateA3 ----> Table A3
>
> But the process abort when he has 21.703.032 in each aggregate, and in
log
> it gives us only the following warning:
>
> Type: Warning
> Event:Abnormal termination of stage DSCFAGG.AGG_A1 detected
>
> Can anyone have any suggestions??
>
> Thanks in advance.
>
> NP
>
>
>
>
Locked