Buffer Operator Warning (1st encounter)

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
parag.s.27
Participant
Posts: 221
Joined: Fri Feb 17, 2006 3:38 am
Location: India
Contact:

Buffer Operator Warning (1st encounter)

Post by parag.s.27 »

Hi All,

I am getting following warning in one of the job that has 10 million plus records to be loaded in the table in Oracle 10g database.

buffer(10),0: APT_BufferOperator warning: newTime < startTime, 1242920537.63075 1242920538.07821

I had been trying to find anything matching in the forum but could not find one directly....

Can any one help in understanding this warning and what is causing this warning?

This warning is causing the entire master sequence to abort after loading 5 million records. :x
Thanks & Regards
Parag Saundattikar
Certified for Infosphere DataStage v8.0
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Search just for "newTime". That and give us some idea of your job design.
-craig

"You can never have too many knives" -- Logan Nine Fingers
parag.s.27
Participant
Posts: 221
Joined: Fri Feb 17, 2006 3:38 am
Location: India
Contact:

Post by parag.s.27 »

chulett wrote:Search just for "newTime". That and give us some idea of your job design. ...

Hi Chulett,

Thanks for the suggestion as well as apologies for not searching the topic with all permutations and combinations.
Thanks & Regards
Parag Saundattikar
Certified for Infosphere DataStage v8.0
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No worries... sometimes people search for "too much", too specific of a search string. Can help to cut it back, to use a more generic portion of the message. Sure it gives you more to weed thru, but your fish is in the net. Somewhere. :wink:

Do you still need help? If so, please do give us some details of your job design, stages used, settings, etc.
-craig

"You can never have too many knives" -- Logan Nine Fingers
parag.s.27
Participant
Posts: 221
Joined: Fri Feb 17, 2006 3:38 am
Location: India
Contact:

Post by parag.s.27 »

chulett wrote:No worries... sometimes people search for "too much", too specific of a search string. Can help to cut it back, to use a more generic portion of the message. Sure it gives you more to weed thru, but your fish is in the net. Somewhere. :wink:

Do you still need help? If so, please do give us some details of your job design, stages used, settings, etc.
Hi,

Thanks a lot for help...What we have figured out is that in one of our job where this problem is occurring, we are having a CDC stage, few joiners and the data is getting loaded in Oracle table. Now the data volume is too high almost 20 million records.

we were checking for the performance of jobs on a project level and we've enabled the $APT_PM_PLAYER_TIMING parameter. This was causing the DataStage server to operate GetTimeOfTheDay function with AIX. This was the prime reason where time between 2 subsequent records was having a difference of 2 milliseconds on the lesser side. So one of our team member who had a good knowledge of AIX set up some parameter that resolved the issue for us.
Thanks & Regards
Parag Saundattikar
Certified for Infosphere DataStage v8.0
sanjay
Premium Member
Premium Member
Posts: 203
Joined: Fri Apr 23, 2004 2:22 am

Post by sanjay »

Please let us know AIX parameter

Thanks
Sanjay
parag.s.27 wrote:
chulett wrote:No worries... sometimes people search for "too much", too specific of a search string. Can help to cut it back, to use a more generic portion of the message. Sure it gives you more to weed thru, but your fish is in the net. Somewhere. :wink:

Do you still need help? If so, please do give us some details of your job design, stages used, settings, etc.
Hi,

Thanks a lot for help...What we have figured out is that in one of our job where this problem is occurring, we are having a CDC stage, few joiners and the data is getting loaded in Oracle table. Now the data volume is too high almost 20 million records.

we were checking for the performance of jobs on a project level and we've enabled the $APT_PM_PLAYER_TIMING parameter. This was causing the DataStage server to operate GetTimeOfTheDay function with AIX. This was the prime reason where time between 2 subsequent records was having a difference of 2 milliseconds on the lesser side. So one of our team member who had a good knowledge of AIX set up some parameter that resolved the issue for us.
Post Reply