array size while inserting

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
DS_FocusGroup
Premium Member
Premium Member
Posts: 197
Joined: Sun Jul 15, 2007 11:45 pm
Location: Prague

array size while inserting

Post by DS_FocusGroup »

Hi, Anyone please let me know why we get this warning ? what is the default array size ? what is the maximum we can use? where do we change this from ?

Code: Select all

Insert_TD,0: [IIS-CONN-TERA-005010] The estimated row length of 41 bytes multiplied by the array size of 2,000 is 82,000 which exceeds the maximum buffer size of 64,260
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Seems to me, everything is in the error message you posted. Your array size needs to be no more than 1567 with that row length to ensure the buffer size is not exceeded.
-craig

"You can never have too many knives" -- Logan Nine Fingers
DS_FocusGroup
Premium Member
Premium Member
Posts: 197
Joined: Sun Jul 15, 2007 11:45 pm
Location: Prague

Post by DS_FocusGroup »

How did we come to this conclusion :roll: . it the array length always fixed or can we change it ?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Based on what you posted, of course, and a little bit of that 'rithmetic stuff. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
DS_FocusGroup
Premium Member
Premium Member
Posts: 197
Joined: Sun Jul 15, 2007 11:45 pm
Location: Prague

Post by DS_FocusGroup »

"How" to change the array size is still the question....................
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

How can anyone answer that for you unless they are clairvoyent? You haven't given any details like database, stage, etc. We can guess Teradata, but that's about it. :?
-craig

"You can never have too many knives" -- Logan Nine Fingers
toshea
Participant
Posts: 79
Joined: Thu Aug 14, 2008 6:46 pm

Post by toshea »

There is a property in the Teradata Connector called Array size. Reduce its value to get rid of the warning.
shershahkhan
Participant
Posts: 64
Joined: Fri Jan 25, 2008 4:41 am

Post by shershahkhan »

Wouldn't it be nice to increase the buffer size?
toshea
Participant
Posts: 79
Joined: Thu Aug 14, 2008 6:46 pm

Post by toshea »

The Teradata Parallel Transporter API has a hard limit of 64260 for its buffer size. You cannot increase it (although you can decrease it).
DS_FocusGroup
Premium Member
Premium Member
Posts: 197
Joined: Sun Jul 15, 2007 11:45 pm
Location: Prague

Post by DS_FocusGroup »

thanks all!
Post Reply