Oracle metadata imports improper field size

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sd
Premium Member
Premium Member
Posts: 5
Joined: Fri May 15, 2009 9:29 am

Oracle metadata imports improper field size

Post by sd »

When we import Oracle 10 table metadata using Orchestrate and charset/map of UTF-8 from our production database, the field sizes are correct.

When we import Oracle 10 table metadata using Orchestrated and charset/map of UTF-8 from our new data warehouse, all the varchar field sizes are multiplied by 4.

I'm sure this is an Oracle configuration problem, but we are too green to see it. Can anyone point us in the right direction?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Are you sure it's not a multiple of 3? Does your new data warehouse use a multi-byte character set?
-craig

"You can never have too many knives" -- Logan Nine Fingers
sd
Premium Member
Premium Member
Posts: 5
Joined: Fri May 15, 2009 9:29 am

Post by sd »

chulett wrote:Are you sure it's not a multiple of 3? Does your new data warehouse use a multi-byte character set?
It is definitely a multiple of 4.

The Oracle production server whose metadata can be used in DataStage just fine is NLS_CHARACTERSET US7ASCII.

The new Oracle data warehouse server whose metadata field sizes are x4 is NLS_CHARACTERSET AL32UTF8.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Prefer importing Oracle table definitions using the Orchestrate orchdbutil facility. It is known to be more accurate in how it retrieves metadata.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sd
Premium Member
Premium Member
Posts: 5
Joined: Fri May 15, 2009 9:29 am

Post by sd »

ray.wurlod wrote:Prefer importing Oracle table definitions using the Orchestrate orchdbutil facility. It is known to be more accurate in how it retrieves metadata.
We are using Import, Table Definitions, Orchestrate Schema Definitions with the radio button for Database table (via orchdbutil) selected and tables we import from our data warehouse with UTF-8 selected are 4 x as large as they should be. The ones we import from production are the correct size.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

There's nothing you can do about it, from what I've seen, other than manually correct things. It seems to import based on maximum bytes rather than characters from a multi-byte character set. :?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply