Files with varying columns

Shadab_Farooque · Post by **Shadab_Farooque** » Mon Jul 14, 2008 11:05 am

Hi,

I have a csv file which can have 60 to 105 columns .
Eg.one day it will have 60 columns,next day it will have 78 columns and so on.

How should i load this file into Oracle database

Regards
Shadab

chulett · Post by **chulett** » Mon Jul 14, 2008 11:07 am

When it magically has 78 columns the next day, are the first 60 the same as the previous day?

ray.wurlod · Post by **ray.wurlod** » Mon Jul 14, 2008 3:57 pm

Define 105 columns. Create "missing columns" rules in the table definition for the Sequential File stage.

Shadab_Farooque · Post by **Shadab_Farooque** » Mon Jul 14, 2008 4:44 pm

Hi Ray,
Can you please let me know how to create "missing columns" rules

Shadab_Farooque · Post by **Shadab_Farooque** » Mon Jul 14, 2008 4:48 pm

chulett wrote:When it magically has 78 columns the next day, are the first 60 the same as the previous day? ...

Hi Chulett,

Yes, the first 60 columns are same as yesterdays

keshav0307 · Post by **keshav0307** » Mon Jul 14, 2008 8:53 pm

check this post :
viewtopic.php?p=291072

keshav0307 · Post by **keshav0307** » Mon Jul 14, 2008 8:55 pm

missing columns action is available for server jobs only

ray.wurlod · Post by **ray.wurlod** » Mon Jul 14, 2008 9:59 pm

Not 100% sure whether that's true or not, but if it is you can put the Sequential File stage into a server Shared Container to make use of this particular functionality in a parallel job.

You might also investigate an approach using the Schema File property of the parallel Sequential File stage.