Dataset with a different structure

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mjgmc
Participant
Posts: 52
Joined: Thu Nov 25, 2004 8:06 am

Dataset with a different structure

Post by mjgmc »

Hello,

I have a job which is used to concat several Datasets into one to be loaded into an Oracle table.

So, its design is

Code: Select all

                           Oracle
Dataset_1                    |
..          --> Funnel --> Lookup --> Dataset
Dataset_n 
Each input Dataset have the structure:

Col1
Col2 (used for the lookup reference)
Col3
Col4

And my Output Dataset is

Col1
Col3
Col4
Col5 (from the Oracle table)

I don't have the RCP activated but my Dataset is created as:

Col1
Col2
Col3
Col4
Col5

As my Load job is a generic one for which I need to have the same structure for the Dataset and the table, I keep having the same error:

ORA_BD: Describe failed because of missing column for Col2

I already tried everything (I think :( ):

- Copy the job
- Delete the link and the Dataset and recreate it
- Create it with another name...

I also tried to put the option "Silently Drop Columns Not In Table" = True, but this generates warnings.

What can I do to solve this problem?

tkx
thumsup9
Charter Member
Charter Member
Posts: 168
Joined: Fri Feb 18, 2005 11:29 am

Post by thumsup9 »

I would put a Transformer in between Lookup and DataSet and map the necessary columns.
prabu
Participant
Posts: 146
Joined: Fri Oct 22, 2004 9:12 am

Re: Dataset with a different structure

Post by prabu »

mjgmc wrote:Hello,

I
Each input Dataset have the structure:

Col1
Col2 (used for the lookup reference)
Col3
Col4

And my Output Dataset is

Col1
Col3
Col4
Col5 (from the Oracle table)

I don't have the RCP activated but my Dataset is created as:

Col1
Col2
Col3
Col4
Col5

As my Load job is a generic one for which I need to have the same structure for the Dataset and the table, I keep having the same error:

ORA_BD: Describe failed because of missing column for Col2

I already tried everything (I think :( ):

- Copy the job
- Delete the link and the Dataset and recreate it
- Create it with another name...

I also tried to put the option "Silently Drop Columns Not In Table" = True, but this generates warnings.

What can I do to solve this problem?

tkx
Hi, i am not sure i understand your question. is it the sturcture you get in your lookup . *,**,*** ,****indicates key?? please tell me what is your key from oracle table .

Code: Select all

   *Col1
   **Col3
   ***Col4
   ****Col5 (from the Oracle table)                    col1
                                                                      col3
  *Col1                                                            col4
  ****Col2 (used for the lookup reference)         col2(equals col5)
  **Col3
  ***Col4
  
  
prabu
Participant
Posts: 146
Joined: Fri Oct 22, 2004 9:12 am

Post by prabu »

assuming col5 is ora key and col2 is funnel key

Code: Select all

  ora_Col1
  Col3
  Col4
  *Col5 (from the Oracle table)                   ora_col1
                                                  col3
  ds_Col1                                         col4
  *Col2 (used for the lookup reference)           col5
  Col3                                            col2 [don't take this from bottom left]
  Col4
  
  hope this helps!
  
  

Post Reply