Passing transformations dynamically
Posted: Fri Mar 05, 2010 6:22 pm
Hi Everyone ,
I have the following requirement :
There are some 100 columns and i need to do some transformations on these columns .
col1 , col2 , col3 , col4 ...col100 are columns .
The type of transformations are stored in a table called rule_table .This table will be populated daily . Suppose record1 is coming then it has rule id on the record .Based on this rule id , we will querying the table rule_table based on rule id .
Suppose let us say the record in rule table is :
ruleid ( 100 ) , transformation ( col1 ='A' and col2 ='B' )
ruleid ( 101 ) , transformation ( col10 = 'C' or col59 = 'G' ) and so on .
I need to join those tables based on ruleid and do the transformations based on the transformation column in rule_table .
If incoming record has ruleid =100 then i need to verify
( col = 'A' and col2 = 'B' ) is true or not .Please note that here transformations , number of columns involved in the transformation , name of the columns in the transformations are dynamic .
Could you please tell if this can be acheived through datastage or not ? Please let me know if i have not clearly explained the scenario ?
I have the following requirement :
There are some 100 columns and i need to do some transformations on these columns .
col1 , col2 , col3 , col4 ...col100 are columns .
The type of transformations are stored in a table called rule_table .This table will be populated daily . Suppose record1 is coming then it has rule id on the record .Based on this rule id , we will querying the table rule_table based on rule id .
Suppose let us say the record in rule table is :
ruleid ( 100 ) , transformation ( col1 ='A' and col2 ='B' )
ruleid ( 101 ) , transformation ( col10 = 'C' or col59 = 'G' ) and so on .
I need to join those tables based on ruleid and do the transformations based on the transformation column in rule_table .
If incoming record has ruleid =100 then i need to verify
( col = 'A' and col2 = 'B' ) is true or not .Please note that here transformations , number of columns involved in the transformation , name of the columns in the transformations are dynamic .
Could you please tell if this can be acheived through datastage or not ? Please let me know if i have not clearly explained the scenario ?