How to pass transformation dynamically

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
anandsivan
Participant
Posts: 8
Joined: Wed Sep 21, 2011 4:27 am
Location: Karnataka

How to pass transformation dynamically

Post by anandsivan »

Hi,

I have a requirement of creating generic jobs to read the COBOL file using CFF stage and do some basic transformations and load into Tera data. But unfortunately I am not able to use Schema files with CFF stage.

Currently I am using Sequential file to read the file using the schema files and RCP . But I am not sure to pass the transformation dynamically .

Here is an example of my transformation requirements.

Code: Select all


Input Column Names :

1.  COLUMN1
2.  COLUMN2
3.  COLUMN3
4.  COLUMN4
4.  COLUMN4_NULL_IND

And Output Column Names :

1.  COLUMN1
2.  COLUMN2
3.  COLUMN3
4.  If IsNull(COLUMN4_NULL_IND)  Then SetNull() Else COLUMN4 


And for each each file the column names differs. 

Kindly someone let me know any solution/logic to achieve this.

Many Thanks,
Anand
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Only the RMM (Read My Mind) stage. You cannot effect transformation without naming the columns in the transformation, with very limited exceptions in the Modify stage (which does not have If..Then..Else capability).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
prasannakumarkk
Participant
Posts: 117
Joined: Wed Feb 06, 2013 9:24 am
Location: Chennai,TN, India

Post by prasannakumarkk »

In teradata, is it going to be bulk load?
Why not achieve this simple transformation in the SQL query?
In this case , like one schema file for each file, you must have a sql query for each table and it must be maintained somewhere.
Not sure of the feasibility. Just a thought
Thanks,
Prasanna
anandsivan
Participant
Posts: 8
Joined: Wed Sep 21, 2011 4:27 am
Location: Karnataka

Post by anandsivan »

Yes. This will be bulk load.
Anyway I will try with using customized SQL queries .



_________________
Thanks
Anand
Post Reply