In my job,i need to concatenate two datasets into a single dataset.I know that for this we can use funnel stage but the problem is my two input datasets are in different formats(Having different fields and different lengths) so funnel wil not work in this case.
Is there any best method is there to do this concatenation in Datastage Job?
Is there any specific stage to execute CAT command from Datastage job.I need to use the final created file(After Concatenating) for further processing in the same job.
Raamc wrote:Is there any specific stage to execute CAT command from Datastage job.I need to use the final created file(After Concatenating) for further processing in the same job.
You can execute CAT command in the Execute Command Activity.
After job subroutine. But keep in mind these datasets need to be exported to a flat file before you can pass an os level cat on it.
I am not sure if any orch utility exists to cat datasets. I am not at a px site currently.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
You can not do what you seek to do, without forcing the format (record schema) to be that of the target Data Set. Once you have done that, you can use a Funnel stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Could you add 2 transformers ?
1 concatenate all fields of dataset 1 into 1 single field varchar(xxxx)
the other does the same for dataset 2
and then funnel both streams.