Hi guys
Just got a requirement to do the following:
Receive two files, one with the target metadata and another containing the data
- Create the table based on the supplied metadata in the first file and then insert the data in the second file.
This will need to be a generic solution, as there are planned to be many such interfaces and we would like to avoid designing one job per interface. The idea would be to have a single job to do this...
Is there a way to do this dynamically in DS Server?
Thanks in advance
Wade
Generate Metadata from File, then load second file?
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
Not really the DataStage "way"... but I'm sure some kind of utility job could be cobbled together. You might have to treat the contents of each file as a single varchar column and parse out what you need.
In the long run, I think you will be much better off with a job per interface.
The utility approach will be brittle and a constant source of destabilization for your application.
Mike
In the long run, I think you will be much better off with a job per interface.
The utility approach will be brittle and a constant source of destabilization for your application.
Mike
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I agree with Mike.
It may be easier to do in parallel jobs, by converting the metadata into a schema file, but it would still be brittle - what happens when you need to refer to some dynamically-created column name in an expression?
It may be easier to do in parallel jobs, by converting the metadata into a schema file, but it would still be brittle - what happens when you need to refer to some dynamically-created column name in an expression?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.