Help on Schema file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chitrangadsingh
Participant
Posts: 12
Joined: Mon Jul 18, 2005 4:07 am

Help on Schema file

Post by chitrangadsingh »

Hi all,

I'm using a schema file to read/write into a sequential file. But when i delete the metadata in the stage, the job doesn't compile nor i'm able to view data.
My understanding is, schema files are used where metadata is not static and keeps on changing. Thus the metadata has to be changed only at one location and we dont have to load col defns in all the jobs/stages.
But if the job doesnt work without loading fresh metadata, what purpose does the schema file serve?
Please correct me if i'm wrong or tell me if i'm going wrong somewhere.

Thanks,
Chits
RAJEEV KATTA
Participant
Posts: 103
Joined: Wed Jul 06, 2005 12:29 am

Re: Help on Schema file

Post by RAJEEV KATTA »

Hi Chits,
Its something like this schema file is used to import metadata into the stage during runtime.So for this you need to check runtime column propagation in the columns tab.To avail this option in your columns tab go to DataStage Administrator and check Runtime column propagation.Now when you check the runtime column propagation in columns tab and by specifying the schema file there is no need for you to load the column definitions.


Cheers,
Rajeev.


chitrangadsingh wrote:Hi all,

I'm using a schema file to read/write into a sequential file. But when i delete the metadata in the stage, the job doesn't compile nor i'm able to view data.
My understanding is, schema files are used where metadata is not static and keeps on changing. Thus the metadata has to be changed only at one location and we dont have to load col defns in all the jobs/stages.
But if the job doesnt work without loading fresh metadata, what purpose does the schema file serve?
Please correct me if i'm wrong or tell me if i'm going wrong somewhere.

Thanks,
Chits
chitrangadsingh
Participant
Posts: 12
Joined: Mon Jul 18, 2005 4:07 am

Re: Help on Schema file

Post by chitrangadsingh »

Thanx Rajiv,
It worked.
But now i have another related query. In this scenario, if one has to do some transformations/calculations then how this can be done? coz now there wont be any columns visible in the transformer. I actually tried putting in a transformer in b/w two seq file stages. The job ran and simply dumped the data into destination file.
Or is it so that schema file can only be used for simple load/extract?

Thanks,
Chits
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

That's completely unrelated to the topic. Please start a new thread. :!:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
RAJEEV KATTA
Participant
Posts: 103
Joined: Wed Jul 06, 2005 12:29 am

Re: Help on Schema file

Post by RAJEEV KATTA »

Hi Chits,
In the scenario you said transformations/calculations is not possible as the columns pass only during runtime from schema file and the osh code gets generated when you compile the job and that osh code is being ran when you run the job.If you want to do that then you have to load the columns explicitly even after specifying schema file and then use them in transformer for transformations thats the work around as far as i know.

Cheers,
Rajeev Katta.

chitrangadsingh wrote:Thanx Rajiv,
It worked.
But now i have another related query. In this scenario, if one has to do some transformations/calculations then how this can be done? coz now there wont be any columns visible in the transformer. I actually tried putting in a transformer in b/w two seq file stages. The job ran and simply dumped the data into destination file.
Or is it so that schema file can only be used for simple load/extract?

Thanks,
Chits
Post Reply