Dataset Query

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rumu
Participant
Posts: 286
Joined: Mon Jun 06, 2005 4:07 am

Dataset Query

Post by rumu »

Hi All,

I have created a Dataset in a Firts job using 4 node configuration file and trying to read the same dataset in 2nd job while running the job in 2 node configuration file.
The second job is running fine.
Is this ok?since I heard that in such scenerio 2nd job shud abort but it is not happening ...
Could anyone suggest pls?
Rumu
IT Consultant
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: Dataset Query

Post by chulett »

rumu wrote:I heard that in such scenerio 2nd job shud abort
You heard wrong.
-craig

"You can never have too many knives" -- Logan Nine Fingers
abhijain
Participant
Posts: 88
Joined: Wed Jun 13, 2007 1:10 pm
Location: India

Post by abhijain »

There is no reason why the job should abort. You can create dataset by using any no. of nodes and can use in any other job, which uses different no. of nodes.

The job will work fine without any issues.
Rgrds,
Abhi
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
hamzaqk
Participant
Posts: 249
Joined: Tue Apr 17, 2007 5:50 am
Location: islamabad

Post by hamzaqk »

hmmm well i also had an impression that the DS is configuration file dependent. :?
Teradata Certified Master V2R5
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Well... it is but if the only difference in the 'configuration' is the number of nodes, there wouldn't be any issues.
-craig

"You can never have too many knives" -- Logan Nine Fingers
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

the second job should also have four node to read the dataset..
so if you want to process the data in 2 node in second job, then make the other two node in "read only" pool.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Actually (in version 8 and later) DataStage will do this automatically and invisibly.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rumu
Participant
Posts: 286
Joined: Mon Jun 06, 2005 4:07 am

Post by rumu »

Thanks to every body for your input.
Why I asked that,when I did an initial training on Datastage V8.0,the trainer from IBM itself told this information in the class.She was from IBM software Lab..But when I practically implement this I found job is running fine.hence I asked in this forum.

Thanks again for your valuable input.

Regards,

Rumu
Rumu
IT Consultant
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

Post by zulfi123786 »

ray.wurlod wrote:Actually (in version 8 and later) DataStage will do this automatically and invisibly.
If the same situation arises in versions prior to 8 do we always need to make the other two node in "read only" pool ? and also can you help me with how to do this. I guess this shold me made in the dataset stage using the option "Node Pool and Resource Constraint", am i right?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

To be honest, I don't recall. I vaguely remember that the configuration file with which the Data Set had to be read had to be "compatible" with the configuration file used when the Data Set was written.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply