Dataset Read/Write

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
I_Server_Whale
Premium Member
Premium Member
Posts: 1255
Joined: Wed Feb 02, 2005 11:54 am
Location: United States of America

Dataset Read/Write

Post by I_Server_Whale »

Hi All,

If a dataset is created using a 2 node config file, then should it always be read by a 2 node config file ideally?. If needed to be read by > 2 node config file (3 or more), then is there a workaround?

Your inputs are greatly appreciated,
Whale.
Anything that won't sell, I don't want to invent. Its sale is proof of utility, and utility is success.
Author: Thomas A. Edison 1847-1931, American Inventor, Entrepreneur, Founder of GE
thebird
Participant
Posts: 254
Joined: Thu Jan 06, 2005 12:11 am
Location: India
Contact:

Post by thebird »

You can always read it with a higher configuration - just make sure that the configuration includes the same nodes that created the DataSets.

The point here is that a data file (containing the actual data that is loaded in the DataSet) is created on each node defined in the configuration file used to create the DataSet. When reading the DataSet - all the data files for that DataSet should be accessible to the Configuration used to read.
------------------
Aneesh
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... which means that all the nodes named in the configuration file with which it was created must be accessible under the new configuration file's regime. The control file (blah.ds) contains the locations of the data files, though not readily in human-readable format.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply