Moving Datasets between servers

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
netboyks
Participant
Posts: 20
Joined: Sat Mar 08, 2003 7:43 am

Moving Datasets between servers

Post by netboyks »

Could anyone let me know if there is a utility to move Datasets between two servers (from version 6.x Server to 7.5 Server).
Thanks
Netboyks
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi,
why do you need to do that?
I think that if you have the source simply rebuild the data set on your new server.
I don't have EE avail to check if there is a orcadm command for that, or if the 2 versions are compatible in that aspect.
did you check the upgrade guide for any notes regarding this? (if there are any).

IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
T42
Participant
Posts: 499
Joined: Thu Nov 11, 2004 6:45 pm

Post by T42 »

Datasets are NOT portable between 6.x and 7.x. Period. The structure within 6.x datasets and 7.x datasets have changed enough to break the interface.
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Yea but to give a work around, if you can call it that,
if you have the source, even if only in DS V6 data set, you can build a sequential file then process that file with your 7 version to build a new data set.
you might need to transfer the seq file to the 7 version in some mannor or setup access to it's location but you'll get the job done ;)

IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
lcduddridge
Participant
Posts: 8
Joined: Tue Nov 16, 2004 12:34 pm

Post by lcduddridge »

Yes. You can copy dataset from one machine to another. I have done it. I copied from Ver6.0 to Ver 7.1 on Solaris machine.

This process is not straight forward. I have to set NFS mount point between the machines and use modified config.apt file and copied between the machines. (Use Orchadmin or osh command to copy)

One known problem between the datasets are varchar. You have to get patch for it. It is a headache. Only Ascential and ValueCap (ex-PX developers) can do this.

I would recommend to create small jobs to read the dataset and dump into a sequential file. Then move all sequential file to new machine and reverse it to dataset (if you have schema definition, you can use osh to create it easily).

Good luck.
dsxuserrio
Participant
Posts: 82
Joined: Thu Dec 02, 2004 10:27 pm
Location: INDIA

Post by dsxuserrio »

netboyks
First make sure your new config.apt is using the same nodes as the old config.apt.

Using the new libraries try the following three commands.

dsrecords olddataset.ds
orchadmin describe -s olddataset.ds
orchadmin dump -p 1000 -name olddatset.ds

If these three work fine, most likely you can do one of the following to copy successfully

orchadmon copy

or

osh "modify 'drop junk' < olddataset.ds > newdataset.ds"

The last resort is using sequential files.
Thanks
dsxuserrio

Kannan.N
Bangalore,INDIA
Post Reply