Creating new Dynamic VOC file and replacing the VOC file

sreddy666 · Post by **sreddy666** » Wed Feb 01, 2012 4:03 am

HI All,

I am importing files of large size, so import process is taking huge amount of time to import.

To over come above problem, i have followed steps from IBM to create new dynamic file and replace with existing VOC file.

Steps i followed.
------------------

1.Make sure no DataStage Clients are connected to the project which will have it's VOC changed.
2.Change directory to the DSEngine directory.
3.Source the dsenv
$ . ./dsenv
4.Execute the following:
$ bin/uvsh
> LOGTO <project name>
> CREATE.FILE VOC.NEW DYNAMIC
> COPY FROM VOC TO VOC.NEW ALL
> QUIT
5.Change directory to the project's directory
6.Execute the following:
$ mv VOC VOC.orig
$ mv VOC.NEW VOC

Now the issue is: when i am doing 6 step (i.e mv VOC.NEW VOC) VOC folder is creating instead of file.

Could any one help out of this...

THanks in advance...

chulett · Post by **chulett** » Wed Feb 01, 2012 7:47 am

From the linked instructions:

Changing the VOC file from a static file to a dynamic file speeds up the updating of the VOC.

You don't have an issue, keep on going. In all honesty, if you don't understand why I don't think you should be in there doing something of this nature.

ps. Your 'folder' came from step 4, not step 6.

sreddy666 · Post by **sreddy666** » Wed Feb 01, 2012 11:14 am

HI Crag,

But now VOC file is not present in Projects/Projectname> folder only VOC folder exists.

chulett · Post by **chulett** » Wed Feb 01, 2012 12:22 pm

And what is in this "VOC folder"?

ray.wurlod · Post by **ray.wurlod** » Wed Feb 01, 2012 2:57 pm

DATA.30, OVER.30 and .Type30 files.

This is because the new VOC was created as a dynamic hashed file rather than the usual static hashed file.

There's no good reason for doing this, imho. Can you please ask IBM support why they suggested it?

chulett · Post by **chulett** » Wed Feb 01, 2012 4:19 pm

Sheesh... we know the answer Ray, it was meant to be answered by the OP.

sreddy666 · Post by **sreddy666** » Wed Feb 01, 2012 11:32 pm

HI Craig & Ray,

Thanks for your reply's.. Yes we have those 3 files in VOC folder.., As per you suggestion that , this process won't help much.. Could you please suggest me any other method for reducing import time for large files...

This .dsx files are provided by IBM as Peoplesoft EPM .. I am importing those files to new project.. , I am using Datastage Designer for import process...

Thanks in advance.

chulett · Post by **chulett** » Thu Feb 02, 2012 9:51 am

Out of curiousity, just how large are these files? Any idea how many objects they contain to be imported? And just how long is this 'huge amount of time' are we talking about to import them?

This should only be a one time process so wondering if there is really an issue or not...

sreddy666 · Post by **sreddy666** » Thu Feb 02, 2012 10:17 am

Hi Craig,

File size ranges b/w 100000 KB to 225000 KB. Each file contains more than 1500 objects.. , if i select whole file to import its running more than 5 hrs.. and I am facing VPN n/w issues.. and datastage connection is lossing , so i am selecting only 200 objects to import and its taking 2-3 hrs..

qt_ky · Post by **qt_ky** » Thu Feb 02, 2012 10:04 pm

1. Don't attempt any large DSX import from your client over a slow or unreliable VPN, ever. Is that clear? It will likely fail most every time--because of the VPN. Instead, do it from within the office on the local network (not wireless either), or via some remote desktop that is local on the network. In the latter case, VPN is OK, because the only VPN traffic is to display the remote desktop that's in the office. Most likely you will be stuck until you are able to avoid importing over the VPN.

2. On import, "deselect the Perform Impact Analysis checkbox" (from the Designer Client guide). This WILL speed up imports. However, impact analysis can be valuable to have, so I would recommend against this option and focus on eliminating VPN problems.

sreddy666 · Post by **sreddy666** » Fri Feb 03, 2012 12:06 am

1> our server is located at onsite and clients are installed on our Desktops.. so we are using VPN to establish connection..., We are trying to get one remote desktop .. it's in process...,

2> Yes , i am unchecking Perform Impact analysis box while doing import..

chulett · Post by **chulett** » Fri Feb 03, 2012 8:21 am

Stop quoting everything every dang time you post. Please. There's a perfectly good Reply to quote button down there, please learn to use it. Then I can stop constantly cleaning up after you.

If you are "onsite" with the server, why in the world are you using VPN to connect? That should only be for remote users.

qt_ky · Post by **qt_ky** » Fri Feb 03, 2012 3:13 pm

I think you are saying you are not on the same site where the server is, is that right? Continue pushing for remote desktop connectivity, as that is the answer. Your best best will be to have one remote desktop available per remote developer or you're likely to continue having annoying problems even after you get a successful import.

qt_ky · Post by **qt_ky** » Sat Feb 04, 2012 10:08 am

I read that as the server is onsite and desktops are offsite... The other option besides a remote desktop is to get a very fast, reliable network connection to the server site. Your current infrastructure clearly does not support the type of work you are attempting.

Post by **daignault** » Sat Feb 04, 2012 10:30 am

Depending on your Datastage revision, there is a unix based import process for DSX files. Move the DSX file to unix directory execute the unix shell script.

It's the InformationServer/ASBNode/bin/DSXImportService.sh command. Perform the import from here and you don't have to worry about the VPN.

Regards,

Ray D