Tool to export jobs without their related shared container

holymac · Post by **holymac** » Thu Dec 14, 2006 1:28 am

Dear All,

Our warehouse project has about 3000 jobs and we need to export the job designs[not the executables] individually without their related shared containers included.

I am using a tool to export the jobs individually which uses "dsexport" but it is including the shared containers as well.

Is there a way for me to export this 3000 jobs separately without including the shared containers apart from exporting them one by one using DS Manager?

Thank you in advance.

kduke · Post by **kduke** » Thu Dec 14, 2006 7:11 am

I posted some new scripts on the 2 links below my sig. The new script was DataStageExport.bat. Do a search for this. Basically it requires a JobList.txt file to be setup in a folder with the project name. This list of jobs will get exported one at a time.

There is a similar command for importing these called DataStageImport.bat. This command will import all dsx files in this directory. This could be used to promote these jobs from dev to test to prod.

kduke · Post by **kduke** » Thu Dec 14, 2006 7:13 am

There is also a Perl script which someone posted to split a full export into one per job. I think it is called DsxParse.pl.

chulett · Post by **chulett** » Thu Dec 14, 2006 7:37 am

"dsx cutter" from what I recall. Oh wait, that was Wolfgang's. You're right, I believe, I seem to recall seeing a goodly amount of Perl posted here somewhere.

Cowmix · Post by **Cowmix** » Tue Jan 02, 2007 1:31 am

kduke wrote:There is also a Perl script which someone posted to split a full export into one per job. I think it is called DsxParse.pl.

BTW.. I think I just found an error with the ParseDSX.pl that might be a show-stopper for some people out there. The error (again.. I think) is if you have a line in your DSX that has 'special charaters' in it, the parser seems to toss it out.. for instance:

Code: Select all

         Default "$UNSET"

or

Code: Select all

         Default "QQW@G;N1?9GO"

Both those lines, for instance, were dropped in a DSX dump I had it recently process.

Cowmix · Post by **Cowmix** » Tue Jan 02, 2007 1:34 am

holymac wrote:Dear All,

Our warehouse project has about 3000 jobs and we need to export the job designs[not the executables] individually without their related shared containers included.

I am using a tool to export the jobs individually which uses "dsexport" but it is including the shared containers as well.

Is there a way for me to export this 3000 jobs separately without including the shared containers apart from exporting them one by one using DS Manager?

Thank you in advance.

"dscmdexport.exe" exports everything, but in order so the jobs are always first.. Can't you just cut away everything below where the job export ends?

jdmiceli · Post by **jdmiceli** » Thu Oct 04, 2007 4:17 pm

Follow this link for a Perl parser that should have no show stoppers (famous last words of course!):

viewtopic.php?t=113429&highlight=perl

Bestest!

kduke · Post by **kduke** » Fri Oct 05, 2007 8:08 am

Preston took one of these and cut out the dependent objects so now our migration script can run unattended. Very cool. We do not need to click on No to not overwrite the shared containers.

kirankota79 · Post by **kirankota79** » Wed Jun 18, 2008 8:49 am

kduke wrote:I posted some new scripts on the 2 links below my sig. The new script was DataStageExport.bat. Do a search for this. Basically it requires a JobList.txt file to be setup in a folder with the project name. This list of jobs will get exported one at a time.

There is a similar command for importing these called DataStageImport.bat. This command will import all dsx files in this directory. This could be used to promote these jobs from dev to test to prod.

Duke:
I am always getting the error like the below one. Can you please tell me how to setup the directory structure? I am planning to export a whole project using your script. If this runs i want to use it for other projects too.

Bad/Non-existing directory: D:\DatastageBackups\KiranTest

Please ensure that you have permission to access/create directories
and files. Also ensure that directory listed exists.

The syntax of the command is incorrect.

Thanks

kirankota79 · Post by **kirankota79** » Wed Jun 18, 2008 8:58 am

just to let you know..i am doing this for parallel jobs

ray.wurlod · Post by **ray.wurlod** » Wed Jun 18, 2008 4:46 pm

There's a great tool called DataStage Manager that can do precisely what you require.

chulett · Post by **chulett** » Wed Jun 18, 2008 6:36 pm

Wow... you can schedule the Manager to run unattended and export all projects on a Server to date stamped directories?

(

)

ray.wurlod · Post by **ray.wurlod** » Wed Jun 18, 2008 8:42 pm

Operator.

DS_SUPPORT · Post by **DS_SUPPORT** » Wed Jun 18, 2008 11:17 pm

How we can schedule the exports from Manager? Can you refer to any documents?

chulett · Post by **chulett** » Wed Jun 18, 2008 11:21 pm

I was being sarcastic. And did you not see Ray's reply? You 'schedule' it by having an Operator perform the function on a regular basis.

DSXchange

Tool to export jobs without their related shared container

Tool to export jobs without their related shared container

Re: Tool to export jobs without their related shared contain