Page 1 of 2
Tool to export jobs without their related shared container
Posted: Thu Dec 14, 2006 1:28 am
by holymac
Dear All,
Our warehouse project has about 3000 jobs and we need to export the job designs[not the executables] individually without their related shared containers included.
I am using a tool to export the jobs individually which uses "dsexport" but it is including the shared containers as well.
Is there a way for me to export this 3000 jobs separately without including the shared containers apart from exporting them one by one using DS Manager?
Thank you in advance.
Posted: Thu Dec 14, 2006 7:11 am
by kduke
I posted some new scripts on the 2 links below my sig. The new script was DataStageExport.bat. Do a search for this. Basically it requires a JobList.txt file to be setup in a folder with the project name. This list of jobs will get exported one at a time.
There is a similar command for importing these called DataStageImport.bat. This command will import all dsx files in this directory. This could be used to promote these jobs from dev to test to prod.
Posted: Thu Dec 14, 2006 7:13 am
by kduke
There is also a Perl script which someone posted to split a full export into one per job. I think it is called DsxParse.pl.
Posted: Thu Dec 14, 2006 7:37 am
by chulett
"dsx cutter" from what I recall. Oh wait, that was Wolfgang's. You're right, I believe, I seem to recall seeing a goodly amount of Perl posted here somewhere.
Posted: Tue Jan 02, 2007 1:31 am
by Cowmix
kduke wrote:There is also a Perl script which someone posted to split a full export into one per job. I think it is called DsxParse.pl.
BTW.. I think I just found an error with the ParseDSX.pl that might be a show-stopper for some people out there. The error (again.. I think) is if you have a line in your DSX that has 'special charaters' in it, the parser seems to toss it out.. for instance:
or
Both those lines, for instance, were dropped in a DSX dump I had it recently process.
Re: Tool to export jobs without their related shared contain
Posted: Tue Jan 02, 2007 1:34 am
by Cowmix
holymac wrote:Dear All,
Our warehouse project has about 3000 jobs and we need to export the job designs[not the executables] individually without their related shared containers included.
I am using a tool to export the jobs individually which uses "dsexport" but it is including the shared containers as well.
Is there a way for me to export this 3000 jobs separately without including the shared containers apart from exporting them one by one using DS Manager?
Thank you in advance.
"dscmdexport.exe" exports everything, but in order so the jobs are always first.. Can't you just cut away everything below where the job export ends?
Posted: Thu Oct 04, 2007 4:17 pm
by jdmiceli
Follow this link for a Perl parser that should have no show stoppers (famous last words of course!):
viewtopic.php?t=113429&highlight=perl
Bestest!
Posted: Fri Oct 05, 2007 8:08 am
by kduke
Preston took one of these and cut out the dependent objects so now our migration script can run unattended. Very cool. We do not need to click on No to not overwrite the shared containers.
Posted: Wed Jun 18, 2008 8:49 am
by kirankota79
kduke wrote:I posted some new scripts on the 2 links below my sig. The new script was DataStageExport.bat. Do a search for this. Basically it requires a JobList.txt file to be setup in a folder with the project name. This list of jobs will get exported one at a time.
There is a similar command for importing these called DataStageImport.bat. This command will import all dsx files in this directory. This could be used to promote these jobs from dev to test to prod.
Duke:
I am always getting the error like the below one. Can you please tell me how to setup the directory structure? I am planning to export a whole project using your script. If this runs i want to use it for other projects too.
Bad/Non-existing directory: D:\DatastageBackups\KiranTest
Please ensure that you have permission to access/create directories
and files. Also ensure that directory listed exists.
The syntax of the command is incorrect.
Thanks
Posted: Wed Jun 18, 2008 8:58 am
by kirankota79
just to let you know..i am doing this for parallel jobs
Posted: Wed Jun 18, 2008 4:46 pm
by ray.wurlod
There's a great tool called DataStage Manager that can do precisely what you require.
Posted: Wed Jun 18, 2008 6:36 pm
by chulett
Wow... you can schedule the Manager to run unattended and export all projects on a Server to date stamped directories?
(
)
Posted: Wed Jun 18, 2008 8:42 pm
by ray.wurlod
Operator.
Posted: Wed Jun 18, 2008 11:17 pm
by DS_SUPPORT
How we can schedule the exports from Manager? Can you refer to any documents?
Posted: Wed Jun 18, 2008 11:21 pm
by chulett
I was being sarcastic. And did you not see Ray's reply? You 'schedule' it by having an Operator perform the function on a regular basis.