Taking ETL backups through scripts- istool

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
AmeyJoshi14
Participant
Posts: 334
Joined: Fri Dec 01, 2006 5:17 am
Location: Texas

Taking ETL backups through scripts- istool

Post by AmeyJoshi14 »

Hi Experts,

We need to automate the process which takes backup of the complete project. I found the command 'istool' which we can use to export the jobs in specific folder.
Export option for istool is

istool export
authentication options
[generic options]
-archive "pathname" [-updatearchive]
[-preview ]
[-abortIfError=number_of_errors]
-datastage ' [ -base="server[:port]/project"]
[-includedependent]
[-nodesign]
[-includeexecutable]
"dsServer[:port]/project/folder/name.type" '

Is there anyway where in we can just pass the project name and it will export all the objects from that project?

Thanks in Advance!!
http://findingjobsindatastage.blogspot.com/
Theory is when you know all and nothing works. Practice is when all works and nobody knows why. In this case we have put together theory and practice: nothing works. and nobody knows why! (Albert Einstein)
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Andy has a comprehensive post on 'istool' here, it should help.
-craig

"You can never have too many knives" -- Logan Nine Fingers
AmeyJoshi14
Participant
Posts: 334
Joined: Fri Dec 01, 2006 5:17 am
Location: Texas

Post by AmeyJoshi14 »

Thanks craig for the help! :o

But the problem is we have many subfolders under the Job folder. So when I try to run the export command with "Jobs/*/*.*" option it exports the job(if any) from the 1st level of subfolder. Is there any way to select all the jobs/objects(including different level of subfolders)? :roll:

Appreciate your help!!

Thanks
http://findingjobsindatastage.blogspot.com/
Theory is when you know all and nothing works. Practice is when all works and nobody knows why. In this case we have put together theory and practice: nothing works. and nobody knows why! (Albert Einstein)
asorrell
Posts: 1707
Joined: Fri Apr 04, 2003 2:00 pm
Location: Colleyville, Texas

Post by asorrell »

I'm not certain why you aren't getting the sub-folders. I'm posting the command I normally use. I've removed the "-silent" option so you can see from the output that it is getting all the sub-directories. I have replaced specific host / project names since that's confidential.

Code: Select all

$ /opt/IBM/InformationServer/Clients/istools/cli/istool export -domain hostname:9080 -authfile /home/dsadm/.authfile -archive /projects/backups/projectname_20140108.isx -datastage "-incdep -base=hostname/projectname Jobs/*/*.*"

Beginning Export
 [1/48] hostname/projectname/Jobs/ADS_CCMSGLVL.sjb
 [2/48] hostname/projectname/Jobs/ADS_Test.pjb
 [3/48] hostname/projectname/Jobs/Andy\Categories\Categories.tbd
 [4/48] hostname/projectname/Jobs/Andy\Products\Products.tbd
 [5/48] hostname/projectname/Jobs/CopyOfGetFeed_BazaarVoice.pjb
 [6/48] hostname/projectname/Jobs/CopyOfseqBazaarVoice.qjb
 [7/48] hostname/projectname/Jobs/GetFeed_GPShopper.pjb
 [8/48] hostname/projectname/Jobs/INTEGRATION/COMMON/SEQ_CMN_AUDIT_STS.qjb
 [9/48] hostname/projectname/Jobs/INTEGRATION/COMMON/XFM_AUDIT_LOG.pjb
 [10/48] hostname/projectname/Jobs/INTEGRATION/COMMON/XFM_JOB_STATUS.pjb
 [11/48] hostname/projectname/Jobs/INTEGRATION/ECOM/LOAD/XFM_ECOM_ITEMRECON_LOAD.pjb
 [12/48] hostname/projectname/Jobs/INTEGRATION/ECOM/LOAD/XFM_ECOM_ITEMRECON_SMY_LOAD.pjb
 [13/48] hostname/projectname/Jobs/INTEGRATION/ECOM/SEQUENCES/SEQ_ECOM_ITEMSRECON_LOAD.qjb
 [14/48] hostname/projectname/Jobs/INTEGRATION/PARMSET/ps_Nexus.pst
 [15/48] hostname/projectname/Jobs/INTEGRATION/ztest/CopyOfSEQ_ECOM_ITEMSRECON_LOAD.qjb
 [16/48] hostname/projectname/Jobs/Prototype_GetFeed_x.pjb
 [17/48] hostname/projectname/Jobs/Ufeed/GetFeed_Easy2.pjb
 [18/48] hostname/projectname/Jobs/Ufeed/GetFeed_PMDigital.pjb
 [19/48] hostname/projectname/Jobs/Ufeed/GetStatus.sjb
 [20/48] hostname/projectname/Jobs/Ufeed/GetTimestamp.sjb
 [21/48] hostname/projectname/Jobs/Ufeed/Untitled1.qjb
 [22/48] hostname/projectname/Jobs/Ufeed/seqBazaarVoice.qjb
 [23/48] hostname/projectname/Jobs/Ufeed/seqEasy2.qjb
 [24/48] hostname/projectname/Jobs/Ufeed/seqGPShopper.qjb
 [25/48] hostname/projectname/Jobs/Ufeed/seqMonetate.qjb
 [26/48] hostname/projectname/Jobs/Ufeed/seqPMDigital.qjb
 [27/48] hostname/projectname/Jobs/Ufeed/seqVendorNet.qjb
 [28/48] hostname/projectname/Jobs/Ufeed/seqWishabi.qjb
 [29/48] hostname/projectname/Jobs/header.qjb
 [30/48] hostname/projectname/Jobs/pathtest.pjb
 [31/48] hostname/projectname/Jobs/seq_StatusCheck.qjb
 [32/48] hostname/projectname/Parameter Sets/AcademySMTP.pst
 [33/48] hostname/projectname/Parameter Sets/BazaarVoice.pst
 [34/48] hostname/projectname/Parameter Sets/ECM.pst
 [35/48] hostname/projectname/Parameter Sets/Easy2.pst
 [36/48] hostname/projectname/Parameter Sets/GPShopper.pst
 [37/48] hostname/projectname/Parameter Sets/Monetate.pst
 [38/48] hostname/projectname/Parameter Sets/PMDigital.pst
 [39/48] hostname/projectname/Parameter Sets/SqlServer.pst
 [40/48] hostname/projectname/Parameter Sets/TestSFTP.pst
 [41/48] hostname/projectname/Parameter Sets/VendorNet.pst
 [42/48] hostname/projectname/Parameter Sets/Wishabi.pst
 [43/48] hostname/projectname/Table Definitions/ODBC/UWDB32S02ES.NEXUSREP/ODBC\UWDB32S02ES.NEXUSREP\NexusAudit.RMSDEV.ETL_JOBS_STATUS.tbd
 [44/48] hostname/projectname/Table Definitions/ODBC/swdbecm02e/ODBC\swdbecm02e\UniversalFeed.dbo.X_DATASTORE_PRODUCT.tbd
 [45/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_CATEGORY.tbd
 [46/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_PRODUCT.tbd
 [47/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_STATUS.tbd
 [48/48] hostname/projectname/Transforms/SetUserStatus.srt
Elapsed time: 00:00:58
Exported 48 assets
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
AmeyJoshi14
Participant
Posts: 334
Joined: Fri Dec 01, 2006 5:17 am
Location: Texas

Post by AmeyJoshi14 »

Thanks for the help. I was running different syntax. :oops:
http://findingjobsindatastage.blogspot.com/
Theory is when you know all and nothing works. Practice is when all works and nobody knows why. In this case we have put together theory and practice: nothing works. and nobody knows why! (Albert Einstein)
Post Reply