Page 1 of 1

Taking ETL backups through scripts- istool

Posted: Tue Jan 07, 2014 4:27 pm
by AmeyJoshi14
Hi Experts,

We need to automate the process which takes backup of the complete project. I found the command 'istool' which we can use to export the jobs in specific folder.
Export option for istool is

istool export
authentication options
[generic options]
-archive "pathname" [-updatearchive]
[-preview ]
[-abortIfError=number_of_errors]
-datastage ' [ -base="server[:port]/project"]
[-includedependent]
[-nodesign]
[-includeexecutable]
"dsServer[:port]/project/folder/name.type" '

Is there anyway where in we can just pass the project name and it will export all the objects from that project?

Thanks in Advance!!

Posted: Tue Jan 07, 2014 6:14 pm
by chulett
Andy has a comprehensive post on 'istool' here, it should help.

Posted: Wed Jan 08, 2014 9:53 am
by AmeyJoshi14
Thanks craig for the help! :o

But the problem is we have many subfolders under the Job folder. So when I try to run the export command with "Jobs/*/*.*" option it exports the job(if any) from the 1st level of subfolder. Is there any way to select all the jobs/objects(including different level of subfolders)? :roll:

Appreciate your help!!

Thanks

Posted: Wed Jan 08, 2014 2:02 pm
by asorrell
I'm not certain why you aren't getting the sub-folders. I'm posting the command I normally use. I've removed the "-silent" option so you can see from the output that it is getting all the sub-directories. I have replaced specific host / project names since that's confidential.

Code: Select all

$ /opt/IBM/InformationServer/Clients/istools/cli/istool export -domain hostname:9080 -authfile /home/dsadm/.authfile -archive /projects/backups/projectname_20140108.isx -datastage "-incdep -base=hostname/projectname Jobs/*/*.*"

Beginning Export
 [1/48] hostname/projectname/Jobs/ADS_CCMSGLVL.sjb
 [2/48] hostname/projectname/Jobs/ADS_Test.pjb
 [3/48] hostname/projectname/Jobs/Andy\Categories\Categories.tbd
 [4/48] hostname/projectname/Jobs/Andy\Products\Products.tbd
 [5/48] hostname/projectname/Jobs/CopyOfGetFeed_BazaarVoice.pjb
 [6/48] hostname/projectname/Jobs/CopyOfseqBazaarVoice.qjb
 [7/48] hostname/projectname/Jobs/GetFeed_GPShopper.pjb
 [8/48] hostname/projectname/Jobs/INTEGRATION/COMMON/SEQ_CMN_AUDIT_STS.qjb
 [9/48] hostname/projectname/Jobs/INTEGRATION/COMMON/XFM_AUDIT_LOG.pjb
 [10/48] hostname/projectname/Jobs/INTEGRATION/COMMON/XFM_JOB_STATUS.pjb
 [11/48] hostname/projectname/Jobs/INTEGRATION/ECOM/LOAD/XFM_ECOM_ITEMRECON_LOAD.pjb
 [12/48] hostname/projectname/Jobs/INTEGRATION/ECOM/LOAD/XFM_ECOM_ITEMRECON_SMY_LOAD.pjb
 [13/48] hostname/projectname/Jobs/INTEGRATION/ECOM/SEQUENCES/SEQ_ECOM_ITEMSRECON_LOAD.qjb
 [14/48] hostname/projectname/Jobs/INTEGRATION/PARMSET/ps_Nexus.pst
 [15/48] hostname/projectname/Jobs/INTEGRATION/ztest/CopyOfSEQ_ECOM_ITEMSRECON_LOAD.qjb
 [16/48] hostname/projectname/Jobs/Prototype_GetFeed_x.pjb
 [17/48] hostname/projectname/Jobs/Ufeed/GetFeed_Easy2.pjb
 [18/48] hostname/projectname/Jobs/Ufeed/GetFeed_PMDigital.pjb
 [19/48] hostname/projectname/Jobs/Ufeed/GetStatus.sjb
 [20/48] hostname/projectname/Jobs/Ufeed/GetTimestamp.sjb
 [21/48] hostname/projectname/Jobs/Ufeed/Untitled1.qjb
 [22/48] hostname/projectname/Jobs/Ufeed/seqBazaarVoice.qjb
 [23/48] hostname/projectname/Jobs/Ufeed/seqEasy2.qjb
 [24/48] hostname/projectname/Jobs/Ufeed/seqGPShopper.qjb
 [25/48] hostname/projectname/Jobs/Ufeed/seqMonetate.qjb
 [26/48] hostname/projectname/Jobs/Ufeed/seqPMDigital.qjb
 [27/48] hostname/projectname/Jobs/Ufeed/seqVendorNet.qjb
 [28/48] hostname/projectname/Jobs/Ufeed/seqWishabi.qjb
 [29/48] hostname/projectname/Jobs/header.qjb
 [30/48] hostname/projectname/Jobs/pathtest.pjb
 [31/48] hostname/projectname/Jobs/seq_StatusCheck.qjb
 [32/48] hostname/projectname/Parameter Sets/AcademySMTP.pst
 [33/48] hostname/projectname/Parameter Sets/BazaarVoice.pst
 [34/48] hostname/projectname/Parameter Sets/ECM.pst
 [35/48] hostname/projectname/Parameter Sets/Easy2.pst
 [36/48] hostname/projectname/Parameter Sets/GPShopper.pst
 [37/48] hostname/projectname/Parameter Sets/Monetate.pst
 [38/48] hostname/projectname/Parameter Sets/PMDigital.pst
 [39/48] hostname/projectname/Parameter Sets/SqlServer.pst
 [40/48] hostname/projectname/Parameter Sets/TestSFTP.pst
 [41/48] hostname/projectname/Parameter Sets/VendorNet.pst
 [42/48] hostname/projectname/Parameter Sets/Wishabi.pst
 [43/48] hostname/projectname/Table Definitions/ODBC/UWDB32S02ES.NEXUSREP/ODBC\UWDB32S02ES.NEXUSREP\NexusAudit.RMSDEV.ETL_JOBS_STATUS.tbd
 [44/48] hostname/projectname/Table Definitions/ODBC/swdbecm02e/ODBC\swdbecm02e\UniversalFeed.dbo.X_DATASTORE_PRODUCT.tbd
 [45/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_CATEGORY.tbd
 [46/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_PRODUCT.tbd
 [47/48] hostname/projectname/Table Definitions/ODBC/uwdbecm02es/ODBC\uwdbecm02es\UniversalFeed.dbo.X_DATASTORE_STATUS.tbd
 [48/48] hostname/projectname/Transforms/SetUserStatus.srt
Elapsed time: 00:00:58
Exported 48 assets

Posted: Mon Jan 13, 2014 2:03 pm
by AmeyJoshi14
Thanks for the help. I was running different syntax. :oops: