Search found 307 matches

by jdmiceli
Fri Sep 28, 2007 10:22 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38438

Job concatenator

Many times there are tons of jobs that need to be moved from one server to another or fixed at the file level and then re-imported. If you have ever done an import, you know it only seems to do one file at a time (unless I'm just brain dead and haven't found a way to do it! :shock: ) This very easy ...
by jdmiceli
Fri Sep 28, 2007 10:13 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38438

Perl code to split jobs out

This first script is a job splitter. It will take a single file in DataStage export format (generally .dsx though it doesn't really matter as long as the format is there) and split it into individual jobs that can be loaded. It will provide a proper header and everything needed to correctly import t...
by jdmiceli
Fri Sep 28, 2007 10:04 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38438

Useful Perl Scripts I have written

Greetings to everyone in the DataStage community, Every now and then we see requests for utilities that will work with .DSX files for replacing values, parameters or whatever, as well as concatenators and splitters. I have written several utilities in Perl that I use all the time and that actually s...
by jdmiceli
Fri Sep 28, 2007 8:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Add new parameter and remove default value from Jobs
Replies: 10
Views: 3152

Hi all!

I have had several requests for my Perl script so I will start another thread in the General Section and post it. I will also include my other utilities just in case anyone can use them.

Bestest!
by jdmiceli
Thu Sep 27, 2007 4:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Iterating a single server job over multiple schemes
Replies: 6
Views: 2942

We do very similar processing of our databases here at work. I have 18 companies that have databases with the same structure. All of my jobs are parameterized to the utmost possible. I do everything with parameters if possible, and then pass the appropriate values in when calling the jobs to run. Th...
by jdmiceli
Thu Sep 27, 2007 4:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Use of CFF stage exits out designer client!
Replies: 3
Views: 1433

We had the same issue and had to get a patch from support. I'm not sure, but it may require SP2.


Bestest,
by jdmiceli
Wed Sep 26, 2007 4:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Add new parameter and remove default value from Jobs
Replies: 10
Views: 3152

I wrote a Perl script that does this exact thing, but it is for Server jobs. Does anyone know if the DSX files for Parallel and Server are similar in structure? If so, then I can make the script available to you to use.
by jdmiceli
Wed Sep 26, 2007 4:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Add new parameter and remove default value from Jobs
Replies: 10
Views: 3152

I wrote a Perl script that does this exact thing, but it is for Server jobs. Does anyone know if the DSX files for Parallel and Server are similar in structure? If so, then I can make the script available to you to use.
by jdmiceli
Wed Sep 26, 2007 4:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Controlling job flow by counting rows in hashed files - ???
Replies: 9
Views: 3227

Thanks, Craig! I will check into that as soon as I can.
by jdmiceli
Wed Sep 26, 2007 4:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Controlling job flow by counting rows in hashed files - ???
Replies: 9
Views: 3227

Thanks, Craig! I will check into that as soon as I can.
by jdmiceli
Wed Sep 26, 2007 10:14 am
Forum: General
Topic: About staging variables,Derivations,Constraints
Replies: 2
Views: 1885

Hi Nilesh,

You have asked a rather broad question that touches several different places in DataStage. I would suggest that you read the Server Job Developer's Guide that came with your installation of DataStage. That will explain it all for you.
by jdmiceli
Wed Sep 26, 2007 10:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Controlling job flow by counting rows in hashed files - ???
Replies: 9
Views: 3227

Controlling job flow by counting rows in hashed files - ???

Hello to all the DS Gurus! I have an interesting situation and I would like opinionions from those who may have dealt with this type of situation. Hopefully, this isn't just me having a mental speed bump and overcomplicating things. :oops: (That would be embarassing) Here is the background: I have 1...
by jdmiceli
Wed Aug 01, 2007 2:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looping in a stage
Replies: 1
Views: 1589

Re: Looping in a stage

Hi all, I have an input file in which some columns occur 0 to 50 times depending on the value of another column (For example, if DOC_COUNT=3, then DOC_CD,DOC_FLG,DOC_IND,etc. will occur 3 times) and the file contains fields like CL, BR, RR, DOC_COUNT, CUST_TP, DOC_CD, DOC_FLG, DOC_IND,... Now, I ha...
by jdmiceli
Wed Aug 01, 2007 2:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Importer errors
Replies: 4
Views: 1913

Could be that there's a design limit on the size of an XSD file (256K?). I don't know whether this is the case - just my guess - but the vendor will be able to provide a definitive answer through your support provider. Thanks, Ray! Please see my response to Craig's note above. I will be gathering j...
by jdmiceli
Wed Aug 01, 2007 1:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Importer errors
Replies: 4
Views: 1913

XSD size thoughts

I would think you'd need to ping the vendor for something like this, open a Support case. Or perhaps wait and see if Ernie will swoop down and help out. I'm curious... a 257K XSD file? And that's "your smallest"? I've never seen one more than 1/10th that size, even for our most complex. I...