Search found 307 matches

by jdmiceli
Mon Oct 08, 2007 9:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dynamically processing csv files based on header row
Replies: 8
Views: 3765

Please let me know if it worked or if there is something I can do to improve the script. I am adding this to my directories of utilities I have written. I have also added it to the open topic I have for Perl scripts I have made available for anyone to use. I figure maybe having a bunch in one place ...
by jdmiceli
Fri Oct 05, 2007 1:29 pm
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38455

Pivot script for text file

This script will take a text file and pivot the values on the first field. It assumes the header is the first row of the file and that the first field in each row is the key. All you have to do is put the program in the directory where your file is (or vice versa) and pass it the name of the file, t...
by jdmiceli
Fri Oct 05, 2007 1:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dynamically processing csv files based on header row
Replies: 8
Views: 3765

Potential solution

Hi Dave (and anyone else that may be interested), I have a potential solution to this problem for you to try. You are welcome to use it as you see fit and modify it to suit your needs. If you don't have Perl installed, go to Activestate and get it. It is standard on any Unix/Linux install and I wrot...
by jdmiceli
Fri Oct 05, 2007 8:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dynamically processing csv files based on header row
Replies: 8
Views: 3765

How many rows are you working with? 100,000 per minute is pretty slow especially if you are working with a significant data set. I'll try to put something together for you in Perl real quick and see if I can't improve on the speed. Any chance you could send me the file winzipped? If so, send to jmic...
by jdmiceli
Thu Oct 04, 2007 4:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dynamically processing csv files based on header row
Replies: 8
Views: 3765

Hi Dave, Stepping outside of DataStage, you could use a Perl script to do this for you. If it were programmed correctly, there would be no issue with changing parameters AS LONG AS the first field is always the KEY. The Perl script would then just create a new file for you with the pivoted values. I...
by jdmiceli
Thu Oct 04, 2007 4:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Stange behaviour...file size in Unix(AIX) is 0
Replies: 15
Views: 5738

Is it possible a temp file is being built wherever tempspace is defined for and that it will not flush to the destination file until the entire process is finished? I would think there would be buffer writes if this were the case, but maybe for some reason it is doing the whole there. Just a thought...
by jdmiceli
Thu Oct 04, 2007 4:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: The string representation of a datetime value is out of rang
Replies: 7
Views: 10169

If you change the field length, I think you also have to change the Display length. DB2 defaults the format of timestamps to YYYY-MM-DD HH:MM:SS.mmmmmm (I think). If the process is converting that to char or varchar, then you need more than 18 or you will truncate. Don't know if that helps or not! :...
by jdmiceli
Thu Oct 04, 2007 4:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Tool to export jobs without their related shared container
Replies: 15
Views: 7554

Follow this link for a Perl parser that should have no show stoppers (famous last words of course!):

viewtopic.php?t=113429&highlight=perl

Bestest!
by jdmiceli
Thu Oct 04, 2007 4:03 pm
Forum: General
Topic: I need a DSX-Cutter
Replies: 48
Views: 68034

Here is a link for a bunch of Perl scripts I have written, including a cutter, joiner, and parameter block replacer. Feel free to use them!

viewtopic.php?t=113429&highlight=perl

Bestest!
by jdmiceli
Thu Oct 04, 2007 3:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading/Parsing a weblog file
Replies: 3
Views: 1771

Hi Gents! Doing this in Perl would not be too tough. :? Notice that I say that without actually having more than what I see here. It would probably take any hour or two to come up with something that could parse that formatted file into the structure you want. Would you want to drop it into a sequen...
by jdmiceli
Thu Oct 04, 2007 3:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Add new parameter and remove default value from Jobs
Replies: 10
Views: 3178

This thread has multiple utilities to work with .dsx and other files (in Perl):

viewtopic.php?t=113429&highlight=perl

I hope it help!

Bestest,
by jdmiceli
Fri Sep 28, 2007 11:12 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38455

Change parameter block completely in export file

This perl script is great when it comes time for a team like Release Management to release your new code to a different environment. This may be needed to change your default parameters for all jobs in the export file (unless, of course, you are using one of a several job control methods where you p...
by jdmiceli
Fri Sep 28, 2007 10:58 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38455

dos to unix perl script

Here is the last scripts opposite, turning dos files to unix terminations. Usage is perl dos2unix.pl directoryname . #!/usr/bin/perl -w # A script to convert Windoze files to Unix line termination format. # WARNING: THIS SCRIPT DOES NOT CHECK FOR PRE-EXISTING # FILE, USE WITH CAUTION # usage: dos2un...
by jdmiceli
Fri Sep 28, 2007 10:56 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38455

unix to dos converter

This perl utility is a simple unix to dos converter. I wish I could take complete credit for it, but it is a pretty basic item and most of the code is lifted from a book (though I don't remember right off which one to give proper credit). Just know I am not claiming it solely as my own, though I did...
by jdmiceli
Fri Sep 28, 2007 10:47 am
Forum: General
Topic: Useful Perl Scripts I have written
Replies: 24
Views: 38455

sorting script

I also do a lot of table name extraction to a file or whatever and then use VI or Vim to do substitutions to add the rest of what I want in front of and behind the names. Sometimes I forgot to order things, so I wrote this little sorting script with the option of sorting ascending or descending. Thi...