Search found 307 matches
- Mon Oct 08, 2007 9:12 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Dynamically processing csv files based on header row
- Replies: 8
- Views: 3765
Please let me know if it worked or if there is something I can do to improve the script. I am adding this to my directories of utilities I have written. I have also added it to the open topic I have for Perl scripts I have made available for anyone to use. I figure maybe having a bunch in one place ...
- Fri Oct 05, 2007 1:29 pm
- Forum: General
- Topic: Useful Perl Scripts I have written
- Replies: 24
- Views: 38455
Pivot script for text file
This script will take a text file and pivot the values on the first field. It assumes the header is the first row of the file and that the first field in each row is the key. All you have to do is put the program in the directory where your file is (or vice versa) and pass it the name of the file, t...
- Fri Oct 05, 2007 1:25 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Dynamically processing csv files based on header row
- Replies: 8
- Views: 3765
Potential solution
Hi Dave (and anyone else that may be interested), I have a potential solution to this problem for you to try. You are welcome to use it as you see fit and modify it to suit your needs. If you don't have Perl installed, go to Activestate and get it. It is standard on any Unix/Linux install and I wrot...
- Fri Oct 05, 2007 8:25 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Dynamically processing csv files based on header row
- Replies: 8
- Views: 3765
How many rows are you working with? 100,000 per minute is pretty slow especially if you are working with a significant data set. I'll try to put something together for you in Perl real quick and see if I can't improve on the speed. Any chance you could send me the file winzipped? If so, send to jmic...
- Thu Oct 04, 2007 4:43 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Dynamically processing csv files based on header row
- Replies: 8
- Views: 3765
Hi Dave, Stepping outside of DataStage, you could use a Perl script to do this for you. If it were programmed correctly, there would be no issue with changing parameters AS LONG AS the first field is always the KEY. The Perl script would then just create a new file for you with the pivoted values. I...
- Thu Oct 04, 2007 4:34 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Stange behaviour...file size in Unix(AIX) is 0
- Replies: 15
- Views: 5738
Is it possible a temp file is being built wherever tempspace is defined for and that it will not flush to the destination file until the entire process is finished? I would think there would be buffer writes if this were the case, but maybe for some reason it is doing the whole there. Just a thought...
- Thu Oct 04, 2007 4:29 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: The string representation of a datetime value is out of rang
- Replies: 7
- Views: 10169
If you change the field length, I think you also have to change the Display length. DB2 defaults the format of timestamps to YYYY-MM-DD HH:MM:SS.mmmmmm (I think). If the process is converting that to char or varchar, then you need more than 18 or you will truncate. Don't know if that helps or not! :...
- Thu Oct 04, 2007 4:17 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Tool to export jobs without their related shared container
- Replies: 15
- Views: 7554
Follow this link for a Perl parser that should have no show stoppers (famous last words of course!):
viewtopic.php?t=113429&highlight=perl
Bestest!
viewtopic.php?t=113429&highlight=perl
Bestest!
- Thu Oct 04, 2007 4:03 pm
- Forum: General
- Topic: I need a DSX-Cutter
- Replies: 48
- Views: 68034
Here is a link for a bunch of Perl scripts I have written, including a cutter, joiner, and parameter block replacer. Feel free to use them!
viewtopic.php?t=113429&highlight=perl
Bestest!
viewtopic.php?t=113429&highlight=perl
Bestest!
- Thu Oct 04, 2007 3:58 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Reading/Parsing a weblog file
- Replies: 3
- Views: 1771
Hi Gents! Doing this in Perl would not be too tough. :? Notice that I say that without actually having more than what I see here. It would probably take any hour or two to come up with something that could parse that formatted file into the structure you want. Would you want to drop it into a sequen...
- Thu Oct 04, 2007 3:48 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Add new parameter and remove default value from Jobs
- Replies: 10
- Views: 3178
This thread has multiple utilities to work with .dsx and other files (in Perl):
viewtopic.php?t=113429&highlight=perl
I hope it help!
Bestest,
viewtopic.php?t=113429&highlight=perl
I hope it help!
Bestest,
- Fri Sep 28, 2007 11:12 am
- Forum: General
- Topic: Useful Perl Scripts I have written
- Replies: 24
- Views: 38455
Change parameter block completely in export file
This perl script is great when it comes time for a team like Release Management to release your new code to a different environment. This may be needed to change your default parameters for all jobs in the export file (unless, of course, you are using one of a several job control methods where you p...
- Fri Sep 28, 2007 10:58 am
- Forum: General
- Topic: Useful Perl Scripts I have written
- Replies: 24
- Views: 38455
dos to unix perl script
Here is the last scripts opposite, turning dos files to unix terminations. Usage is perl dos2unix.pl directoryname . #!/usr/bin/perl -w # A script to convert Windoze files to Unix line termination format. # WARNING: THIS SCRIPT DOES NOT CHECK FOR PRE-EXISTING # FILE, USE WITH CAUTION # usage: dos2un...
- Fri Sep 28, 2007 10:56 am
- Forum: General
- Topic: Useful Perl Scripts I have written
- Replies: 24
- Views: 38455
unix to dos converter
This perl utility is a simple unix to dos converter. I wish I could take complete credit for it, but it is a pretty basic item and most of the code is lifted from a book (though I don't remember right off which one to give proper credit). Just know I am not claiming it solely as my own, though I did...
- Fri Sep 28, 2007 10:47 am
- Forum: General
- Topic: Useful Perl Scripts I have written
- Replies: 24
- Views: 38455
sorting script
I also do a lot of table name extraction to a file or whatever and then use VI or Vim to do substitutions to add the rest of what I want in front of and behind the names. Sometimes I forgot to order things, so I wrote this little sorting script with the option of sorting ascending or descending. Thi...