DSXchange

You may also want to consider that if the ftp processes available with DataStage are extremely slooooooooowwww. If you are dealing with larger files, you will spend a lot of time waiting. You may want to consider utilizing a wait for file stage in a sequence, but use another mechanism for actually p...

If your data is in a sequential file, there is a perl script on the site in the General Forum that will do it for you. Look carefully to make sure it does what you want. It is pretty fast and easy to use. I don't have the link handy at the moment, but just search for Perl Scripts posted by jdmiceli.

If your data is in a sequential file, there is a perl script on the site in the General Forum that will do it for you. Look carefully to make sure it does what you want. It is pretty fast and easy to use. I don't have the link handy at the moment, but just search for Perl Scripts posted by jdmiceli.

Is the info you are looking for a count? A single dataset? Can it be defined as a user defined SQL? Does the SQL need to change each time?

These are the first questions that pop to my mind.

Provide some more background and details and we might be able to give you more.

I just noticed you are using parallel, not server edition. I am afraid I have no idea how to do it in parallel. I searched for some things in the Parallel forum and the only option I see for you is the Convert function. Sorry, I tried...

Try the eReplace(InLink.field, "attn: "," ") and see what happens. That goes in the derivation field in the transform stage for the field you are looking at. You may even have to make it a stage variable, but I doubt it.

You could use a Sequence job to and schedule that. Set up the wait for file stage to look for the touch file.

ADMINISTRATOR: please move this topic to the Parallel forum!

Came up with another option that should do what you want: use eReplace() instead. It would look something like this: eReplace(<fieldname,linkname,etc>, "<String to replace>", "<replacement values>", [# of instances to replace], [occurance to start from]) - the last two are option...

Just for clarification, are you wanting to replace an entire string 'XYZ' or any incidents of ('X','Y','Z')? Convert is probably what you want, but make sure you remember how it works. This is from the docs: Syntax Convert (list, new.list, string) list is a list of characters to replace. If list is ...

Here is a sample batch clean up script. Right now, I have a process that runs each night for 18 different companies using the same DataStage jobs. I pass in parameters that identify the companies and the batches they are on, but the same thing happens for all of them. Since I am moving a fair amount...

Of course, if you like Perl (as I do), you could put something like this in your path somewhere (maybe common scripts directory) and be able to run it from anywhere: #!/user/local/bin/perl -w # # program name: FileSorter.pl # Purpose : To sort a flat file taking into account the header # row if it e...

another thing to consider is what kind of delimiter you are using in the file. If it is a flat file and the source process that built the original file didn't put a representation for NULL in the file, I'm not sure how you could capture it. However, if the original creation process used something li...

You could also use an after job ExecSH command to do a quick line count.
Something along the lines of :
wc -l #filename# >> countfilename

Just a thought.

Never mind! I found a way. If you are not married to the command line option, you can use DataStage Manager to do a Multi Job compile. It is under the Tools menu, then choose 'Run Multiple Job Compile'.

Works like a champ!