DSXchange

Take your Routine and paste the logic into a Batch:: style job. Add DSLogInfo() lines to write output to the job log. For developing long routines or functions this can be a useful device. Once you figure out where your logic goes bad, you'll be able to fix your actual Routine. Thanks Ken, I'll try...

Hi Craig, Well... you are simply setting it to the value of "Temp" so whatever is in there at the time is what you end up with. Is this a leftover value from a previous step that did not get cleared perhaps? The only place I see that value is in DataColumns<36> but it is in the ValidateCol...

Thanks Kim, I appreciate the input. Regardless of whether I walk away from this approach or not, does anyone have an idea why: GL4Product: * No validation but need to save value of GL4Product for later use ; GL4Product = Temp; RETURN(0) would turn: Audit="" (as proven by debugging statemen...

*** I've edited this post to include the entire routine and added the log results *** Hi, This post is related to http://www.dsxchange.com/viewtopic.php?t=126507. Scroll down to my second post in that thread. First of all, apologies for the long post. I'd considered putting the code on Google docs,...

Did you not know that you can rearrange the order of any grid in DataStage? Select the "key" column - usually the leftmost - and slide it up or down, usually using the right mouse button for the drag/drop but just occasionally the left (ya gotta love the consistency). Create a new job - y...

I coded all the "mandatory" validations per my initial posting. I've now found I missed a number of "additional constraint" validations from the specification. I'd like the code to be written in the same order as the source data column specification in the spec, and I'd like the ...

Hi, I have a job where I need to do data validations on about 50 columns, and reject the row if any column fails validation. My current approach is something like (incoming link is "Extract"): Stage Variables C1-C50, plus Audit and InvalidRecord C1: If Not(Extract.Var1 Matches "FOO&qu...

I would write a script that would check the existence of the file and move it to the new directory. Either write "File Exists" / "File Does Not Exist" to STDOUT or pass a return code. Call this script from a ExecCmd stage in a sequence job. Pass the cmd output as a job parameter ...

In my script I am saving the wordcounts of CSV files to /opt/IBM/count_<<yesterdays date>.txt and i need to call this as the input file in the sequential stage. seq.stage--->Trf---->ODBC.Stage. i want to use before sub routine and the script will give me the file in the above format. but i want to ...

What's nice about the transformer stage is it's easy to drag columns from the input to output links and vice versa. When I'm working with a stage that doesn't support this, what works for me is to save the metadata from the desired (old) link, then copying that to the new link. So, in this scenario,...

Thanks Craig. The question was in relation to viewtopic.php?t=126366&highlight=.

My workaround was essentially the 'pre-count' approach, joining the table back with itself based on the RowNum.

Several approaches: 1. Process the input line as one long string. Which I'm already doing to validate that the source file contains required number of columns. For this conversion, it needs to be exactly tilde-space{1,}-tilde , to tilde-tilde . Other fields may have one or more embedded spaces which...

Thanks. Does DS have the equivalent of:
i.e. replace tilde-one or more spaces-tilde to tilde-tilde, in a transformer? Otherwise I'd use a sed script to pre-process the file.

Revisiting this topic... If my tilde delimited sequential file has data like: FOO~ ~BAR~ ~ ~BLAH are there settings in the format tab of the sequential file stage that will convert the embedded spaces to empty string, i.e. '' rather than ' ' In the format tab of my sequential stage, I'm trying: LHS:...

or simply sort the incoming data and append to existing using stage variable. Something like sort input -> tx -> hashed file and in tx do yourStgField = if (prevKey = Key) then inField Else yourStgField : delim : inField where yourStgField is a stage variable. Sainath's reply gave me a few ideas......