DSXchange

In order to debug this further, I would suggest breaking the command string into its separate commands and storing results in either files or variables so that you can see what is being seen at the time by the commands. Something like the following would be one way of accomplishing this: MyWordCount...

To answer your earlier question: No, the job would not be "refreshing". But that does bring up the characteristics of the job you're testing this with: How long does it run? How are you starting/restarting it when it ends?

Regards,

Does the command line resolve to a 1 or 0 in the trace? '[' 1 -ne 0 ']' or '[' 0 -ne 0 ']' If it's resolving to 0, then the grep argument is probably not matching to what ps -ef is actually putting out and that's what you will need to concentrate on. The logic itself works (I can do the same using r...

Why wasn't it (the -x, I assume) much help? -x should have shown you how the commands executed and what the results resolved to, similar to the following: ++ ps -ef ++ grep 'phantom DSD.RUN job_jobName' ++ grep -iv -e grep -e 'SH -c' ++ wc -l + '[' 0 -ne 0 ']' You see each command that is executed. ...

Is your jobname stored in a variable, or is it hardcoded in the command (as in your example)?

Add -x to the shell executable at the top of your script: to enable the shell to trace the execution of your script.

Regards,

It's not that expensive...a column generator stage can do it, or if you already have a transformer stage in the path use that. Besides, what's more expensive: adding a single column or not being able to perform the work? Some other options are: BuildOp (C++) Custom Operator (C++) Do the lookup outsi...

To determine the appropriate dataset segments to delete, you would need to pull that info from the descriptor file which is a binary file, not text, with a non-published format that is subject to change. While you may not trust the orchadmin command 100%, I expect that rolling your own would be much...

Try creating a dummy key column in your lookup data that you can use in a range lookup: If your input value must be less than the lookup value to be a match, then the lookup derivation may be: input.value < lookup.value and input.value >= lookup.dummyvalue where dummyvalue is the lowest value you ca...

Are there additional key columns on which the join is an equality? Example: WHERE IN1.A = IN2.A and IN1.B < IN2.B ? If so, you could join on the columns which must be equal (IN1.A = IN2.A) and then use a transformer or filter to handle the inequality requirements (IN1.B < IN2.B).

Regards,

There are plenty of examples for looping in C and C++ available on the web. In fact, you are already using one method in your routine--the while loop. There are others: until is a variation on while , and for is used quite often as well. You can call as many routines as you feel necessary inside a t...

Your routine returns after comparing to the first lookup record, whether or not you get a match. You can simply change the while condition to include "&& flag == 0", remove the returns from the loop and place a return after the fclose statement. How many rows of data will you be pr...

What does your incoming data look like? Is it always in the same format (and have you verified so by looking at the data or running analysis on it)?

Can you show the StringToTimestamp() call you have written?

Regards,

What exactly is the warning you are receiving? Seeing as the source is a sequential file, is the "null" column actually an empty string (0 bytes in length) or nothing but spaces or other character value? If so, then you could simply check for that condition. For instance, if an empty strin...

Yes. I left that to the OP's discretion. When I have to do this multiple times within a single transformer, I generally create a single stage variable that matches the longest required length.

Regards,

You are likely creating a new column with a name which matches that of an input column, or you may be intentionally replacing an existing input column but never referring to that column in the output derivation (both are really the same thing, one unintentional and one not).

Regards,