DSXchange

As your state file is on NAS/NFS, I would recommend specifying a block size rather than using the system-selected option. You could try a value of 10000 or 20000 and adjust higher or lower from there. The goal is to reduce the number of I/O requests to the file (open/close/read/write) over the NFS c...

ya think?

Convert column 2 from a string to a numeric datatype, such as integer or decimal, before sorting.

Regards,

Does your job (and hence the transformer) run only on the compute node, or does it also use the conductor node as a compute node?

What is the block size you are using with the surrogate key?

Regards,

That error usually occurs when the listed parameter isn't present in the value file. Try creating a new valuefile using the GUI interface, populating those parameters with the same values as in your current file. Compare the two valuefiles to see if there are any differences, and also try running th...

Your parameter set valuefile is located in the wrong directory. As parameter sets are project-specific, their valuefiles are stored under the project home directory. See the documentation under Parameter Set Dialog Box - Values Page for a Windows-based example, easily converted to Linux/Unix. For ds...

So long as you understand that the approach I was suggesting is simply aimed at keeping a best or desired value, when present, over all others in the key group. That's what my use of the term "best value" means in this example.

Regards,

Good point. My initial read on it was keeping a "best value", but based on the samples, the requirement could be a simple summation for which an aggregator is the better approach. To answer the looping question: Looping can be used, but is not necessary for the simple best value approach I...

I mentioned how you could detect the key change in my first post. Use key change detection to know when a new key group is present (either keyChange from a sort stage or compare to previous row's values) How to generate the keyChange column in Sort is documented. Stage variables (plural). You need a...

For the first record you encounter in a key group, copy the column values into stage variables. For subsequent records, copy only the 1s into stage variables. In the constraint of your output link, use the LastRowInGroup function as the constraint. Populate the output columns with the values stored ...

There ya go! The column itself may only ever have "IN" and "OUT" as values, but in your logic you need to account for the possibility. If you absolutely, positively know that "IN" and "OUT" are all you will ever see, then the following type of logic could be v...

Just as you would in an output link derivation...the rules are the same.

Every "if" requires both a "then" and an "else" to be present. In your code, you have no else statement to describe what to do when lnk_xfmr.DIR is not equal to either 'IN' or 'OUT'.

Regards,

Partition/Sort on your grouping key column(s), then use a transformer to Use key change detection to know when a new key group is present (either keyChange from a sort stage or compare to previous row's values) Use stage variables to save the column values you wish to output for a key group and plac...

You choose the valuefile you wish to use when you schedule the job. If you need to change parameter values, you can then modify the valueset file between job runs. If you want the flexibility to use different valueset files (to avoid having to modify a single file), you should use a script or outsid...

uvconfig is used for DataStage configuration DSParam is used for Project configuration ORLogging/RTLogging is set in DSParam for 8.0 and 8.1. In 8.5 and later, the option is now chosen directly in Administrator. AUTHORIZATION? Do you perhaps mean AUTHENTICATION, which is in the uvconfig file? Regards,