DSXchange

I would like to find all the jobs having a particular field.
Would like to know which internal Datastage Hash file should I search to get the same?

Note: Cannot use Datastage manager for Usage analysis as Metadata management(Table Definitions) are not maintained properly.

You can do a explain plan on the query and check the cost of both the SQL's; the one with NVL and second one without NVL. Check the difference, if it very high or its minimal.

laxmi_etl wrote:any more thoughts??

your design should be
db2 ===> seq file

DB2 should have a normal SQL.

and your Sequential file should have below properties.
Record delimeter = UNIX newline
Record Length =fixed
Delimeter = none

This link counts also depends on the stage to which its going... what is the count it shows when records move from copy stage to sample stage ? I am sure it would be, 20 NOT 100... I have never observed or noticed such thing in PX, but in server jobs i noticed it many times... hash File (having 500 ...

Thanks for Shantanu's reply. We would like to avoid using any "split" approach (to avoid unnecessary file landing). Is there any way to handle this kind of source file in Data Stage so that it can be directly loaded into Data Stage. Thanks, Derek Chu If you want to avoid landing of files,...

If its ASCII flat file (mentioned as normal file, in previous posts)..there are several approach.. 1. Split the file upfront in a script (shell or perl or cosort) and in the datastage job do your remaining logic. 2. If you dont need header and trailer record in your DS job. Use external source stage...

Remove
ErrCode = DSWaitForJob(hJob)
ErrCode = DSDetachJob(hJob)
from this loop and add it to another loop.

Hash partitioning is also totally dependent upon the number of nodes. I don't think so. For Hash partition hash function is used and in hash function, I don't think nodes are used. The number of partition is more data dependent. A generic definition of hash: The result of the hash algorithm, is a n...

Though the table may be having NOT NULLABLE defined, you will have to define all the three columns as nullable in your db2stage, look-up stage, and probably your transformer stage (or stage, where you are doing this null check). The reason for getting 0 after look-up failure : The db2 stage extract ...

A simple way (probably not a good way) is to put two input links to one TeraData OCI, something like: source1=>Transformer1=> TeraData OCI source2=>Transformer2=> I don't know about Teradata, but DB2 and Oracle establish a lock before writing to the table. So in your scenario, there will be content...

I agree with Ray on this one! from what I have seen Modulus works great if used appropriately!! but if you want to play safe--- hash partition both streams ... As i mentioned before, modulous partition is totally dependent on number of nodes; number of partition will always be less than or equal to...

I am not using the has file for uniqueness. I am trying to use hash file TO REPLACE Link Collector. Link Collector sometimes throws "MUTEX" error. I am trying to avoid link collector. I am trying to bring data from two transformer stages and trying to collect all the records and pass it t...

Or if you want to avoid adding the hash file to VOC. Make a copy of UtilityHashLookup and change the command given after comment * Table is not in cache of opened tables, so open it. Change From: Open HashTable Change To: OpenPath HashTable You are now good to go, no hasle of adding the hash file to...

1. Write to hash file with keys as table2.col4 and table2.col3 2. Use UtilityHashLookup routine to read the hash file 3. Check return value of the routine If IsNull(UtilityHashLookuptable(Arg1,Arg2,Arg3)) Then "" else table2.col5 Note : you need to add hash file to VOC, before reading it t...

helpmeout,

No hard feeling..but all the past few posts from you look to me more like interview question..If so, please avoid asking such questions.