DSXchange

ray.wurlod wrote: and has not been correct since about version 2.2 (more than ten years ago).

I admire they way Ray has indexed the data so that it could be fetched after 10 years :D

1) So in a 32 bit machine with a heap memory of 2GB, Is it safe to say we can go for a lookup stage if the reference data is 1.00 GB? there are lot many processes running over the server and using up 50% of memory just for one stage is not wise. Well assuming the server has only 2 GB memory is also...

1. Ignores duplicates , but issues a warning message about a duplicate key ref found. Usually the duplicate removal/identification algorithms rely on sorting so just wondering how duplicates are identified without sorting 2. No - The reference link in a lookup stage does NOT require a sort - nor do...

1) So in a 32 bit machine with a heap memory of 2GB, Is it safe to say we can go for a lookup stage if the reference data is 1.00 GB? there are lot many processes running over the server and using up 50% of memory just for one stage is not wise. 2) So in a 64 Bit machine, where heap memory has no l...

Hi Could some one please share some light over the below 1. The look up stage removes the duplicates if, multiple rows returned from link is disabled, does it mean that the look up operator has a tsort underneath to remove duplicates OR are the duplicates identified when the look up table is built a...

chulett wrote:The answer changes based on 32bit v. 64bit architecture. The former has a 2GB limit while the latter does not.

Was wondering, what if on a 32bit AIX machine has heap/data limit defined as unlimited, Will it override the 2GB constraint ?

Also look for user limits defined for heap memory/data size for unix users

chandra.shekhar@tcs.com wrote:According to your requirement if KEY1 is null then value of KEY2 column should be mapped, then the data type of both KEY1 and KEY2 should be same.

It is the same,

zulfi123786 wrote:before trying with dates I tested for varchar columns

From the above I meant both KEY1 and KEY2 were varchars.

chandra.shekhar@tcs.com wrote:Is handle_null a system function ?

Its not a system function, its a modify operator function name.

chandra.shekhar@tcs.com wrote: The KEY1 column should contain date value, any other data type values will throw error.

Did not get this ?

Hi There is a simple derivation where a source date column which is Nullable is to be replaced with NOT NULL date column when the source column is NULL. Tried the below: TST=handle_null(KEY2,KEY1) before trying with dates I tested for varchar columns, KEY2 is the source column and KEY1 is the NOT NU...

I have seen One of the IBM projects where they have made it mandatory to add copy stage after each stage, though it makes no difference at run time but maintanence becomes easy when you have to add more flows to the design

There could be differences when the output columns are datatyped differently for instance a left outer joined column from left link is supposed to be NULLABLE YES and if its defined as NULLABLE NO the join operator defaults the values per the datatype.

As per my understanding of Hash partitioning same key values will be partitioned into same processing node. Correct How Hash partitioning works with/without key values Sorted? Hash operator does not require sorted data so either ways the result is same with extra burden of sorting Why Sorting is ma...

There was a time, I recollect the version 7.5 days where we observed something fascinating. The job was reading from DB2 Enterprise stage and writing to Dataset whith no stage in between and the job intelligently created the dataset segment files in the resource path of DB2 node but since the datase...

I have tried one more way where I generate a column "CODE" and for every different age group the value is incremented by 1. My source is a database so I can use it in my query. And finally use this column for SUM Suppose you have 10 million records (hypothetical example) And if your datab...