DSXchange

Thanks for the explanation ! I got the idea .

Thanks for your replies, but I am still not able to solve it. Since data volume is more than 10 million so Join is used.Now I need to estimate the additional scratch space that is needed to sort a specific volume of records ( say 5 billion data in one input stream and 25 million in other ) . I need ...

Yes, I understand that. I need to do some capacity planning for that.

But how much data will be in memory while using join, input hash paritioned & sorted ? with 4 node , is input stream/4 ?

Please let me know if you have any suggestion regarding capacity planning.

Hi All, Can anybody please explain me the join operation, in terms of memory usage ? As per my understanding join doesn't take all the data into memory as lookup does, instead it goes into the table (say both the input link are Oracle src) and read the data page wise.But if join input streams are ha...

Thanks for the suggestions !

I tried to logout from director->clean up resources but couldn't abort the job.
However there could be problem with Database lock as source, lookup
were pointing to production.I will contact our DBA if the problem happens again.

Thanks ,
Ankita

Yes, I agree with you, but I am doing some performance testing with large volume of data and running the jobs manually.The job reads from a Oracle table, performs lookup with Oracle and loads data into another Oracle table, dataset . When I check in unix , it's showing that a phantom process is runn...

Hi , I am facing a strange problem while running a job; the job is showing as 'Running' in Director window.But while monitoring I find it as ready even after several minutes, also not able to abort the job from Director. I finally aborted by using kill command from unix, but facing the same issue ag...

Hi, Can anyone help me to understand how DataStage handles partitions in below cases ? 1> 1st Lookup input is hash partitioned, reference is entire, next lookup stage input is Auto partitioned.Does DataStage change the partition ? what's the default behaviour of Auto ? 2> Remove duplicate is done us...

Hi, I want to know the better way of loading a Oracle table(10g). While loading millions of records into Oracle table, which option should be chosen for better performance (without any deadlock issue)? - Using Upsert - Splitting the data stream into 'Insert' & 'Update' stream and using two Oracl...

Hi, I am trying to generate xml output file from a cobol file and getting the following warning for level 88 as : Derivation rule "88 DEAL-ADD-IND 'A' 88 DEAL-DEL-IND 'D' 88 DEAL-TRLR-IND 'T'" is invalid. Message = "Extra illegal tokens! expression = '88 DEAL-ADD-IND 'A' 88 DEAL-DEL-I...