DSXchange

do you see your job when you issue the command

what is the result of COUNT DS_JOBOBJECTS

when we move our job from dev to test and try to run it we get this fatal error message WriteHash() - Write failed for record id 'BRT019453K 53425' After we re-compile the job it runs fine. It does not look like it is related to data issue because the job runs fine after we compile it. The fatal err...

Okay, I was able to run the job on a different server and it completed successfully. We did not break it into pieces and ran it as it was. the throughput was around 1200 rows/sec, better than what we had on original server ( 12 rows/sec). It seemed that our server was overloaded and too many process...

Thank you guys for the suggestions.
Narasimha: I re-created the hashed files using default options, not sure why the perfromance is poor. IBM Engineering is also not able to find the root cause of this issue yet

I would like to run the same job in a different environment. I already exported the dsx. How do I move hashed files to the other Environment?
Can I just do a Unix copy of hashed file or there is any import/export command for moving hashed files to different servers?

Appreciate your responses.

Thanks

hi Narasimha, [quote="narasimha"]Attu, What is your source? Database/File? File with 50 million records What is the size of your hashed file in question? HF1 32661504 bytes HF2 700416 bytes HF3 212992 bytes HF4 10645504 bytes HF5 1032192 bytes You would want to resize the hashed file only ...

[quote="srinagesh"]Just as a test, try to split the job into two. yes i splitted the job in two parts, the first part was very fast and it had 2 hashed files doing a lookup, but the second part again slowed down. You can write to a text file, from Link collector stage in Job 1. Use the tex...

Thanks for the info guys, Our issue us still not resolved. we are doing couple of lookups using hashed file and the throughput is very slow e.g. 17 rows/sec. I tried tuning the performance by increasing row-buffering to 1024KB but still does not helps. what other options do I have, we are using a Dy...

Thanks Ray. I ran it as you suggested here is the o/p File type .................. DYNAMIC Hashing Algorithm .......... GENERAL No. of groups (modulus) .... 12003 current ( minimum 1, 0 empty, 3896 overflowed, 1 badly ) Number of records .......... 297932 Large record size .......... 1628 bytes Numb...

Thanks Narasimha. The issue is that we are trying to do lookup from hashed files and the throughput is very low, it is like 17 rows/sec. Is there any issue with the hashed file index or do we need to recreate the hashed files again? Is there any other thing I can do to improve the performance? Thanks

thanks. here is the output. File type .................. DYNAMIC Hashing Algorithm .......... GENERAL No. of groups (modulus) .... 12003 current ( minimum 1 ) Large record size .......... 1628 bytes Group size ................. 2048 bytes Load factors ............... 80% (split), 50% (merge) and 80%...

[quote="narasimha"]First establish a pointer in the VOC by issuing the command
I get this message

what do you want to call it in your VOC file =

Can someone tell me the syntax for this command?