Job failure at 3100000th row of data

DeepakCorning · Post by **DeepakCorning** » Tue Jul 12, 2005 7:02 am

The Job is unable to write data to a hash file after a capacity of 310000 rows. Is the type 30 hash file has a memory limit?? I dotn think it should have such a constraint.

The error-->

"WriteHash() - Write failed"

Viswanath · Post by **Viswanath** » Tue Jul 12, 2005 7:31 am

Hi Deepak,

1.) What are the configurations of the file?
2.) Is the hash file pre-created? If yes then what are the hash parameters are you giving?
3.) What else does the error message say? I guess there would be more than what you have displayed currently?

Cheers,
Vishy

DeepakCorning · Post by **DeepakCorning** » Tue Jul 12, 2005 7:37 am

Its a dynamic hash file and yes it is precreated and not while running this job.

Thats the error with the data for which it has failed.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Tue Jul 12, 2005 7:48 am

Did you check whether you have enough space in the file system?

What is the file size when it aborts?

DeepakCorning · Post by **DeepakCorning** » Tue Jul 12, 2005 3:14 pm

Yep Have a lot of memory available...i dont thin its memory problem.

Does any one knows if i can run the job from a particular row so that i can see if it is data problem or not?

snassimr · Post by **snassimr** » Tue Jul 12, 2005 3:22 pm

If your system is 32bit The hsh file size limited to 2.2 Gb.
Multiply 3100000 to size of each row you enter the hash file.

Does it exceed 2.2 GB ?

pnchowdary · Post by **pnchowdary** » Tue Jul 12, 2005 3:39 pm

Hi Deepak,

DeepakCorning wrote: Does any one knows if i can run the job from a particular row so that i can see if it is data problem or not?

You can put a transformer stage before writing to hash file and in the transformer have a constraint like @INROWNUM >= 3100000, so that it will not write the first 3100000 values and will start writing values from 3100001. That way you will be able to tell whether the data is problem or not.

Thanks,
Naveen