Jobs getting stuck

kumar_s · Post by **kumar_s** » Wed Mar 07, 2007 6:00 pm

So no other go, you need to check whats after 14M records. Try to split the file by some means for testing purpose to know what went wrong. Run the second half and see if your machine react the same way.

asitagrawal · Post by **asitagrawal** » Thu Mar 08, 2007 2:54 am

I agree with you...
Since the problem appears only in this particular set of input...
so initial doubt is that the data is corrupt.

In attempts to split the file or say read data after the 14M using Ascential,
the problem appears, so I am now using MS-DOS commands to split the file.. which also is been done. Today I will run the tese again and get back with the results !!

asitagrawal · Post by **asitagrawal** » Fri Mar 09, 2007 5:37 am

the data was found to be corrupt... but the DataStage was not logging any metadata problem while reading thru the 30M file.
After separating the data... a warning was logged....

kumar_s · Post by **kumar_s** » Fri Mar 09, 2007 5:53 am

May be the processed rows where huge in number that the process has consumed the full paging space and couldn't even log the error.