Duplicate and missing records
Posted: Wed Apr 28, 2004 4:35 am
I have a very strange error that has been driving me crazy for a couple of weeks now. I have stripped back my job to the bare bones and it still exhibits the same behaviour.
The scenario is this:
A sequential file feeding into a transformer, followed by another transformer, feeding into a sequential file. The first transformer strips trailing blanks off the input, the second transformer does some simple transformations including a routine.
There are no contraints anywhere so I expect the same number of records in the output file as are in the input file. And in fact I do get the same number of records, except that one record a third of the way through the file has duplicated itself and the last record is missing.
The only way I can explain it is a bug in DataStage. Does anyone else have experience of this problem or a way of getting round it?
The scenario is this:
A sequential file feeding into a transformer, followed by another transformer, feeding into a sequential file. The first transformer strips trailing blanks off the input, the second transformer does some simple transformations including a routine.
There are no contraints anywhere so I expect the same number of records in the output file as are in the input file. And in fact I do get the same number of records, except that one record a third of the way through the file has duplicated itself and the last record is missing.
The only way I can explain it is a bug in DataStage. Does anyone else have experience of this problem or a way of getting round it?