I have a very strange error that has been driving me crazy for a couple of weeks now. I have stripped back my job to the bare bones and it still exhibits the same behaviour.
The scenario is this:
A sequential file feeding into a transformer, followed by another transformer, feeding into a sequential file. The first transformer strips trailing blanks off the input, the second transformer does some simple transformations including a routine.
There are no contraints anywhere so I expect the same number of records in the output file as are in the input file. And in fact I do get the same number of records, except that one record a third of the way through the file has duplicated itself and the last record is missing.
The only way I can explain it is a bug in DataStage. Does anyone else have experience of this problem or a way of getting round it?
Duplicate and missing records
Moderators: chulett, rschirm, roy
Assuming there is nothing funky in the Sequential file, a couple of questions:
What does the routine do? Anything 'special' or does it use COMMON storage?
Do you have Row Buffering turned on? It can be on either in this particular job or at the Project level and this job uses 'Project Level Defaults'... or something to that effect. In any case, it's a Job Property on the 'Performance' tab, I believe.
What does the routine do? Anything 'special' or does it use COMMON storage?
Do you have Row Buffering turned on? It can be on either in this particular job or at the Project level and this job uses 'Project Level Defaults'... or something to that effect. In any case, it's a Job Property on the 'Performance' tab, I believe.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers