DSXchange

Hi,

I have a folder stage which reads a set of csv files.

The folder stage is connected to a row splitter.

The row splitter splits the data into to rows, one the header and the other row is the data.

The second column length is given the maximum 9999999 beyong which datastage cannot accept.

when processing the data i got a phantom

DataStage Job 222 Phantom 6467
Program "JOB.1132352373.DT.1471260026.TRANS1": Line 68,
Available memory exceeded. Unable to continue processing record.
DataStage Phantom Finished

Please suggest me some ideas where i went wrong and where can i debug the problem.

Thanks,
Suresh N

I believe that "Available memory exceeded." is a very clear message. Think supply and demand.

Thanks Ray.

Issue is with the memory.

Rather than the Folder, use a Sequential file stage - either with the Filter option or a before-job concatenation - to read all of the files.