Datastage Phantom - JOB.1132352373.DT.1471260026.TRANS1

suresh.narasimha · Post by **suresh.narasimha** » Mon Jun 30, 2008 10:52 pm

Hi,

I have a folder stage which reads a set of csv files.

The folder stage is connected to a row splitter.

The row splitter splits the data into to rows, one the header and the other row is the data.

The second column length is given the maximum 9999999 beyong which datastage cannot accept.

when processing the data i got a phantom

DataStage Job 222 Phantom 6467
Program "JOB.1132352373.DT.1471260026.TRANS1": Line 68,
Available memory exceeded. Unable to continue processing record.
DataStage Phantom Finished

Please suggest me some ideas where i went wrong and where can i debug the problem.

Thanks,
Suresh N

ray.wurlod · Post by **ray.wurlod** » Mon Jun 30, 2008 10:59 pm

I believe that "Available memory exceeded." is a very clear message. Think supply and demand.

suresh.narasimha · Post by **suresh.narasimha** » Tue Jul 01, 2008 12:54 am

Thanks Ray.

Issue is with the memory.

chulett · Post by **chulett** » Tue Jul 01, 2008 6:17 am

Rather than the Folder, use a Sequential file stage - either with the Filter option or a before-job concatenation - to read all of the files.