Page 1 of 1

Invalid Filenames using File Name Column property

Posted: Fri Aug 20, 2010 3:39 am
by DSDexter
Hi Gurus,

I am reading multiple files using the file pattern property in a sequential file stage. I am fetching the filenames using the File Name column property. I am also setting the Environment variable $APT_IMPORT_PATTERN_USES_FILESET=TRUE.

I am able to fetch the filenames for each record read. But the filename associated with each record are not as per the actual.

e.g
File1 - 10 rec
File2 - 10 rec
File3 - 10 rec.

I am reading 30 records in the stage. But I get 1 record with File1 as the filename. 10 records with File2 and the rest with File3. So File1 is being overwritten with File3.

Additional Info:

No. of Nodes - 2
Sever Version - 7.5.2
Client Verison - 7.5.1.A
Os - AIX

Thanks

Re: Invalid Filenames using File Name Column property

Posted: Fri Aug 20, 2010 6:33 am
by DSDexter
Any help would realyy be appreicated.

Never seen this issue in v8.

Posted: Fri Aug 20, 2010 6:38 am
by Sainath.Srinivasan
Have you defined any column as key ? Were there any duplicates ?

Does your output still produce 30 records (as per your example) ?

Posted: Fri Aug 20, 2010 4:45 pm
by ray.wurlod
Were any rows reported as rejected? Use Monitor to determine how many rows were handled by each node.