Invalid Filenames using File Name Column property

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
DSDexter
Participant
Posts: 94
Joined: Wed Jul 11, 2007 9:36 pm
Location: Pune,India

Invalid Filenames using File Name Column property

Post by DSDexter »

Hi Gurus,

I am reading multiple files using the file pattern property in a sequential file stage. I am fetching the filenames using the File Name column property. I am also setting the Environment variable $APT_IMPORT_PATTERN_USES_FILESET=TRUE.

I am able to fetch the filenames for each record read. But the filename associated with each record are not as per the actual.

e.g
File1 - 10 rec
File2 - 10 rec
File3 - 10 rec.

I am reading 30 records in the stage. But I get 1 record with File1 as the filename. 10 records with File2 and the rest with File3. So File1 is being overwritten with File3.

Additional Info:

No. of Nodes - 2
Sever Version - 7.5.2
Client Verison - 7.5.1.A
Os - AIX

Thanks
Thanks
DSDexter
DSDexter
Participant
Posts: 94
Joined: Wed Jul 11, 2007 9:36 pm
Location: Pune,India

Re: Invalid Filenames using File Name Column property

Post by DSDexter »

Any help would realyy be appreicated.

Never seen this issue in v8.
Thanks
DSDexter
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Have you defined any column as key ? Were there any duplicates ?

Does your output still produce 30 records (as per your example) ?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Were any rows reported as rejected? Use Monitor to determine how many rows were handled by each node.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply