how to read all files from one directory ?

[kaushal.kumar@igate.com]

Hi,
Do we have any stage in DS parallel job,which can read all file from one directory ( example load ). My requirement is to read all files from directory ,files are fix width length files .I have to pick all files using one job then in intermediate stage i have one refrance table ( which has field defination of all files)by using which i have to bind the data with field name and put it into different table.

I want to know do we have any satge in Ds in parallel job which can read multiple files from same directory in single job (* number of files may changed in next run).

Please help me
[/img]

[ray.wurlod]

Sequential File stage.

Method 1: File Pattern of *

Method 2: Filter command of something like type *

Method 3: Filter command to run script that outputs contents of all files in directory onto stdout.

[kaushal.kumar@igate.com]

Sequential File stage.

Method 1: File Pattern of *

Method 2: Filter command of something like type *

Method 3: Filter command to run script that outputs contents of all fil ...

Thanks,
in Sequential File stage. Method 1: File Pattern of * Method ..---- if i will go for this metod can we get file name as one column and all records in another column.

Please advice

[ray.wurlod]

Yes you can get the stage to populate a column with the File Name (and another with the line number). How it reads (parses) the files is up to you and the metadata (table definition or schema file) that you provide.