Reading multiple files

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ElkanaS
Participant
Posts: 2
Joined: Fri Mar 13, 2009 12:44 am
Location: Midrand

Reading multiple files

Post by ElkanaS »

Hi
I' a beginer in datastage still trying learn my ropes..... I just want ask if theret is a way in parallel jobs, i can be able to read from multiple files of the same format at the same time thanks.
Elkanas
shaminmin26
Participant
Posts: 17
Joined: Mon Apr 21, 2008 9:53 pm
Location: SG

Post by shaminmin26 »

File Pattern
karthegx
Participant
Posts: 27
Joined: Wed Sep 06, 2006 1:48 am

Post by karthegx »

Use 'File Pattern' option in sequential file stage to read multiple files.
kartheek
mdbatra
Premium Member
Premium Member
Posts: 175
Joined: Wed Oct 22, 2008 10:01 am
Location: City of London

Post by mdbatra »

1. Use "File" property again & again( if file format is identical but not file names)
2. Use "File Pattern" property( if file names are having an identical pattern as well)
Rgds,
MB
John Smith
Charter Member
Charter Member
Posts: 193
Joined: Tue Sep 05, 2006 8:01 pm
Location: Australia

Post by John Smith »

You can also try using an External Source Stage with a unix command to read the files ; handy if you need a bit more logic to determine which files to read e.g in cases where the file names are not in the same pattern.
Post Reply