Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
swathitagore
Participant
Posts: 10 Joined: Mon Dec 19, 2011 10:28 am
Post
by swathitagore » Thu Jan 05, 2012 2:30 pm
Using DataStage Designer 8.7 within a parallel job, while reading sequential source files using pattern matching for the file name how do I bring the source file name over with the column data?
Thanks,
Swathi
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Thu Jan 05, 2012 2:48 pm
There is an optional property called something like "source file name column".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
swathitagore
Participant
Posts: 10 Joined: Mon Dec 19, 2011 10:28 am
Post
by swathitagore » Thu Jan 05, 2012 3:34 pm
We found that option but it's only giving back pattern matching instead of full file name.
For example: adrlanding/CMS/MMR/*.MONMEMD.*
Thanks,
Swathi
SURA
Premium Member
Posts: 1229 Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney
Post
by SURA » Thu Jan 05, 2012 4:38 pm
Find out the APT_IMPORT_PATTERN* env variable and add it.
DS User
nagarjuna
Premium Member
Posts: 533 Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago
Post
by nagarjuna » Sat Jan 07, 2012 12:59 pm
You can include filename property ( which gets enables when you use file pattern ) & make sure that you are setting that env variable as suggested by sura
Nag
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Sat Jan 07, 2012 2:55 pm
$APT_IMPORT_PATTERN_USES_FILESET=TRUE
-craig
"You can never have too many knives" -- Logan Nine Fingers