Bringing source file name over with the column data

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
swathitagore
Participant
Posts: 10
Joined: Mon Dec 19, 2011 10:28 am

Bringing source file name over with the column data

Post by swathitagore »

Using DataStage Designer 8.7 within a parallel job, while reading sequential source files using pattern matching for the file name how do I bring the source file name over with the column data?
Thanks,
Swathi
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There is an optional property called something like "source file name column".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
swathitagore
Participant
Posts: 10
Joined: Mon Dec 19, 2011 10:28 am

Post by swathitagore »

We found that option but it's only giving back pattern matching instead of full file name.

For example: adrlanding/CMS/MMR/*.MONMEMD.*
Thanks,
Swathi
SURA
Premium Member
Premium Member
Posts: 1229
Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney

Post by SURA »

Find out the APT_IMPORT_PATTERN* env variable and add it.

DS User
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

You can include filename property ( which gets enables when you use file pattern ) & make sure that you are setting that env variable as suggested by sura
Nag
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

$APT_IMPORT_PATTERN_USES_FILESET=TRUE
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply