JAQL add filename as column

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
eli.nawas_AUS
Premium Member
Premium Member
Posts: 39
Joined: Tue Apr 15, 2014 9:14 am

JAQL add filename as column

Post by eli.nawas_AUS »

I am using the option 'File Name Column = ?' in the BDFS stage, and I would like to optimize the job as JAQL, but this option does not seem to come across in the optimized code. Is there a way, in JAQL, to manage this scenario:

Many files in a folder on Hadoop
Read in all the rows from all the files
With an extra column
In the extra column, each row gets the name of the file it came from

I'm fine with manually editing it, but I'm not sure what changes to make.
Post Reply