JAQL add filename as column
Posted: Mon Aug 25, 2014 9:59 am
I am using the option 'File Name Column = ?' in the BDFS stage, and I would like to optimize the job as JAQL, but this option does not seem to come across in the optimized code. Is there a way, in JAQL, to manage this scenario:
Many files in a folder on Hadoop
Read in all the rows from all the files
With an extra column
In the extra column, each row gets the name of the file it came from
I'm fine with manually editing it, but I'm not sure what changes to make.
Many files in a folder on Hadoop
Read in all the rows from all the files
With an extra column
In the extra column, each row gets the name of the file it came from
I'm fine with manually editing it, but I'm not sure what changes to make.