sequential file pattern property
Posted: Thu Apr 14, 2011 4:51 am
Hi
I have a requirement where I have to fetch few files from a folder of similar pattern and having same metadata and then need to apply some transformations on it and then I have to produce same no of files fetched from the source folder and place them in target folder.
Ex:
dir1 has 210 files and i need to fetch some 50 files of similar pattern ( which I specified in my seq file file pattern stage property)
after applying transformation it need to produce 50 files in target folder
I have problem in splitting individual files which are being read from input folder after the transformation is done (no of files in i/p folder are not fixed and no of records in each i/p file are also not fixed )
can anyone post me a solution for this
I have a requirement where I have to fetch few files from a folder of similar pattern and having same metadata and then need to apply some transformations on it and then I have to produce same no of files fetched from the source folder and place them in target folder.
Ex:
dir1 has 210 files and i need to fetch some 50 files of similar pattern ( which I specified in my seq file file pattern stage property)
after applying transformation it need to produce 50 files in target folder
I have problem in splitting individual files which are being read from input folder after the transformation is done (no of files in i/p folder are not fixed and no of records in each i/p file are also not fixed )
can anyone post me a solution for this