Hi,
I have 200 rows and i need to import the 95 rows to my source (all are in text files).
So how can i avoid first five rows to sourch while importing...
Can you please help me to solve this
thanks
Subbu
How to avoid first five rows from the source in Importing
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 892
- Joined: Thu Oct 16, 2003 5:18 am
Re: How to avoid first five rows from the source in Importin
Use the Filter option in the Sequential file stage. If you know the number of rows in your file (200 in this case) you can give Tail -195 in the filter and this will read only the last 195 records from the file.subbuvp wrote:Hi,
So how can i avoid first five rows to sourch while importing...
But is the number of records in your file going to be a constant?
You can parameterize the rows to be read in the sequential file filter as
tail -#rowcount#
where rowcount is the job parameter. You need to pass the appropriate value to rowcount job parameter.
tail -#rowcount#
where rowcount is the job parameter. You need to pass the appropriate value to rowcount job parameter.
Last edited by balajisr on Tue Dec 05, 2006 2:24 am, edited 1 time in total.
You can useSo how can i avoid first five rows to sourch while importing
Code: Select all
tail +6 filename
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Re: How to avoid first five rows from the source in Importin
Subbu,subbuvp wrote:So how can i avoid first five rows to sourch while importing...
This can be your other option,
If you have a transformer in between your two files, add the below constraint
Code: Select all
@INROWNUM > 5
Narasimha Kade
Finding answers is simple, all you need to do is come up with the correct questions.
Finding answers is simple, all you need to do is come up with the correct questions.
Re: How to avoid first five rows from the source in Importin
This wouldn't work as there would be Fan out happening from the file and the data would get partitioned when it reaches the transformer - and the ordering would be lost.narasimha wrote:This can be your other option,
If you have a transformer in between your two files, add the below constraintCode: Select all
@INROWNUM > 5
Moreover as the transformer is working in parallel, each node would try to execute that constraint - which would not meet the requirement.
Aneesh