Sequential file stage - Filter option
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 10
- Joined: Sun May 18, 2008 5:59 am
- Location: India
Sequential file stage - Filter option
Hi All
Request your help in solving the issue with Filter command property of sequential file stage.
I need to read the header and data rows separately (header row has different structure than data rows). I am able to read the header row separately.But when I tried using the below command to read data rows it is not filtering any header row and not even throwing any syntax error.
grep -v -e "`head -1 FILENAME`"
Does this property of sequential stage has any restrictions on the UNIX commands used
Thanks in advance
Request your help in solving the issue with Filter command property of sequential file stage.
I need to read the header and data rows separately (header row has different structure than data rows). I am able to read the header row separately.But when I tried using the below command to read data rows it is not filtering any header row and not even throwing any syntax error.
grep -v -e "`head -1 FILENAME`"
Does this property of sequential stage has any restrictions on the UNIX commands used
Thanks in advance
-
- Participant
- Posts: 10
- Joined: Sun May 18, 2008 5:59 am
- Location: India
Hi Chullet
Thanks for the quick response
Yes I tred that expresson in command line.For command line we need to use that command like this
grep -v -e "`head -1 FILENAME`" FILENAME
For DS as it is not mandatory to specify the file name again I haven't mentioned it. But I have tried this second expression also.But no luck
Thanks for the quick response
Yes I tred that expresson in command line.For command line we need to use that command like this
grep -v -e "`head -1 FILENAME`" FILENAME
For DS as it is not mandatory to specify the file name again I haven't mentioned it. But I have tried this second expression also.But no luck
-
- Participant
- Posts: 10
- Joined: Sun May 18, 2008 5:59 am
- Location: India
Also remember that the working directory of the job is in the project directory, so you should always specify a full and absolute path to your filename.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 10
- Joined: Sun May 18, 2008 5:59 am
- Location: India
So... you put /dev/null in the Filename prompt and this in the Filter with the full path for the filename (times two):
grep -v -e "`head -1 FILENAME`" FILENAME
And it told you it was empty? If so, then you may be a victim of the filter's bad handling of quotes in the command. I've seen it strip them or only execute up to the first quote and ignore the rest of the command.
Open a case with your official support provider and ask them if that should be working or not.
grep -v -e "`head -1 FILENAME`" FILENAME
And it told you it was empty? If so, then you may be a victim of the filter's bad handling of quotes in the command. I've seen it strip them or only execute up to the first quote and ignore the rest of the command.
Open a case with your official support provider and ask them if that should be working or not.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers