How to avoid blank row in Sequential file
Moderators: chulett, rschirm, roy
How to avoid blank row in Sequential file
Hi,
Some one could you please help me how to avoid blank row in Sequential file.
Thanks in advance,
rck.
Some one could you please help me how to avoid blank row in Sequential file.
Thanks in advance,
rck.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Do you mean a sequential file from which you're reading, or to which you're writing?
You can not avoid anything in a sequential file from which you're reading; the very nature of a sequential file is that you have to read past every byte to get to the next.
So you either have to pre-process the text file to remove the blank lines, or modify your DataStage job such that it ignores them.
You can not avoid anything in a sequential file from which you're reading; the very nature of a sequential file is that you have to read past every byte to get to the next.
So you either have to pre-process the text file to remove the blank lines, or modify your DataStage job such that it ignores them.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 197
- Joined: Mon Feb 17, 2003 11:20 pm
- Location: India
Kumar, just curious to know if we have any Remove Duplicate Stage in DataStage 7.5. I don't see it in the list of stages. Is it something you need to buy separately?kumar_s wrote:can use any of the follow
1) can use a transformer/filter to check all the colum for null
2) can use aggregator to group by any unique column and filter out the blank row
3) If every other rows are unique, can use Remove Duplicate Stage
Regards,
-Sumit
-
- Participant
- Posts: 232
- Joined: Sat May 07, 2005 2:49 pm
- Location: USA
-
- Participant
- Posts: 197
- Joined: Mon Feb 17, 2003 11:20 pm
- Location: India
Hi rck,
Input
SeqFile Stage--------->Transform Stage--------> Output
Pick one Primary Key Column from your Input file and defining Constraint on Transform Output Link
Example:
DSLink.Col > 0
This will eliminate Last New Line (blank row) in your input file
This trick worked for us.........hope it would work for you
Good Luck
Martin
Input
SeqFile Stage--------->Transform Stage--------> Output
Pick one Primary Key Column from your Input file and defining Constraint on Transform Output Link
Example:
DSLink.Col > 0
This will eliminate Last New Line (blank row) in your input file
This trick worked for us.........hope it would work for you
Good Luck
Martin
i guess this is what i mentioned in my first point, can also use <> IsNull() function.martin wrote:Hi rck,
Input
SeqFile Stage--------->Transform Stage--------> Output
Pick one Primary Key Column from your Input file and defining Constraint on Transform Output Link
Example:
DSLink.Col > 0
This will eliminate Last New Line (blank row) in your input file
This trick worked for us.........hope it would work for you
Good Luck
Martin