How to avoid blank row in Sequential file

rck · Post by **rck** » Tue Jul 19, 2005 5:23 am

Hi,

Some one could you please help me how to avoid blank row in Sequential file.

Thanks in advance,

rck.

kumar_s · Post by **kumar_s** » Tue Jul 19, 2005 5:32 am

can use any of the follow
1) can use a transformer/filter to check all the colum for null
2) can use aggregator to group by any unique column and filter out the blank row
3) If every other rows are unique, can use Remove Duplicate Stage

ray.wurlod · Post by **ray.wurlod** » Tue Jul 19, 2005 5:57 am

Do you mean a sequential file from which you're reading, or to which you're writing?

You can not avoid anything in a sequential file from which you're reading; the very nature of a sequential file is that you have to read past every byte to get to the next.

So you either have to pre-process the text file to remove the blank lines, or modify your DataStage job such that it ignores them.

sumitgulati · Post by **sumitgulati** » Tue Jul 19, 2005 2:27 pm

kumar_s wrote:can use any of the follow
1) can use a transformer/filter to check all the colum for null
2) can use aggregator to group by any unique column and filter out the blank row
3) If every other rows are unique, can use Remove Duplicate Stage

Kumar, just curious to know if we have any Remove Duplicate Stage in DataStage 7.5. I don't see it in the list of stages. Is it something you need to buy separately?

Regards,
-Sumit

pnchowdary · Post by **pnchowdary** » Tue Jul 19, 2005 3:27 pm

Hi Sumit,

I believe that Remove Duplicate Stage is present only in the PX version (EE version) but not in the server edition. Guys, please correct me if I am wrong.

Thanks,
Naveen

sumitgulati · Post by **sumitgulati** » Tue Jul 19, 2005 3:29 pm

pnchowdary wrote:Hi Sumit,

I believe that Remove Duplicate Stage is present only in the PX version (EE version) but not in the server edition. Guys, please correct me if I am wrong.

Thanks,
Naveen

Thanks Naveen.

ranga1970 · Post by **ranga1970** » Tue Jul 19, 2005 10:30 pm

Yes; Remove duplicates fall in the PX

thanks
ranga

martin · Post by **martin** » Wed Jul 20, 2005 8:41 am

Hi rck,

Input
SeqFile Stage--------->Transform Stage--------> Output

Pick one Primary Key Column from your Input file and defining Constraint on Transform Output Link

Example:
DSLink.Col > 0

This will eliminate Last New Line (blank row) in your input file

This trick worked for us.........hope it would work for you

Good Luck
Martin

kumar_s · Post by **kumar_s** » Wed Jul 20, 2005 11:40 am

martin wrote:Hi rck,

Input
SeqFile Stage--------->Transform Stage--------> Output

Pick one Primary Key Column from your Input file and defining Constraint on Transform Output Link

Example:
DSLink.Col > 0

This will eliminate Last New Line (blank row) in your input file

This trick worked for us.........hope it would work for you

Good Luck
Martin

i guess this is what i mentioned in my first point, can also use <> IsNull() function.