Page 1 of 1

Records skipped when reading sequential file

Posted: Mon Oct 18, 2010 11:25 pm
by Pk39565
Hi,

I have created a sequential file manually which has following data

Code: Select all

R00450000010100|ONE|ACTIVE|90286|DIRECT|2010-01-10|2011-01-10
R004P0000010100|ONE|ACTIVE|90286|DIRECT|2008-05-20|2011-01-10
R004000010100|ONE|ACTIVE|90286|DIRECT|2007-03-10|2011-01-10
When I read the above data in sequential file in parallel job only last row is showing the data, the first 2 records are skipped.

Property of sequential files:
Delimter=|
Final Delimeter =end (used none also ..result is same)

why the first 2 records are skipped? was there any format issues?

thanks in advance

Re: Problem with sequntial file

Posted: Mon Oct 18, 2010 11:28 pm
by adityavarma
Are you getting any warnings while running the jobs?

See if there is any filter condition applied in the sequential file stage

Posted: Mon Oct 18, 2010 11:43 pm
by chulett
What are the data types you've used for the columns in the stage?

Posted: Tue Oct 19, 2010 12:25 am
by ray.wurlod
Look in the job log. Are they being skipped, or are they experiencing import failures and being rejected/dropped?

Posted: Tue Oct 19, 2010 1:44 am
by mk_ds09
Hi

Check the first column values in all three records

R00450000010100|ONE|ACTIVE|90286|DIRECT|2010-01-10|2011-01-10
R004P0000010100|ONE|ACTIVE|90286|DIRECT|2008-05-20|2011-01-10
R004000010100|ONE|ACTIVE|90286|DIRECT|2007-03-10|2011-01-10

You need to check the first column metadata, it seems that metadata is not defined correctly.

All other columns are having the same values, so should not be any issue with those columns.

Also check the last character after each record, either through unix or some editing tool..

Hope this helps..

Posted: Thu Oct 21, 2010 4:59 pm
by abc123
Do a:
od -c YourFileName

This'll tell you what the last character is.

You need to have Quote=None in Field Delimiter as well. None is not the default.