Inconsistent View Data in Sequential File stage

[vnspn]

Hi,

We have a Sequential File stage as source that reads a .csv file. This file has 115 records in it. The last few records have a value of -1 in one of the columns.

When we do a view data on this stage, the number of records that show on the screen are inconsistent. Sometimes it shows all records including the last few records with '-1' value, or sometimes it does not show the last few records that have '-1' value. I have the limit for view data as the highest 9999.

We would like to know if its a problem with just the view data or something to do with the format within the file.

Thanks.

[Sainath.Srinivasan]

Sometimes it shows all records including the last few records with '-1' value, or sometimes it does not show the last few records that have '-1' value. I have the limit for view data as the highest 9999.

What is common in the 'sometimes' ?

[vnspn]

I'm doing nothing differently.

I just repeatedly do a view data, and at times is shows all records and at certain times does not show the last few records with -1.

[chulett]

What happens when you run the job? Are those last "-1" records processed or skipped? Skipped records indicate a metadata issue. Typically.

[vnspn]

No, they are not skipped. So far when we have run the job, I see them in the output. The problem is only when I view the data from the stage. Because it sometimes shows up and sometimes does not with view data, we are worried that, if that would drop those records during some runs.

[ray.wurlod]

What's the data type? -1 is a valid value for any signed data type.

[vnspn]

The datatype is Interger.
I'm not getting any error /warning message when I view data. But, it just misses some records...

[ray.wurlod]

What are your sampling specifications when you use View Data? If you specify only 10 rows, that's all you'll get.

[chulett]

If you repeatedly view the exact same static data over and over using the same settings and the results are not identical, you need to report that to the vendor - i.e. your official support provider.

[vnspn]

Ray - I have my sampling specfication with the highest value possible, '9999'.

chulett - You have precisely stated our scenario. When we repeatedly view the exact same static data over and over using the same settings, the results are not identical. We shall get in touch with our vendor support as you have mentioned.

Thank you.