Missing delimter and non ascii characters in the file

[pradkumar]

Hi Everyone,

I have job which reads from dataset ,loads in to a sequential file . The options i have set in the sequential file are
Final Delimter -- end
record delimiter- unix new line
delimeter - pipe
date format string, timestamp format string ( iam converting the date and timestamp format ). The job is running fine but when i view the data on the unix file system i see pipe delimiter is missing for some fields and also wierd characters.

00003010038144|^D218912140020|^B29R|||03/14/2008|12/31/9999|D|V|D|Y|Active|20091002:103630
But the record should looks like
00003010038144|2189|12140020|29|R|||03/14/2008|12/31/9999|D|V|D|Y|Active|20091002:103630.

Could anyone please let me know the reason for missing delimter between coulmns and wierd characters.

Thanks in Advance

[chulett]

Can you let us know what the hex values are for the 'weird' characters?

[pradkumar]

Hi chulett,

Could you please let me know how to find the hex values for those characters..

Thanks in Advance

[chulett]

You can move it over to your desktop and use a hex editor or from the UNIX side try an "od -h" on the file and post the results. There are many free hex editors out there to try. For the "od" command, probably best to use it on a file with just that one record in it, if possible.

[pradkumar]

Hi,

below are the hex values for the above one record

0000000 3030 3030 3330 3130 3033 3831 3434 7c00
0000020 0432 3138 3931 3231 3430 3032 307c 0002
0000040 3239 527c 7c7c 3033 2f31 342f 3230 3038
0000060 7c31 322f 3331 2f39 3939 397c 447c 567c
0000100 447c 597c 4163 7469 7665 0000 0000 7c32
0000120 3030 3931 3030 323a 3130 3336 3330 0a00
0000137

thanks in advance

[ray.wurlod]

Which characters are "weird" and why?

[pradkumar]

Hi,

The issue was resolved. For some fileds in the target sequential stage the prefix bytes property was set to 2 ( default). once we removed the property we dont see any issue.

Iam marking this thread as resolved.

Thanks for everyone