Weird Character When copying file...

rodre · Post by **rodre** » Wed Nov 22, 2006 8:58 am

Hello Everyone,

Sometimes (not always) when a file (flat file) is copied, either manually or via a .Bat file with the copy command, it produces this character "" at the end of the file which causes a datastage job to abort.
Can the row or the character be deleted before running the Server Job?
Thank you for your response in advance!!...

Rodre

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 9:15 am

where are you copying it from and where to. I use to see that character when i would ftp a file from mainframe to windows in ascii format. But if it was ndm'd (ftp'd) directly to a unix server, that 'box' wouldnt show up.
Does this box appear at the end of the last character or after the last row on a new line ?
Try by specifying "column has terminators", in the column specs in the seq. file stage. See if that helps.

thumsup9 · Post by **thumsup9** » Wed Nov 22, 2006 9:26 am

Non Printable characters like this can be handled using OCONV with MCP and MCN options...

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 9:38 am

True.
As i mentioned, if it appears at the end of record then MCP conversion code can be used. If it appears in a new line, datastage will treat it as a new record with all the columns missing and hence scream.

rodre · Post by **rodre** » Wed Nov 22, 2006 9:42 am

The file is ftp'd to us, however the copying is done within the datastage windows server, from one folder to another. Also, the original ftp'd file does not have the box character until the file is copied.

The box shows up after the last row on a new line.

I tried "column has terminators", it did not help.

Don't this need to be deleted before opening the file or would abort?

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 9:46 am

So what you are trying to say is, when you are picking up the original ftp'd file, there is no box present, but when you copy it a different folder it magically shows up???
How are you copying the file? Is via datastage job or through some other mechanism?

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 9:54 am

Ok. Did some testing.
Go to the Seq. File -> outputs tab -> columns.
Scroll right to the "Incomplete Column" property and select replace. What replace does is it replaces it with NULL.
This was atleast your job wont abort. You can then handle this particular row from not being passed on in the transformer by constraining it.

chulett · Post by **chulett** » Wed Nov 22, 2006 10:09 am

rodre wrote:The box shows up after the last row on a new line.

That's because it is an 'EOF' marker, a.k.a a Control-Z if I remembers me DOS days. Should be a way to transfer the file without that little booger.

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 10:11 am

You are correct Craig. It is control Z. I dont know about dos but in unix it is control z (^Z).

rodre · Post by **rodre** » Wed Nov 22, 2006 10:13 am

Changing the "Incomplete Column" to Replace, it gives a compile error:

"The incomplete value of Column Name must have values in ascending order"

What does this mean?...

chulett · Post by **chulett** » Wed Nov 22, 2006 10:15 am

You have to start at 'the end' and work your way back to the beginning with that particular option.

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 10:17 am

You have to specify that at the last column. I just tested it. The job runs fine.

rodre · Post by **rodre** » Wed Nov 22, 2006 10:25 am

GREAT....Thanks for your help!!!! the file loads now.....

What is the best way to delete that empty row? In the transformer or is a filter command...

DSguru2B · Post by **DSguru2B** » Wed Nov 22, 2006 10:35 am

specify the constraint

Code: Select all

inlink.FIRST_COLUMN <> ""

ray.wurlod · Post by **ray.wurlod** » Wed Nov 22, 2006 11:08 am

DSguru2B wrote:You are correct Craig. It is control Z. I dont know about dos but in unix it is control z (^Z).

My understanding is that Ctrl-Z is the DOS end-of-file character, and that the UNIX end-of-file character is Ctrl-D.