FTP connection

przytula · Post by **przytula** » Tue Nov 09, 2004 2:00 am

Trying to use ftp as input stage
defined connection/port/filename
It is possible to use interactive ftp
I am getting this message when running the stage :
ICPC_FTP..Transform_dates: Internal error: function 'buffer_to_row' failed
ICPC_FTP..Transform_dates: Unable to retrieve column from link
Any idea where to find the reason/explanation of these error codes.
activated debug level but no additional info
Thanks for all help
Best Regards, guy Przytula

przytula · Post by **przytula** » Tue Nov 09, 2004 6:17 am

The file on remote node is accessible with ds, because if I specify fix length fields no. I can see that the complete record is extracted and truncated
Data is displayed
Thanks for all update

chulett · Post by **chulett** » Tue Nov 09, 2004 6:19 am

Yes, it is possible to use the FTP stage as an input stage, but I personally would try to avoid using it in that manner. You are (in most cases) better off to use 'normal' FTP to move the data local to your DataStage server and then picking it up with the Sequential stage.

When you say you 'activated debug but no additional info', what does that mean?

Did you turn on Trace within the Stage? Set the value up high enough to get information about everything going on? There is alot of information that can be gathered into your job log by the trace option, hence the question.

I would guess that your metadata as defined in the FTP stage isn't matching up 100% with your sequential source. The FTP stage isn't going to be as forgiving as the Sequential stage when dealing with troublesome flat files. Things like missing columns, which the sequential stage can handle, can hose up the FTP stage. So, I'd suggest first bringing your source over locally using plain old ftp (which doesn't need any metadata to drive it) and then examining the file, seeing if it has any 'quirks' in the records or data that may be causing you grief.

przytula · Post by **przytula** » Tue Nov 09, 2004 6:22 am

Thanks for the update
That is exactly what I did. copied the file locally and loaded this file. no problem occured in any stage.
trace was activated in ftp stage properties
Best Regards, Guy Przytula

przytula · Post by **przytula** » Wed Nov 10, 2004 12:26 am

This just to indicate that local import is possible but ftp import is still failing
Best Regards, Guy Przytula

chulett · Post by **chulett** » Wed Nov 10, 2004 7:48 am

So, Guy... does this mean your problem is solved well enough or are you still expecting something from this thread?

przytula · Post by **przytula** » Mon Nov 15, 2004 9:20 am

No problem is NOT solved.
I mean : when doing the ftp manually = no problem
when having ds doing the ftp : I get the error
Best Regards, Guy Przytula

T42 · Post by **T42** » Mon Nov 15, 2004 11:07 pm

Did you attempt to run a very simple 1 column file using the FTP stage with source from the same location?

Have you been able to FTP to it directly from the DataStage server successfully? (i.e. use the right paths, using the same username, and so on forth?)

Have you ever been successful using a different server with the FTP stage?

Are you using a different port for your FTP transfer?

What version is your DataStage, precisely?

przytula · Post by **przytula** » Wed Nov 17, 2004 2:39 am

Thanks for all update
I never tested this before - first ds job with remote ftp
tried manual ftp : same uid/pw = no problem
defined a simple file with 1 record and 10 char
same operation on this test file = same problem
ICPC_FTP..Transformer_2: Internal error: function 'buffer_to_row' failed
Best Regards, Guy Przytula

DSXchange

FTP connection

FTP connection

ftp connection

ftp connection

FTP connection