FTP Enterprise Transform in sftp mode.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mczern
Premium Member
Premium Member
Posts: 80
Joined: Thu Jan 20, 2005 8:38 am
Location: Atlanta, GA
Contact:

FTP Enterprise Transform in sftp mode.

Post by mczern »

Has anyone seen an issue after setting up a passwordless sftp connection between servers and then attempted to use the FTP Enterprise transform as a target and set to sftp mode?

I can perform a command line sftp 'put' to the target server without any issues.

However, when attempting to use the FTP Enterprise target stage in sftp mode, the file gets created on the remote server, but has no content.

Th strangest part is that the DataStage job runs to completion with no errors or warnings.

Any advice or guidance on how to debug this issue would be greatly appreciated.
Mike Czerniawski
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

what version of SFTP are you using?

Is it the open source kind or someone else's flavor?
mczern
Premium Member
Premium Member
Posts: 80
Joined: Thu Jan 20, 2005 8:38 am
Location: Atlanta, GA
Contact:

Post by mczern »

Not open source..
Linux /usr/bin/sftp

password-less setup using public key generation and entries added to know_hosts file.
Mike Czerniawski
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

type "sftp -V" or even "ssh -V"

The Enterprise stage is coded to the open source APIs. If your brand of SSH is not coded to the open source APIs, you're going to have to do the following:

A) influence IBM to create a patch for you to enable your flavor of SSH/SFTP to be functional with their tool. (not an easy task, trust me, been there done that)

B) scrap the ftp enterprise stage and go with an Execute Sequencer Stage and do a command line call for your SFTP needs. (we did that).


Since your file is a 0 byte file on your target system... that means you actually did an SSH connection and that something else is at fault. You might want to verify your settings. Try SFTPing to yourself first. Work out the kinks locally, then go remotely.

Is the version of SFTP common between both systems?
mczern
Premium Member
Premium Member
Posts: 80
Joined: Thu Jan 20, 2005 8:38 am
Location: Atlanta, GA
Contact:

Post by mczern »

sftp -V does not work..
However...
ssh -V
OpenSSH_4.3p2, OpenSSL 0.9.8e-fips-rhel5 01 Jul 2008
Mike Czerniawski
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

So yes, your SFTP is open source.

The FTP Enterprise stage should interface with it properly.

Look to see if you have proper file permissions on the directory you are writing into. Look to see if you have read authority on the file you are sending. (I know it worked from the command line, but when you execute in DataStage you could be credentially mapped to execute as someone else.)
Post Reply