Regarding FTP STAGE

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

vijaykumar
Participant
Posts: 228
Joined: Tue Oct 03, 2006 7:08 pm

Regarding FTP STAGE

Post by vijaykumar »

Hi Gurus,

My team is asking me to show how FTP works.
I said to them that, basically inorder to work with FTP one needs mainframe environment, and it is mainly used to migrate files from one system to another. My database is oracle.How can i use FTP component and show them the way FTP works.

cheers;
vijay
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

I think you need to go over the ftp.pdf help document. It will tell you how to set it up and get it running.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
I_Server_Whale
Premium Member
Premium Member
Posts: 1255
Joined: Wed Feb 02, 2005 11:54 am
Location: United States of America

Re: Regarding FTP STAGE

Post by I_Server_Whale »

vijaykumar wrote:inorder to work with FTP one needs mainframe environment
Not necessarily.
vijaykumar wrote:it is mainly used to migrate files from one system to another.
vijay
True.
Anything that won't sell, I don't want to invent. Its sale is proof of utility, and utility is success.
Author: Thomas A. Edison 1847-1931, American Inventor, Entrepreneur, Founder of GE
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

It's used to "read" a remote file. It's not intended to "move" files. Command line FTP will move many files faster with imposing metadata reading characteristics and will move compressed files.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Re: Regarding FTP STAGE

Post by narasimha »

vijaykumar wrote:My database is oracle.
FTP has nothing to do with your database.
You need to note that there are differences with how the command line FTP and the FTP Stage work.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
Saama
Premium Member
Premium Member
Posts: 83
Joined: Wed Nov 22, 2006 6:42 pm
Location: Pune
Contact:

Post by Saama »

Hi Gurus,
How to work around with FTP document, iam not able to access the Help document on FTP which you specified GURU. can anyone help me so that i can show a example to my team lead, how ftp works.

cheers;
vijay
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Saama wrote:How to work around with FTP document, iam not able to access the Help document on FTP which you specified GURU.
The help is available in the DS Online Manuals.
If that does not help get back
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
us1aslam1us
Charter Member
Charter Member
Posts: 822
Joined: Sat Sep 17, 2005 5:25 pm
Location: USA

Post by us1aslam1us »

you can access them from your computer. From something like this

Code: Select all

C:\Program Files\Ascential\DataStage7.5\Docs\ftp.pdf
I haven't failed, I've found 10,000 ways that don't work.
Thomas Alva Edison(1847-1931)
vijaykumar
Participant
Posts: 228
Joined: Tue Oct 03, 2006 7:08 pm

Post by vijaykumar »

Hi Gurus,

My design is FTP------>SEQUENTIAL FILE.

Iam selecting the file whose path is c:\HashFiles\vijay\salma
i want to dump the data in that file into sequential file.

In the FTP properties.
server name- system name----->i entered the system name.
user name- i entered Admin
since this is my user name.
In the outputs tab, I enteres the path as /c:/Hashfiles/vijay/saaa
This is the path of the file.

Iam getting error- Unable to connect to remote server.Please help me Gurus

cheers;
vijay
rleishman
Premium Member
Premium Member
Posts: 252
Joined: Mon Sep 19, 2005 10:28 pm
Location: Melbourne, Australia
Contact:

Post by rleishman »

My FTP stage runs on Unix, reads from Unix, and writes to a Sequential file. I used it because I had just one file to get, and was too lazy to code a shell script with all of the appropriate error handling and logging that I get for free with DS.

General Tab
Server Name: <Same as I use in command line FTP>
Remote FTP Port: 21
Remote Telnet Port: 23
User Name: <Same as I use for command line FTP>
User Password: <Same as I use for command line FTP>
Tracing Level: 0
Retries: 3
Retry Interval: 15
Number of Telnet Prompts: 2
Telnet Prompt 1: login
Telnet Prompt 2: password
All others: <empty>

Properties Tab
Remote Path: <Same as I use with 'cd' for command line FTP>
Remote File name: <same as I use with 'get' for command line FTP>
Data Representation Type: ascii
Check Data Against Metadata: no
Line Termination: LF
Fixed Width Columns: No
Spaces between Columns: 0
Column Delimiter: 1
First Line Column Names: No
FTP Data Connection Mode: Active
Link Tracing Level: 0
Buffer Length: 4096
All Others: <empty>

Columns Tab
A single column called FTP_DATA of type VARCHAR. The length is unimportant because we set the parameter not to validate it.

This has been working reliably for me.
Ross Leishman
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: Regarding FTP STAGE

Post by ray.wurlod »

vijaykumar wrote:Hi Gurus,

My team is asking me to show how FTP works.
I said to them that, basically inorder to work with FTP one needs mainframe environment, and it is mainly used to migrate files from one system to another. My database is oracle.How can i use FTP component and show them the way FTP works.

cheers;
vijay
Do they mean FTP (the protocol) or the DataStage FTP stage? Either way your assertion about mainframe environment is completely incorrect; FTP can be used to transfer files between any operating system and any other. FTP = "File Transfer Protocol".

Why did your team ask you to show how FTP works, and what is meant by "show" in this context?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Saama
Premium Member
Premium Member
Posts: 83
Joined: Wed Nov 22, 2006 6:42 pm
Location: Pune
Contact:

Post by Saama »

Hi Gurus,
Iam using datastage FTP STAGE to retrive the file which is in c directory of my system and dumping into oracle database using ODBC.

we never used FTP , we just want to analyze how FTP works ie properties of FTP. As Gurus explained in unix environment, what happens in windows environment. Iam getting error- failed connecting FTP SERVER. How can i resolve this error.

what would be my FTP SERVER NAME.

please Gurus help me.

cheers;
vijay
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Saama wrote: Iam using datastage FTP STAGE to retrive the file which is in c directory of my system and dumping into oracle database using ODBC.
Not sure it thats a good aproach, but its is option though.
I would break this up into two steps.
- Do the FTP first, get the file.
- Load file into Oracle.
Saama wrote: what would be my FTP SERVER NAME
The server name, from where you are pulling your data.

Also try to do your FTP using command line first and check if you get the same errors.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
vijaykumar
Participant
Posts: 228
Joined: Tue Oct 03, 2006 7:08 pm

Post by vijaykumar »

Hi,
I dont have access to FTP.
My file is in local directory itself.
Inorder to do FTP , what should i do, can i use FTP to retrieve from my local directory.please help me.

cheers;
vijay
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

That one's easy. Don't.

FTP is about remote files. Use Sequential File stage or Complex Flat File stage to read local files. Always.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply