Using the BDFS stage to connect to Hadoop server

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
udayanguha
Premium Member
Premium Member
Posts: 37
Joined: Wed Oct 29, 2014 10:48 pm
Location: Ohio

Using the BDFS stage to connect to Hadoop server

Post by udayanguha »

Hi,
I want to extract some files from a Hadoop server to my Datastage server using the BDFS stage.
I am able to ping the Hadoop server from UNIX server but when I use the BDFS stage, its unable to connect to specified server and port.

I went through the links provided by at IBM knowledge center:

http://www-01.ibm.com/support/knowledge ... ml?lang=en

But I am unable to understand anything explained in this. Can someone please help me in a less complicated way how to configure the environment for using the BDFS stage.
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

Post by rkashyap »

Which flavor of Unix is on DataStage server?
udayanguha
Premium Member
Premium Member
Posts: 37
Joined: Wed Oct 29, 2014 10:48 pm
Location: Ohio

Post by udayanguha »

Hi,
we are using the Linux version of UNIX
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I don't know if this is critical or not to the discussion but would wager that the next question would be - what flavor of Linux? There are... several.
-craig

"You can never have too many knives" -- Logan Nine Fingers
udayanguha
Premium Member
Premium Member
Posts: 37
Joined: Wed Oct 29, 2014 10:48 pm
Location: Ohio

Post by udayanguha »

I am not very sure about the Linux version right now but will update later on once I get to my system. But still suggestions and solutions for Hadoop connectivity are welcome.
udayanguha
Premium Member
Premium Member
Posts: 37
Joined: Wed Oct 29, 2014 10:48 pm
Location: Ohio

Post by udayanguha »

Any suggestions on this :)
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Contact support if none of those steps make sense to you. Or do you have a DataStage admin that could work through them for you?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply