Connecting to HDFS via Datastage 9.1 installed on windows

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: Connecting to HDFS via Datastage 9.1 installed on window

Post by chulett »

ssk wrote:Does that mean I won't be able to go ahead?
Yes, that is exactly what that means. Others will have to chime in to say if support was added in a later version but my quick attempt to google something up failed miserably. :(
-craig

"You can never have too many knives" -- Logan Nine Fingers
ssk
Participant
Posts: 7
Joined: Thu Oct 29, 2009 12:24 am

Post by ssk »

Thanks chulett for your reply.

Unfortunately, the 11.3 version also has the same message! :(

I wonder if anyone has come across this situation earlier.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Yes, which is one of the reasons they chose to install on Linux.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

Post by rkashyap »

For sourcing data from hadoop at non Linux/AIX IIS installations, workaround suggested by IBM is "For read only operations, JDBC/HIVE interface can be utilized".

We have not tried it.
ssk
Participant
Posts: 7
Joined: Thu Oct 29, 2009 12:24 am

Post by ssk »

Thanks ray, rkashyap.

I will check the JDBC connection part.
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

For what it's worth, the option is there....the File Connector supports WebHDFS and HttpFS protocols for reaching into Hadoop for hdfs.... I am using that on my Linux images, so haven't had a need to test it with my Windows image, but the option is there (in Windows 11.5) in the File Connector.....

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
adityavinay
Participant
Posts: 32
Joined: Tue Dec 13, 2011 7:27 am

Post by adityavinay »

Are you able to connect to HIVE using JDBC connection?
ssk
Participant
Posts: 7
Joined: Thu Oct 29, 2009 12:24 am

Post by ssk »

Have not tried it yet. Though I vaguely remember to have read somewhere that this connection is possible.
Post Reply