Hadoop and Datastage EE
Posted: Thu Nov 04, 2010 7:00 am
Hadoop - http://en.wikipedia.org/wiki/Hadoop
I'm looking at playing with the Hadoop API and creating a buildop for write operations. Anyone out there worked with Hadoop.
I've created buildops before so I'm fine on that side of the ledger. I suspect that with hadoop I'll need to pay attention to partitioning on the outbound connector.
Just to clarify, at the present time I'm only interested in playing with updating the HDFS file system. Not playing with Map reduce, etc.
Thanks for any insite.
Regards,
Ray D
I'm looking at playing with the Hadoop API and creating a buildop for write operations. Anyone out there worked with Hadoop.
I've created buildops before so I'm fine on that side of the ledger. I suspect that with hadoop I'll need to pay attention to partitioning on the outbound connector.
Just to clarify, at the present time I'm only interested in playing with updating the HDFS file system. Not playing with Map reduce, etc.
Thanks for any insite.
Regards,
Ray D