Trying to pass a Cntrl A as a delimiter to Hadoop

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
JPalatianos
Premium Member
Premium Member
Posts: 306
Joined: Wed Jun 21, 2006 11:41 am

Trying to pass a Cntrl A as a delimiter to Hadoop

Post by JPalatianos »

Hi
We are running DataStage 11.5 on Red Hat Linux and we are connecting to Cloudera's version of Hadoop utilizing the File Connector stage. The Hadoop admins are requesting that we use a ctrl-A as a column delimiter. They told us that the physical value is "\001". We tried putting this in the delimiter property but they end up receiving the "\001" between columns.

Is anyone else attempting this?

Thanks - - John
JRodriguez
Premium Member
Premium Member
Posts: 425
Joined: Sat Nov 19, 2005 9:26 am
Location: New York City
Contact:

Post by JRodriguez »

Try escaping the back slash.....and format as Unicode character like below

\\u0001
Julio Rodriguez
ETL Developer by choice

"Sure we have lots of reasons for being rude - But no excuses
Post Reply