DSXchange

Hi Ray, Current job : Sort stage followed by remove dup stage. In sort stage partition by col1,col2,col3 and then sort by col1,col2 col4. col1 and col2 asc order sort, whereas col4 desc sort. Now in remove dups there is remove dup on col1,col2,col3. Currently wt is missing in current job is the part...

We have used netstat and telnet commands to test the port. The Biginsights (hdfs) machine is listening fine too. Below is the exact error we are getting.

Unable to connect to hdfs host on port 9000: Socket operation on non-socket.


Thank you.

Hi, we are using sort stage followed by remove duplicates stage in a datastage job. Hash partioning done on col1,col2,col3 and sorting done on col1,col2 col4 in sort stage. Now in remove duplicates stage removing duplicates on col1,col2,col3. Retaining the first row in remove duplicates stage. Remov...

Hi,

The syncbi.sh command is not available at the path below:
<IS_install_path>/Server/biginsights/tools

The datastage version being used is 9.1.

The folder biginsights itself is not present in the Server folder. Is it because of the datastage version.


Thanks

The Hadoop server is listening fine. Below is the exact error which we are facing :

Unable to connect to hdfs host on port 9000: Socket operation on non-socket.

hi,

We are getting the following error while connecting to HDFS through Big Data File Stage

Unable to connect to host hdfs server though port 9000.

Can anyone who worked on bdfs stage let us know what is causing this error.

The biginsights server is pinging fine from DS Engine server.



Thanks.

Hi,

1) Is BDFS patch available for version 8.7.

2) We have a BDFS patch to be installed for using the BDFS stage. Do we also need to install IBM Infosphere Biginsights which hosts the HDFS for using BDFS stage.




Thanks.

Hi, I would like to generate multiple rows from a single row and each row is dependent on the previous row. I have implemented this using stage variables by storing the values of prev and curr record. For looping I have used a constraint which increments the count and checks for the required count. ...

Hi,

Can anyone let me know the main Architectural difference between versions 7.5 and 8.1

chulett wrote:Figured I'd start with sorted and go from there.

Should the data be sorted and hash partitioned or just sorted?


Thanks

hi,

I have an issue with the remove duplicates stage in the job. It is not removing the duplicates based on the key, even though identical values are coming in the key.
Could you please let me know why this could happen.



Thanks

Below is the format required : <note ElementID="x"> - <Table> <MANDT>n1</MANDT> <MATNR>n2</MATNR> <SPRAS>n3</SPRAS> <MAKTX>n4</MAKTX> <MAKTG>n5</MAKTG> </Table> - </Table> <MANDT>p1</MANDT> <MATNR>p2</MATNR> <SPRAS>p3</SPRAS> <MAKTX>p4</MAKTX> <MAKTG>p5</MAKTG> </Table> ' ' ' ' ' ' -</note...

Root element is "the parent" of all other elements.

Format :

<root>
<child>
<subchild>.....</subchild>
</child>
</root>

Thanks

Hi, I need to generate an XML document which has a root element. I am able to get the rest of the document except the root element. I have checked the best practices document. Did not get much help. I feel I am missing something here.How do I obtain this root element using the XML output stage. Kind...

Do we have any option on the XML output stage to spilt the files based on the number of records.



Thanks