DSXchange

Hi,
I need to read the data from an URL.
If i click on URL,it displays a pipe delimeted data as shown below.

Name|Place|State
xx|yyyy|zz
kk|fff|ee
Please suggest me what stage can i use to read this data?

Hi Kandy, I removed the funnel stage and placed join stage. I performed inner join based on the key generated and passes the elements and values on two columns Next in the transformer stage i inserted newline character after elements. So now i'm getting them in proper order :D . Thanks for your valu...

I tried funnel stage by setting different properties.But the data is received as the values first and then the elementsi.e data from second link first and then the first link.

2,3
p,q

2,3,3
x,y,z

Are you specific about the order of output rows? Hi Kandy, I resolved that issue by placing previouskey stage variable after the concatenation stage variable. Now i need to funnel out the data like 1st record from 1st transformer containing elements and 1st record from other transformer containing ...

Thanks Kandy for your valuable time .I will try to find out and let you know.

Ya i also tried setting sequential mode in second transformer and it is giving the output as
p1
p,q1
p,q,x2
p,q,x,y2
p,q,x,y,z2

I am exactlly implementing the same logic as you mentioned. As i generated the rownumber in first transformer by setting execution mode as sequential,when iam further passing col1 and rownumber to another transformer,the data is getting partitioned and the output of concatenation is like q,1 q,y,2 p...

My input data will be from a transformer stage where i will be getting xml files,each xml containing different elements. so,i am extracting the elements from the xmls under two columns.one column containing element name and other containing the values. if xml1: <xml><p>2</p><q>3</q> xml2: <xml><x>2<...

Yes my issue will be resolved if pivot_column have different values after concatenation.
a 1
a,b 1
a,b,c 1

x 2
x,y 2
x,y,z 2

Just assign 1 to pivot column and process in transformer stage. When done, sort by your new (concatenated) column in desc order and take the first record by using the appropriate stage ;) Hi kandy, But the earlier approach is giving me the problem when readng more than 2 files. During concatination...

Remove unwanted rows by adding another stage ;) Hi Kandy, Instead of dummy column pivot,i took a column called row_num and assigned it to @inrownum system variable. so that data from each file can have a unique key i.e file1: ,a 1 ,a,b 1 ,a,b,c 1 file2: ,x 2 ,x,y 2 ,x,y,z 2 so that i can arrange th...

qt_ky wrote:I don't see any tar -O option on my flavor of UNIX... What does -O do?

-O is for standard output

deepa.y wrote:concat=if currentkey=nextkey then concat:lnk_input.col1 else ''

Sorry there is mistake in my previous reply.
concat=if currentkey=nextkey then concat:","
:lnk_input.col1 else ''

Hi, I implemented the following logic I took a column pivot and assigned value 1 . Then in stage variables,i gave current key=pivot nextkey=currentkey concat=if currentkey=nextkey then concat:lnk_input.col1 else '' and it is giving me the following output. ,a ,a,b ,a,b,c--->need to read this row and...

Hi Kandy,
Could you please explain me in detail?