Split a record into multiple records

rajendharreddy · Post by **rajendharreddy** » Thu Mar 31, 2011 7:05 pm

Hi,

I have a requirement as mentioned below. I need to split one record into multiple columns as shown below.

Input Record
---------------
Col1
a,b,c,d
d,e
f,g,h

Col1|Col2|Col3|Col4
a|b|c|d
d|e
f|g|h

Could anyone help me out on the above.

Thanks in advance.

Regards,
Raj

ray.wurlod · Post by **ray.wurlod** » Thu Mar 31, 2011 8:00 pm

Concatenation in Transformer stage.

Column Export stage.

soumya5891 · Post by **soumya5891** » Fri Apr 01, 2011 12:41 pm

You can use a transformer stage variable also to split the records

senthil_k · Post by **senthil_k** » Mon May 16, 2011 7:36 am

Use Field Function in transformer

vamsi.4a6 · Post by **vamsi.4a6** » Mon May 21, 2012 12:52 am

ray.wurlod wrote:Concatenation in Transformer stage.

Column Export stage. ...

My idea to get the required output is as follows

1)Input is read as once column as id

2)count the no of delimiters in each record and Concatenatinating required delimiters for example for second record input is -d,e so i am adding d,e,, since the no of fields in the output is four.

3)Then using column import stage to parse the one column into four columns

Just want to know how to get the required o/p with Concatenation and Column Export stage.Please correct me if i am wrong?

priyadarshikunal · Post by **priyadarshikunal** » Mon May 21, 2012 5:59 am

approch is dependant on what you want. Are you going to write it directly to a file then you just need to replace the delimiters from comma to pipe and add a header for column names using convert().

if you need to split the incoming column in four columns then you can read it in single column and feed it to column export stage.

It can also be done in a transformer to split the columns using field function and then you may need to do null handling for missing values if performing the task in stage variables.

vamsi.4a6 · Post by **vamsi.4a6** » Mon May 21, 2012 7:48 am

@priyadarshikunal

if you need to split the incoming column in four columns then you can read it in single column and feed it to column export stage.

Doubt:for splitting the column one from i/p to four columns we will use column import stage not column export stage.please correct me if i am wrong?

vamsi.4a6 · Post by **vamsi.4a6** » Mon May 21, 2012 10:06 pm

vamsi.4a6 wrote:@priyadarshikunal

if you need to split the incoming column in four columns then you can read it in single column and feed it to column export stage.

Doubt:for splitting the column one from i/p to four columns we will use column import stage not column export stage.please correct me if i am wrong?

Could anybody please clarify on the above point for column import stage?

chulett · Post by **chulett** » Mon May 21, 2012 10:16 pm

What above point, exactly? If you are unsure which 'direction' the Column Import or Column Export stages go, why not simply check the documentation? It is stated quite clearly there.