Split big column into records

getsatish_gk · Post by **getsatish_gk** » Tue Mar 12, 2013 11:55 am

I have a one column which has
id,tax_input,tax_amt,tax_address | id,tax_input,tax_amt,tax_address

I want to split this into records based on delimited '|'
id,tax_input,tax_amt,tax_address
id,tax_input,tax_amt,tax_address

this should happen on dynamically based on '|' as record separator.

prasson_ibm · Post by **prasson_ibm** » Tue Mar 12, 2013 12:25 pm

Which version of datastage you are in.?

prasson_ibm · Post by **prasson_ibm** » Tue Mar 12, 2013 12:30 pm

I am assuing you are in 8.5 or above version,you can check below post,I have given solution,you need to apply only one transformer,check only logic for tsfm2

viewtopic.php?t=149150

bob7027 · Post by **bob7027** » Tue Mar 12, 2013 12:34 pm

getsatish_gk : use field option for '|' in transformer, then use Pivot stage to convert into rows

ray.wurlod · Post by **ray.wurlod** » Tue Mar 12, 2013 3:36 pm

If the source file is a text file, you could use a Filter command such as sed or awk to convert the pipe delimiters into line terminators. (Even though you are on Windows, the MKS Toolkit provides these commands.)