Multiple recordtypes in a single flatfile

victorbos · Post by **victorbos** » Wed Apr 20, 2005 8:26 am

Hi all,

I have a sequentialfile as input that has two recordtypes.
The two recordtypes are of a completly different layout.
I have a table definition for both recordtypes. Can I use those to write the contents of the file to two database tables?

thanks in advance,

Victor

mkeevil · Post by **mkeevil** » Wed Apr 20, 2005 8:30 am

Most times when I have a file with 2 or more differnt layouts, the file should have a record type indicator, something to tell you what kind of record it is. You can probably use this indicator in the Transform stage to direct the record though the correct layout and into the correct file.

victorbos · Post by **victorbos** » Thu Apr 21, 2005 12:06 am

Yes, I do have a recordtype indicator.
The trouble is that when I split the file in a Transformer, I cannot use the sequentialfile-definition to read the record into columns, but am forced to use lots of substrings [,] to read the record.....

Victor

ArndW · Post by **ArndW** » Thu Apr 21, 2005 12:15 am

Victorbos,

you can define your original file read in any column definition form as long as you can check your indicator field in a transform; I usually define the whole row as just one column if possible. Then, instead of having to parse out all of your columns, just write the data back to a file (I usually will use a pipe here to save I/O time) and read from that file using the correct column definitions. It is easy to do and also quite efficient.

chulett · Post by **chulett** » Thu Apr 21, 2005 7:06 am

Nice.

tonystark622 · Post by **tonystark622** » Thu Apr 21, 2005 7:46 am

I believe with the newer versions of DataStage that you can use a RowSplitter stage to take the single column in and split it out into individual columns.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Thu Apr 21, 2005 7:48 am

Yes. RowSplitter does the trick.

fridge · Post by **fridge** » Thu Apr 21, 2005 9:43 am

You can also use the Complex File Stage with multiple output links - the selection page allows you to define the field as the rectype indicator and each output link can have different table defs on it

Its a more elegant, and understandable solution but I am not sure about performance vs reading from a seqstage - but these things are often a balance.

Ed

victorbos · Post by **victorbos** » Mon Apr 25, 2005 3:08 am

Thanks for all the help!
The solution with a pipe runs smooth.

Victor