Multiple Record Types

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
ghutchin
Premium Member
Premium Member
Posts: 45
Joined: Thu Mar 13, 2003 7:34 am

Multiple Record Types

Post by ghutchin »

I've got a file that has multiple record types, each having a header with a record type at the beginning of each row. Each record type has a different record length.

My problem is that the file is on the Mainframe and need to process this file on our Unix server and the FTP stage is having an issue pushing this data to the server. Beyond that, even when the data is FTP-ed via a script initiated on the DS Server, there is no CR/LF at the end of each row. I've tried reading the file with both the CFF and the Sequential file stages and each needs either the metadata to describe the record length or describe the line delimitter.

Anyone run into anything similar to this? If so, please let me know how you got around this.

Thanks,

Gordon
rwierdsm
Premium Member
Premium Member
Posts: 209
Joined: Fri Jan 09, 2004 1:14 pm
Location: Toronto, Canada
Contact:

Re: Multiple Record Types

Post by rwierdsm »

We are doing something similar here at our site.

Our Universal Copy software takes care of translating from EBCIDIC to ASCII and puts the proper CRLF in the data.

We created COBOL copy books to describe the various embedded record types and imported these definitions into the CFF stage. The first three characters in each row (sounds like you have something similar in your data) is used to direct each record type into its own stream (use the selection criteria tab in the CFF stage)

HTH,

Rob W.
Rob Wierdsma
Toronto, Canada
bartonbishop.com
Post Reply