Problem reading Mainframe EBCDIC file

just4geeks · Post by **just4geeks** » Sun Jan 07, 2007 1:16 pm

I am having a problem with complex flat file stage.

I am using Complex flat file stage to extract header and body off of a mainframe file. (EBCDIC format and Binary Record Style, NO CR/LF). The criteria for extraction is value contained in the first field.

It so happens that only one of header or body is extracted. I think I can get the problem across sooner and clearer if you see it yourself.

Here is the link to download the job and the source files. Please enable pop-up blocker before opening the link.
http://www.yousendit.com/download/2VfiCAhRwLh5TA%3D%3D

There are two source files.

The header file contains body and header
The no_header file contains only body.

The job extracts body and header. If I feed the no_header file, the body is extracted completely. If I feed the header file, only the header is extracted. My question is, how do I extract the body and the header from the header file?

Thank you for your time and patience.

kumar_s · Post by **kumar_s** » Sun Jan 07, 2007 6:16 pm

If you use the metadata for the body and if you try to extract the header and body, dont you get the header getting rejected?
Sorry I dont have access to Datastage at the moment. Is your header and body are of same fixed length?

just4geeks · Post by **just4geeks** » Sun Jan 07, 2007 6:27 pm

Thanks for your response.

kumar_s wrote:If you use the metadata for the body and if you try to extract the header and body, dont you get the header getting rejected?
Sorry I dont have access to Datastage at the moment. Is your header and body are of same fixed length?

There are two output links for the Complex flat file stage. One extracts header and the other extracts body. In the output tab of the complex flat file stage properties, there is a dropdown list which shows the two links. I have put down the column descriptions for each of the links. So, the metadata exists for both header and body.

No, the header and body are of different length. But I think its only reasonable to expect them to be of different lengths. Shouldn't the complex flat file stage be able to work it out itself given that the column descriptions are fed into it?

kumar_s · Post by **kumar_s** » Sun Jan 07, 2007 11:29 pm

Dont you get any error or warning message? What happens if you have design to extract body and pass the file with header and body?

thurmy34 · Post by **thurmy34** » Mon Jan 08, 2007 2:53 am

Hi,
Do you set the Start/End Record fields in the selection Criteria tab.
Start=1 End=1 for the header
Start=2 End=0 for the Body.

just4geeks · Post by **just4geeks** » Mon Jan 08, 2007 3:26 am

thurmy34 wrote:Hi,
Do you set the Start/End Record fields in the selection Criteria tab.
Start=1 End=1 for the header
Start=2 End=0 for the Body.

Start=2 End=0 for the Body is an invalid combination. I then tried Start=2 End=2 for the Body. But NO Success either.

thurmy34 · Post by **thurmy34** » Tue Jan 09, 2007 3:38 am

Hi
Sorry for the miscue.
I just want to check the value of this fields.
For the body it's Start=2 End=9999999999999999999 (to be sure to proceed all the rows).
I just download your job, rewrite it and i have one header and 33
bodies in my results file.
By the way you can do the same thing with one link a tranformer and a constraint on the rec_id.

thurmy34 · Post by **thurmy34** » Tue Jan 09, 2007 3:38 am

Hi
Sorry for the miscue.
I just want to check the value of this fields.
For the body it's Start=2 End=9999999999999999999 (to be sure to proceed all the rows).
I just download your job, rewrite it and i have one header and 33
bodies in my results files.
By the way you can do the same thing with one link a tranformer and a constraint on the rec_type.

just4geeks · Post by **just4geeks** » Tue Jan 09, 2007 7:20 am

thurmy34 wrote:For the body it's Start=2 End=9999999999999999999

I typed the exact same number of 9's and I got this error message, "End Record # must be equal to or greater than Start Record #".

Then I filled 9999, and I got no error but no body records either. Also, I confirmed with the mainframe guy and there are 825 body records in the file.

Can you tell me what other changes did you make such that you got 33 body records?

Thanks for your response.

kumar_s · Post by **kumar_s** » Tue Jan 09, 2007 4:11 pm

Try 827. Have you tried passing the Header and Body file into CFF stage which has only Body metadata with a Reject option enabled?

just4geeks · Post by **just4geeks** » Tue Jan 09, 2007 4:28 pm

kumar_s wrote:Try 827. Have you tried passing the Header and Body file into CFF stage which has only Body metadata with a Reject option enabled?

Unfortunately, 827 didn't work either. I tried but couldn't find the reject option in CFF stage? Can you please tell me what tab is it in?

thurmy34 · Post by **thurmy34** » Wed Jan 10, 2007 9:23 am

Hi
Sorry for being so long but I had some issue with my account.

When I rewrote the job I use your files (no_header.txt and header.txt) and in the header.text I have 1 header and 33 Bodies.

The selection criteria tab is set with (for the header link)
Start Record=0 and End record=0
ID Fields=Rec_Type Value=201

The selection criteria tab is set with (for the body link)
Start Record=0 and End record=0
ID Fields=Rec_Type Value=206