View data in CFF

BIuser · Post by **BIuser** » Wed Jun 08, 2011 9:06 am

Hi There,

We are using a CFF stage to read one of our input file

We are able to view the all columns properly but when we view it in datastage each record is shown as 4 times

If i have 2 records in the input file, it shows 8 records when i view the data from Datastage, when i tried to load the file to Dataset it loads 8 records but the performance statistics shows only 2 records

Any ideas please

Regards

rcanaran · Post by **rcanaran** » Wed Jun 08, 2011 11:54 am

Is your datastage configuration running with 4 nodes, with the partitioning (dataset properties, input tab, partitioning subtab) set to ENTIRE ?

Mike · Post by **Mike** » Wed Jun 08, 2011 12:11 pm

One possible scenario: you have an array of 4 elements (e.g. OCCURS 4 TIMES) that you've told the CFF stage to normalize: 2 records * 4 elements = 8 normalized records.

Mike

BIuser · Post by **BIuser** » Wed Jun 08, 2011 12:40 pm

Hi Mike,

Please let me know where can i set the array size

Regards

Mike · Post by **Mike** » Wed Jun 08, 2011 12:45 pm

You don't.

The array is defined in the COBOL FD that you presumably imported. You decide at design time whether to normalize or flatten the array based on your transformation requirements.

Mike

BIuser · Post by **BIuser** » Wed Jun 08, 2011 1:05 pm

Hi Mike,

We selected the option of As-Is while importing

Should we make changes to this option.

As per the design we have to get rid of these duplicates before processing

Please advise

Many thanks for your support

Regards

Mike · Post by **Mike** » Wed Jun 08, 2011 1:31 pm

It's been a while, but I don't think you decide when importing the COBOL FD.

It would be an option when you load the column metadata into the CFF stage.

Mike

FranklinE · Post by **FranklinE** » Wed Jun 08, 2011 3:46 pm

That's certainly true in 7.5.2.

I'm an old COBOL dog, so I don't hesitate to edit the copybook before importing it, deciding on arrays and redefines myself. When I deal with mainframe data, it's always going to or from some other platform (usually Unix) where COBOL formatting is not very useful.

BIuser · Post by **BIuser** » Fri Jun 10, 2011 6:36 am

Hi All,

We got this working by selecting the Flatten Arrays while selecting the columns.

We are getting source files from the Packed Decimal (Comp 3) and EBCDIC format

But when we select the character set as EBCDIC, we are not able to view the data, but we can view the data (Partially-some columns) if we select the character set as ASCII

When we select the character set as EBCDIC, we are getting the below error as

Input buffer overrun at field "FIELD NAME"

Please advise if i have to bring any settings in

Regards

Mike · Post by **Mike** » Fri Jun 10, 2011 7:58 am

The fact that you can partially view the data when you select ascii likely means that the file was transferred in ascii mode... all of your packed decimals will be destroyed.

There was a recent post, I think, where James and Franklin provided some excellent information regarding ftp of mainframe files.

Mike