length of text file truncated...

srinath51 · Post by **srinath51** » Mon Mar 05, 2012 10:07 am

Hi All,

i am generating a text file as an Output with the SIze as 1200Bytes.

i have data for the 444 bytes of data and as per the Req I have to append 756 bytes of remaining data with Spaces.

My question is when i hard-code the 756 bytes of data with the Spaces and Run the job and see the text file then in the final text file,i am getting the data truncated.
so in the final output text file instead of getting 1200 bytes of data i get only 953 bytes of data ,somehow the last 247 bytes are being truncated...

Please Help me on how i can see the 1200 byte data as per req...

jwiles · Post by **jwiles** » Mon Mar 05, 2012 11:56 am

What is your output schema?

How are you populating the additional spaces? In a transformer? What is the derivation?

Regards,

srinath51 · Post by **srinath51** » Mon Mar 05, 2012 12:26 pm

Hi Jwiles,

i am writing the output to a Sequential file.

i am populating the Additional Spaces i.e; 756 within the transformer.

the Derivation is - Space(756)

jwiles · Post by **jwiles** » Mon Mar 05, 2012 12:48 pm

What is your output schema (i.e. metadata), especially for the new data? Hint: Sequential File stage is NOT a schema...

Regards,

srinath51 · Post by **srinath51** » Mon Mar 05, 2012 1:10 pm

HI JWILES,

I didnt understand the question...
Do you mean the format for the output file ??

the output file has 2 predefined fields named "fixedrec1" & "fixedrec2"

the format is varchar.

jwiles · Post by **jwiles** » Mon Mar 05, 2012 2:14 pm

As a Datastage developer, you should understand the question...it is common terminology for DataStage and is discussed during DS training and constantly here on the forums.

Yes..the layout/format of the file. As in:

Code: Select all

Field1  VarChar(250)
Field2  VarChar(250)

Your answer tells me there are two varchar fields, but tells me nothing about defined lengths (if any), leaving me and others to either make assumptions (which can often be incorrect and is dangerous) or to pry further details from you to build a complete picture of the situation and job design.

As you are apparently working with fixed-length records (is this correct?), have you tried defining the columns as Char instead of VarChar?

Regards,

srinath51 · Post by **srinath51** » Mon Mar 05, 2012 2:34 pm

Hi Jwiles,
i am a junior Datastage developer,learning ...

Here is the layout for the fields:
i didnt define the lengths of the fields below,they are fixed lengths.

fixedrec1 varchar
fixedrec2 varchar

i tried using the char,but still getting the truncated data for the last 247 bytes of data...

jwiles · Post by **jwiles** » Mon Mar 05, 2012 3:16 pm

No worries...we all have to start somewhere.

In IS 8.5 I can successfully create a 1200 byte record using the method you described. I'm not aware of a limitation within 7.5 concerning the data length and have no way to test in that version.

Do your input records (containing only one column?) ALWAYS contain exactly 444 bytes of data? Are they in a sequential file or coming from another data source such as a database? If your incoming data is short (<444 bytes), then you probably need to make up the difference in your job so that your output is 1200 bytes.

Regards,

srinath51 · Post by **srinath51** » Mon Mar 05, 2012 3:33 pm

hi jwiles,

now i defined the lengths as 444 and 756 respectively for the fields and i am getting the 1200 bytes data.

thanks for your suggestions....

Kryt0n · Post by **Kryt0n** » Mon Mar 05, 2012 3:39 pm

A simpler way may just be to have one output column of type char and length 1200 setting the pad character to space