Unable to read entire data of a text col when data is huge

Sagnik Mukherjee · Post by **Sagnik Mukherjee** » Tue Jul 30, 2013 2:20 am

Hi,

i have one text column in one file. I am trying to read that column by varchar or long varchar. Now the problem is the data which are coming are so big, DS is not able to read full data. Data which exceeds the maximum length got truncated. Do we have any data type which can raed more character than long varchar? or is there any other solution to read the entire data?

ArndW · Post by **ArndW** » Tue Jul 30, 2013 2:55 am

What limit have you reached, i.e. at what length does truncation occur? Since your file contains only one column per row, you could declare your data as having 2 columns and declaring the file without a column separator.
Do you need to process this long column?

arunkumarmm · Post by **arunkumarmm** » Tue Jul 30, 2013 7:43 am

How long is your text column actually in the file? I remember using longvarchar to read from CLOB or to read the source XML files.

rajendra123 · Post by **rajendra123** » Tue Jul 30, 2013 11:40 am

What kind of processing are you doing on such huge data?

eostic · Post by **eostic** » Tue Jul 30, 2013 2:46 pm

Another useful question is exactly how large are we talking about?

ray.wurlod · Post by **ray.wurlod** » Tue Jul 30, 2013 4:42 pm

If the "Data which exceeds the maximum length got truncated" message occurred in the data browser (view data), that's a limit in the data browser only. You should ignore it.