Page 1 of 1

Unable to read entire data of a text col when data is huge

Posted: Tue Jul 30, 2013 2:20 am
by Sagnik Mukherjee
Hi,

i have one text column in one file. I am trying to read that column by varchar or long varchar. Now the problem is the data which are coming are so big, DS is not able to read full data. Data which exceeds the maximum length got truncated. Do we have any data type which can raed more character than long varchar? or is there any other solution to read the entire data?

Posted: Tue Jul 30, 2013 2:55 am
by ArndW
What limit have you reached, i.e. at what length does truncation occur? Since your file contains only one column per row, you could declare your data as having 2 columns and declaring the file without a column separator.
Do you need to process this long column?

Posted: Tue Jul 30, 2013 7:43 am
by arunkumarmm
How long is your text column actually in the file? I remember using longvarchar to read from CLOB or to read the source XML files.

Posted: Tue Jul 30, 2013 11:40 am
by rajendra123
What kind of processing are you doing on such huge data?

Posted: Tue Jul 30, 2013 2:46 pm
by eostic
Another useful question is exactly how large are we talking about?

Posted: Tue Jul 30, 2013 4:42 pm
by ray.wurlod
If the "Data which exceeds the maximum length got truncated" message occurred in the data browser (view data), that's a limit in the data browser only. You should ignore it.