System Crash due to the usage of "Loop Condition"
Posted: Wed Nov 16, 2011 6:39 am
Hi,
I have a requirement where I need to split a free text column (which mostly exceeds 255 chars) coming in the input row and insert them as multiple rows in the output with each having splitted chunk from the free text column.
So, I have used Loop Condition in Transformer to split the columns with the following Loop Varaibles:
stgTrim -> Col1[stgStart+1,132]
stgStart -> stgStart+132 (stgStart initialized to 0)
stgCnt -> @Iteration
Loop While -> stgTrim<>''
The logic works fine with sample records.
But when I run this job with the actual file, DS hangs and the server crashes.
After analysis, it was found that there was a big peak in the memory usage every time I had run that job which killed the server.
So I wish to know an alternative to implement this or How can I restrict the memory usage of this job.
Thanks and Regards,
Abhishek
I have a requirement where I need to split a free text column (which mostly exceeds 255 chars) coming in the input row and insert them as multiple rows in the output with each having splitted chunk from the free text column.
So, I have used Loop Condition in Transformer to split the columns with the following Loop Varaibles:
stgTrim -> Col1[stgStart+1,132]
stgStart -> stgStart+132 (stgStart initialized to 0)
stgCnt -> @Iteration
Loop While -> stgTrim<>''
The logic works fine with sample records.
But when I run this job with the actual file, DS hangs and the server crashes.
After analysis, it was found that there was a big peak in the memory usage every time I had run that job which killed the server.
So I wish to know an alternative to implement this or How can I restrict the memory usage of this job.
Thanks and Regards,
Abhishek