I got the below fatal error and I understood that the Dataset when crosses 2GB space, writing data into it is not possible and the job gets failed. Is my understanding correct?
APT_CombinedOperatorController,1: Write to dataset on [fd 19] failed: Error 0
The error occurred on Orchestrate node node2 (hostname XXXXXXXX)
Also i searched in the forum and came to know that I have to give these details as an additional information, to have better idea.
If i use a sequential file instead of dataset, will the problem be solved?ulimit -a
core file size (blocks) unlimited
data seg size (kbytes) unlimited
file size (blocks) unlimited
open files 512
pipe size (512 bytes) 10
stack size (kbytes) 8192
cpu time (seconds) unlimited
max user processes 29995
virtual memory (kbytes) unlimited
or whats the soultion for this problem??
Thanks in advance!!!