Hello,
I have a problem with reading xml files up to 49 mb.
My job is like this:
Folder Stage -> XML input -> Transformer -> Seq file
The problem is with memory exceed:
(Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a)
I have increased stack and size kernell parameters (unlimited).
do you know if it is posible to read xml files up 49 mb?
regards,
Cristina.
xml input stage AIX
Moderators: chulett, rschirm, roy
I'm asuming you mean 'over' 49MB. Try using the 'URL/Filepath' option in the XML Input stage with only the first column declared in the Folder. Remove the second one that passes in the full contents of the file, let the XML Input stage do that.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
I had a similar problem, and this was the solution that was recommeded relating to xml file size.
viewtopic.php?t=113623&highlight=xml
Hope it helps.
Jason
viewtopic.php?t=113623&highlight=xml
Hope it helps.
Jason
the size of the xml file is 83 mb.
as "From previous .." there is no message, but it has appear a core with this message:
Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a.
It seems to be a memory issue.
I have chage as IBM told us:
NMEMOFF
and LDR_CNTRL
regards,
Cristina.
as "From previous .." there is no message, but it has appear a core with this message:
Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a.
It seems to be a memory issue.
I have chage as IBM told us:
NMEMOFF
and LDR_CNTRL
regards,
Cristina.