Page 1 of 1

xml input stage AIX

Posted: Wed Jun 18, 2008 5:46 am
by Cr.Cezon
Hello,

I have a problem with reading xml files up to 49 mb.

My job is like this:

Folder Stage -> XML input -> Transformer -> Seq file

The problem is with memory exceed:

(Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a)

I have increased stack and size kernell parameters (unlimited).

do you know if it is posible to read xml files up 49 mb?


regards,
Cristina.

Posted: Wed Jun 18, 2008 5:51 am
by chulett
I'm asuming you mean 'over' 49MB. Try using the 'URL/Filepath' option in the XML Input stage with only the first column declared in the Folder. Remove the second one that passes in the full contents of the file, let the XML Input stage do that.

Posted: Wed Jun 18, 2008 6:25 am
by Cr.Cezon
I've try with the URL/ file path option
but fails with :
'Abnormal termination of stage ' error.

Posted: Wed Jun 18, 2008 6:39 am
by chulett
:? Just how big *is* the file? What shows as 'From previous run...' now if you reset the job?

Posted: Wed Jun 18, 2008 2:08 pm
by jatayl
I had a similar problem, and this was the solution that was recommeded relating to xml file size.

viewtopic.php?t=113623&highlight=xml

Hope it helps.

Jason

Posted: Thu Jun 19, 2008 12:27 am
by Cr.Cezon
the size of the xml file is 83 mb.
as "From previous .." there is no message, but it has appear a core with this message:
Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a.

It seems to be a memory issue.

I have chage as IBM told us:
NMEMOFF
and LDR_CNTRL

regards,
Cristina.

Posted: Thu Jun 19, 2008 6:12 am
by chulett
And? Works now?

Posted: Thu Jun 19, 2008 7:19 am
by Cr.Cezon
no,

aborts with a core

Posted: Thu Jun 19, 2008 7:20 am
by chulett
Time to involve your official support provider, it seems, if you haven't already.