xml input stage AIX

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Cr.Cezon
Participant
Posts: 101
Joined: Mon Mar 05, 2007 4:59 am
Location: Madrid

xml input stage AIX

Post by Cr.Cezon »

Hello,

I have a problem with reading xml files up to 49 mb.

My job is like this:

Folder Stage -> XML input -> Transformer -> Seq file

The problem is with memory exceed:

(Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a)

I have increased stack and size kernell parameters (unlimited).

do you know if it is posible to read xml files up 49 mb?


regards,
Cristina.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I'm asuming you mean 'over' 49MB. Try using the 'URL/Filepath' option in the XML Input stage with only the first column declared in the Folder. Remove the second one that passes in the full contents of the file, let the XML Input stage do that.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Cr.Cezon
Participant
Posts: 101
Joined: Mon Mar 05, 2007 4:59 am
Location: Madrid

Post by Cr.Cezon »

I've try with the URL/ file path option
but fails with :
'Abnormal termination of stage ' error.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:? Just how big *is* the file? What shows as 'From previous run...' now if you reset the job?
-craig

"You can never have too many knives" -- Logan Nine Fingers
jatayl
Premium Member
Premium Member
Posts: 47
Joined: Thu Jan 19, 2006 11:20 am
Location: Rogers, AR

Post by jatayl »

I had a similar problem, and this was the solution that was recommeded relating to xml file size.

viewtopic.php?t=113623&highlight=xml

Hope it helps.

Jason
Cr.Cezon
Participant
Posts: 101
Joined: Mon Mar 05, 2007 4:59 am
Location: Madrid

Post by Cr.Cezon »

the size of the xml file is 83 mb.
as "From previous .." there is no message, but it has appear a core with this message:
Abnormal termination of DataStage.
Fault type is 4. Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a.

It seems to be a memory issue.

I have chage as IBM told us:
NMEMOFF
and LDR_CNTRL

regards,
Cristina.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

And? Works now?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Cr.Cezon
Participant
Posts: 101
Joined: Mon Mar 05, 2007 4:59 am
Location: Madrid

Post by Cr.Cezon »

no,

aborts with a core
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Time to involve your official support provider, it seems, if you haven't already.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply