XML Extraction from Sequential Stage ?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nitin376
Charter Member
Charter Member
Posts: 40
Joined: Tue Apr 11, 2006 9:38 am

XML Extraction from Sequential Stage ?

Post by nitin376 »

Hi !
My Job Structure is as follows:

<b>
Seq Stage ---> XML input ---> TX Stage----> Lookup File set
</b>
The problem is in the
Seq stage, the parameters are as follows:
File Pattern : acential/datastage/folder/xml/data/*.xml
Read Method: File Pattern
Other Parameters are default

XML Input stage,the parameters are as follows:
XML source column: FileContent
Column Content: XML Document
Validate input XML : yes
level: strict

after I run my job, the following error comes:
<b>
sq_Stage_File,0: Source subproc: cat: 0652-050 Cannot open /ascential/datastage//folder/xml/data/*.XML.

sq_Stage_File,0: Filter status 512
Filter process failed: 2
Import error at record 0

Please let me know where Am I wrong ?

Thanks,
Nitin
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Your biggest problem is the fact that the Sequential stage cannot deliver the entire contents of the XML file in one record/field like the Folder stage can in Server.

You need to see if it can pass in the fully qualified path to the XML file and then switch the XML Input stage to use the 'URL' option.
-craig

"You can never have too many knives" -- Logan Nine Fingers
nitin376
Charter Member
Charter Member
Posts: 40
Joined: Tue Apr 11, 2006 9:38 am

Post by nitin376 »

chulett wrote:Your biggest problem is the fact that the Sequential stage cannot deliver the entire contents of the XML file in one record/field like the Folder stage can in Server.

You need to see if it can pass in the fully qualified path to the XML file and then switch the XML Input stage to use the 'URL' option.
Please explain me what do you mean by fully qualified path?
How do I get through this problem ?

thanks,
nitin
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

A fully qualified path is a path which has an absolute path that begins with the root directory on unix, i.e. /tmp/DataStage/Data/Test/DSXChange/test.seq

The other type of path is relative, which starts at some other point, usually the CWD (Current Working Directory) and this type of path looks like "./DSXChange/test.seq" or "test.seq" or "../OtherPath/test.seq"
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

A fully-qualified pathname begins with a slash character (on UNIX) or a drive letter or backslash character (on Windows).
A relative pathname does not begin thus, and is considered to be relative to the current attach point.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
nitin376
Charter Member
Charter Member
Posts: 40
Joined: Tue Apr 11, 2006 9:38 am

Re: XML Extraction from Sequential Stage ?

Post by nitin376 »

nitin376 wrote:Hi !
My Job Structure is as follows:

<b>
Seq Stage ---> XML input ---> TX Stage----> Lookup File set
</b>
The problem is in the
Seq stage, the parameters are as follows:
File Pattern : acential/datastage/folder/xml/data/*.xml
Read Method: File Pattern
Other Parameters are default

XML Input stage,the parameters are as follows:
XML source column: FileContent
Column Content: XML Document
Validate input XML : yes
level: strict

after I run my job, the following error comes:
<b>
sq_Stage_File,0: Source subproc: cat: 0652-050 Cannot open /ascential/datastage//folder/xml/data/*.XML.

sq_Stage_File,0: Filter status 512
Filter process failed: 2
Import error at record 0

Please let me know where Am I wrong ?

Thanks,
Nitin
Hi,
I have to extract all the xml files from the particular directory in Unix, So when I use wildcards *.xml in that directory using seq stage , I get above error. Also, what format setting should be there in sequential stage for xml files.

Please advise me , How to use sequential stage with same functions as Folder stage (server) ?

The job structure is listed above,

thanks,
Nitin
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I suspect you got that error doing View Data. View Data does not work when the read mode is "File Pattern".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rajan.n
Premium Member
Premium Member
Posts: 96
Joined: Mon Oct 09, 2006 7:47 am

Re: XML Extraction from Sequential Stage ?

Post by rajan.n »

hi , am not that much expert to ans this..but i have some thing to share with u, i can see ur path is "/ascential/datastage//folder/xml/data/*.XML."
ok , before folder ans after datastage specify only one one "/"
for ex:"/ascential/datastage/folder/xml/data/*.XML" dont know whether this works or not but jst i want to sahre with u.
thnx
nitin376 wrote:Hi !
My Job Structure is as follows:

<b>
Seq Stage ---> XML input ---> TX Stage----> Lookup File set
</b>
The problem is in the
Seq stage, the parameters are as follows:
File Pattern : acential/datastage/folder/xml/data/*.xml
Read Method: File Pattern
Other Parameters are default

XML Input stage,the parameters are as follows:
XML source column: FileContent
Column Content: XML Document
Validate input XML : yes
level: strict

after I run my job, the following error comes:
<b>
sq_Stage_File,0: Source subproc: cat: 0652-050 Cannot open /ascential/datastage//folder/xml/data/*.XML.

sq_Stage_File,0: Filter status 512
Filter process failed: 2
Import error at record 0

Please let me know where Am I wrong ?

Thanks,
Nitin
jgreve
Premium Member
Premium Member
Posts: 107
Joined: Mon Sep 25, 2006 4:25 pm

Re: XML Extraction from Sequential Stage ?

Post by jgreve »

nitin376 wrote: File Pattern : acential/datastage/folder/xml/data/*.xml
Read Method: File Pattern
Rajan.n had a good idea, try changing your
file pattern to be absolute, e.g. start with a leading slash.

Unix might be: /acential/datastage/folder/xml/data/*.xml

Windows might be:
C:/acential/datastage/folder/xml/data/*.xml
Post Reply