DSXchange

Hi,

I was trying to read an xml file using sequential file stage and External source stage in a parallel job. I get some errors. I was able to read teh file succesfully in server jobs using folder stage. Can anyone please help me?

I get the following error when I use this string "ls #C:\Datafiles#*.xml | sort" in specific programs property in External source stage. C:\Datafiles is my xml subdirectory path.

main_program: Data set, file set, or file "External_Source_0:DSLink3.v": Non-pipe (or non-virtual data set) with .v in its name

when I use this string "cat /#C:\Datafiles#/cd_catalog.xml", I get the following error.

External_Source_0: When processing argument -sourcelistWhen processing file: cat /#C:\Datafiles#/*.xml is not a valid path name: Invalid hostname: cat /#C.

Can anyone give me the exact syntax that I should be using. Thanks in advance.

Thanks,

Reddy.

Hold on, what does your job design look like? You should use the External Source stage to replace the Sequential File stage, not use both.

Why do you have hash/pound signs in your 'xml subdirectory path'?

Choose one from the below options to read your XML stuff.
1. Sequential stage
2. External source stage

I meant I have tried each of those 2 stages in 2 different jobs.

It will be helpful to understand what your feedback might be for Craig's question about the directory name part of your file name.

Are you trying to have a job parameter for the folder name?

Check out viewtopic.php?t=115830&postdays=0&posto ... ce&start=0 for a detailed discussion on this topic.

Good luck,

Hi,

I have used the External Source Stage. I can see that the records passed through to XML Input stage but, all the records are rejected and none of them are processed further. I used a peek stage and got the following error message.

"Peek_5,0: Reject:XML input document parsing failed. Reason: Xalan fatal error (publicId: , systemId: , line: 1, column: 1): Invalid document structure"

I have used Folder Stage and it worked fine without any errors. Can anyone help me with this. Thank you.

Reddy.

For Server jobs

In file Folder U can mention the values

sort order------------NONE
wild carld-------------filename_*.xml (ex: reddy_*.xml)
preserve CRLF-------Yes
Fully quelified--------N

In XML U can enable the value

Where you need repetition value on that column u can enable yes remaining no on columns


If you r parallel

in external source

where u r enable the path name, where u can give before the path name this unix value and between unix value and file path we need single space 'ls file path'(ex:ls /inbox/reddy.xml)

in xml stage
u can enable URL/path in input and Where you need repetition value on that column u can enable yes remaining no on columns


This is deesh
thanks