External Source stage

vasubabu · Post by **vasubabu** » Mon Mar 30, 2009 11:47 pm

Hi,

i am using the external source stage for two different things.
1.to extract the XML file(using ls command)
2.to get the file/dataset count.(using dsrecords function)
But i am getting the errors like this.

Error occurred during initializeFromArgs().
<External_Source_1> Invalid data source specified: Invalid hostname: dsrecords E.(here file is in E drive)
Creation of a step finished with status = FAILED.

Can anybody look at this and give me the solution for the above mentioned two scenarios

Regards,
vasu

chulett · Post by **chulett** » Tue Mar 31, 2009 7:06 am

So... one stage doing both things at once? Two stages? The former would be a problem. For #2 you'd need to post the syntax you are using for anyone to be able to help.

chulett · Post by **chulett** » Tue Mar 31, 2009 7:10 am

Assuming your syntax for 'dsrecords' is wrong, you might want to search the forums for the proper syntax. For example, this post is one of many that came up for me when I searched.

BugFree · Post by **BugFree** » Tue Mar 31, 2009 8:35 am

Are you using dsrecords function to get the count from the file

I thought this function only relates to DataSet

.

vasubabu · Post by **vasubabu** » Wed Apr 01, 2009 1:31 am

i am using for each(dataset count and xml file extract) operation different external source stage.
********************
My syntax is like this for xml extract using external source stage

Source Method=Specific Programs
Source program=ls #XMLFilePathName#/#XMLFileName#

And Format tab
Final delimeter=end

and column is xmldoc vachar 2000

In xmlinput stage i have selected the option as XMLDocument.

***********************
For dataset count

Source program=dsrecords #FilePathName#/#FileName#.ds
**************
Please check the above options i have set and correct me if i am wrong.

eostic · Post by **eostic** » Wed Apr 01, 2009 5:05 am

Does it work when you hard code the values?

Exactly what values are you using?

Ernie

vasubabu · Post by **vasubabu** » Wed Apr 01, 2009 5:41 am

Sorry i did not get your question.
do you mean the parameters.
even if i use the values instead of parameters i am getting the same error.

eostic · Post by **eostic** » Wed Apr 01, 2009 6:27 am

Right...can you send us the exact values that you are using that fail. thx.

chulett · Post by **chulett** » Wed Apr 01, 2009 8:23 am

vasubabu wrote:In xmlinput stage i have selected the option as XMLDocument.

But seeing as how you're not sending in the contents of the document but rather just the path to it, you need to set that to "URL/File path" instead.

lstsaur · Post by **lstsaur** » Wed Apr 01, 2009 10:45 am

Vasu,
From your External_Source stage, check to see whether you are able to view data. If you cannot even view the data, then it has something to do with your "ls" command is not working correclty in Windows env.

vasubabu · Post by **vasubabu** » Thu Apr 02, 2009 2:07 am

when i am trying to view the data only i am getting the error mentioned in the very begining.
but ls command is working when i try in the command prompt.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Thu Apr 02, 2009 2:41 am

Check your PATH.

Try a simple Unix command from DataStage.

vasubabu · Post by **vasubabu** » Thu Apr 02, 2009 7:16 am

for any unix or Dos command i am getting the same error.
Or
any other options to extract the xml file
and to get the dataset count?

DSXchange

External Source stage

External Source stage

Re: External Source stage