Page 1 of 1
problem with folder stage
Posted: Wed Mar 03, 2010 12:16 am
by kaushal.kumar@igate.com
i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Re: problem with folder stage
Posted: Wed Mar 03, 2010 12:24 am
by gssr
kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Check the datatype and the LENGTH of the Column2.
Re: problem with folder stage
Posted: Wed Mar 03, 2010 12:54 am
by kaushal.kumar@igate.com
gssr wrote:kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Check the datatype and the LENGTH of the Column2.
datatype=longNvarchar
Length=999999.
Please advice how to solve this
Posted: Wed Mar 03, 2010 7:52 am
by chulett
Use the Folder stage to read and process multiple XML files. For other types, it is a... less than optimal solution. What kind of 'loads' are you doing?
Posted: Mon Aug 09, 2010 11:34 am
by Marley777
Hi,
Would be nice if the folder stage was available for PX jobs. Is there a PX alternative to the folder stage? Trying to read all xml files from a given Unix directory.
Thanks.
Posted: Mon Aug 09, 2010 11:51 am
by chulett
That would be the External Source Stage and a search for that phrase in the PX forum should reveal the information you are looking for.
Posted: Mon Aug 09, 2010 11:51 am
by eostic
Posted: Mon Aug 09, 2010 11:52 am
by chulett
Or that.
Re: problem with folder stage
Posted: Tue Aug 10, 2010 5:10 pm
by arunkumarmm
kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Are you looking at the ouput or You assume that folder stage reads only one row by the Link count? If later is the case, check your output. Folder stage will always have the link count as 1