problem with folder stage

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
kaushal.kumar@igate.com
Participant
Posts: 77
Joined: Tue Apr 14, 2009 4:03 am

problem with folder stage

Post by kaushal.kumar@igate.com »

i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
gssr
Participant
Posts: 243
Joined: Fri Jan 09, 2009 12:51 am
Location: India

Re: problem with folder stage

Post by gssr »

kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Check the datatype and the LENGTH of the Column2.
RAJ
kaushal.kumar@igate.com
Participant
Posts: 77
Joined: Tue Apr 14, 2009 4:03 am

Re: problem with folder stage

Post by kaushal.kumar@igate.com »

gssr wrote:
kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Check the datatype and the LENGTH of the Column2.
datatype=longNvarchar
Length=999999.
Please advice how to solve this :?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Use the Folder stage to read and process multiple XML files. For other types, it is a... less than optimal solution. What kind of 'loads' are you doing?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Marley777
Premium Member
Premium Member
Posts: 316
Joined: Tue Jan 27, 2004 3:26 pm

Post by Marley777 »

Hi,
Would be nice if the folder stage was available for PX jobs. Is there a PX alternative to the folder stage? Trying to read all xml files from a given Unix directory.

Thanks.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

That would be the External Source Stage and a search for that phrase in the PX forum should reveal the information you are looking for.
-craig

"You can never have too many knives" -- Logan Nine Fingers
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Or that. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
arunkumarmm
Participant
Posts: 246
Joined: Mon Jun 30, 2008 3:22 am
Location: New York
Contact:

Re: problem with folder stage

Post by arunkumarmm »

kaushal.kumar@igate.com wrote:i am using folder stage to read files from load directory. My files are fixed width length file.I am dfining column1 as file name and column 2nd as record( which suppose to contain records of file) .but in my job its taking only first rows of file.Please help me what i need to define so that it will take all rows of file.
Are you looking at the ouput or You assume that folder stage reads only one row by the Link count? If later is the case, check your output. Folder stage will always have the link count as 1
Arun
Post Reply