Extracting bulk data

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
SHARAD123
Premium Member
Premium Member
Posts: 54
Joined: Wed Jan 09, 2008 12:05 am

Extracting bulk data

Post by SHARAD123 »

The scenario is to extract N number of files from a directory in a single go and then load it to a diff database. Also need to count the number of record in each file.


**I tried using Folder Stage
222102
raj158347
Participant
Posts: 26
Joined: Thu Apr 19, 2007 5:15 am
Location: Chennai

Post by raj158347 »

Please specify what is the problem using folder satge ..are counting the records in the files.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

First suggestion would be to ask a question.
-craig

"You can never have too many knives" -- Logan Nine Fingers
sachin1
Participant
Posts: 325
Joined: Wed May 30, 2007 7:42 am
Location: india

Post by sachin1 »

hello friend,

my question is how are you going to segregate records in file, when you read all files in directory in one go.

becuase for folder stage we have only filename(key) and Records columns to work with.
SHARAD123
Premium Member
Premium Member
Posts: 54
Joined: Wed Jan 09, 2008 12:05 am

Post by SHARAD123 »

I ve used row splitter to split the records accordingly... Now the prob is to count the number of recors in each file
222102
Post Reply