breaking the flat file

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
ranga1970
Participant
Posts: 141
Joined: Thu Nov 04, 2004 3:29 pm
Location: Hyderabad

breaking the flat file

Post by ranga1970 »

Hi I am getting zipped file and its attached .mkr file as my flatfile source, the files are huge and it taking lot of time to load, for testing purpose, I would like break the file in small fiels and loadthem and test them, if the test is successful then i want to load the full file, is there a way to do this, or Should ask the person who send me file to send me the small test file
thanks
RRCHINTALA
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Use the unix program "head" and specify how many lines from the top of the file you want. Alternatively, "tail" gives you lines from the bottom. You can make any size file you want.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Or set a Row Limit when you run the job. On the 'Limits' tab you can tell it to stop the job after processing X rows.
-craig

"You can never have too many knives" -- Logan Nine Fingers
scottr
Participant
Posts: 51
Joined: Thu Dec 02, 2004 11:20 am

Post by scottr »

but the best is googleing for some unix file comands
Post Reply