Hi Have a requirement in which i need to proceess the input records based onbatches of 100,000 records to the final output file.. This requirement is because to resolve performance issue..
Please suggest..
As it has 15month's old record so we extracting all the transaction records and limiting in the final output file to process 100,000 records per day
Processing in input data in batch wise
Moderators: chulett, rschirm, roy
Do you mean that you wish to process your input in batches of 100,000 or that you wish to parcel out your output to files limited to 100,000 lines each? If you create one output file you could use the UNIX command "split" to effect that.
Last edited by ArndW on Wed Jul 15, 2009 5:25 am, edited 1 time in total.
Thanks for the quick response.ArndW wrote:Do you mean that you wish to process your input in batches of 100,000 or that you wish to parcle out your output to files limited to 100,000 lines each? If you create one output file you could use th ...
i mean i wish to process your input in batches of 100,000. Could you please help me out in achieving this task
Monaz, please - why are you starting over again on the same subject as your previous post? ![Confused :?](./images/smilies/icon_confused.gif)
![Confused :?](./images/smilies/icon_confused.gif)
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers