Hi , everybody .
How I can speed up the writing to seq file . I am sure that botlneck in writing to seq file . I am get about 3500 rows/sec.
Some programming tricks ?
Write speed to seq file
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 597
- Joined: Fri Apr 29, 2005 6:19 am
- Location: Singapore
Re: Write speed to seq file
What makes you so sure? No, there's no "trick" and I sincerely doubt the "bottleneck" is your sequential write speed unless you are writing to some crap disks or the underlying filesystem is very busy. Ask your SysAdmin about both points, they will either know or monitor that for you.snassimr wrote:I am sure that botlneck in writing to seq file . I am get about 3500 rows/sec.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 597
- Joined: Fri Apr 29, 2005 6:19 am
- Location: Singapore
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There are no programming tricks - the Sequential File stage already uses the STREAMS I/O module.
What else is happening? Are you getting contention on the disk, so that the heads keep being moved away from this file? Try a test where the file is the only thing being accessed on its spindle (an ideal situation, to be sure, but an interesting test) - however, this may not be possible on a storage array network (SAN).
What else is happening? Are you getting contention on the disk, so that the heads keep being moved away from this file? Try a test where the file is the only thing being accessed on its spindle (an ideal situation, to be sure, but an interesting test) - however, this may not be possible on a storage array network (SAN).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.