Read from multiple nodes
Number Of readers per node
Some days ago I just learnt we can set "Number Of readers per node" to improve the performance to read a cma file, that means there are some readers reading in the same time in one node.
And then I realize this one "Read from multiple nodes", according to the document, I think it's like the parallel run, 4 nodes read the same file the same time.
my question is, in my view, sequential file should read in sequence, if we set either the properties, then the file will process "parallelly", is this understanding correct?
And we should always set this property to read seq file, so that we can have better performance, right?
Thanks..
Walter/
sequential file stage property
Moderators: chulett, rschirm, roy
sequential file stage property
wuruimao
I believe those settings only apply to fixed-width files, not delimited files. The benefits of using the settings may be questionable unless justified. It really depends on your topology, horsepower available, and the size of the fixed-width files. I would say not to always set those settings, but only do so when you have the resources and can measure an overall performance improvement.
Choose a job you love, and you will never have to work a day in your life. - Confucius
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: