configration file, paging standards?
Moderators: chulett, rschirm, roy
configration file, paging standards?
OS: AIX
DS: 8.7
questuon 1:
In configration file for datasets are there any standard paging spaces ?
like while running a job it is showing on 3 nodes
node1 5001216
node2 0
node3 5001216
this is very consistant.
so do you where i can find these paging standards?
Question 2:
how can i archive dataset files in node1 ,node 2 ,node3
DS: 8.7
questuon 1:
In configration file for datasets are there any standard paging spaces ?
like while running a job it is showing on 3 nodes
node1 5001216
node2 0
node3 5001216
this is very consistant.
so do you where i can find these paging standards?
Question 2:
how can i archive dataset files in node1 ,node 2 ,node3
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
1) There are no standards for paging. What determines how much data goes to each node is the partitioning algorithm. Your scenario (populating only two nodes out of three) might be seen if the data were partitioned using a key-based partitioning algorithm based on a two-valued field, what is classed as an Indicator were you profiling it with Information Analyzer.
2) The best way to archive Data Sets is to use the orchadmin command. This guarantees that every defined data file is picked up. The data, or "segment" files reside on directories identified as disk resource in the configuration file, and the descriptor file (the one with the ".ds" suffix to its name) records the location of these segments files (along with other information, such as the record schema).
2) The best way to archive Data Sets is to use the orchadmin command. This guarantees that every defined data file is picked up. The data, or "segment" files reside on directories identified as disk resource in the configuration file, and the descriptor file (the one with the ".ds" suffix to its name) records the location of these segments files (along with other information, such as the record schema).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The partitioning algorithm can not be seen in the configuration file.
It can be seen in the job design, on the input link of any stage executing in parallel mode.
It can also be seen in the job score.
It can be seen in the job design, on the input link of any stage executing in parallel mode.
It can also be seen in the job score.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Dear peep,
1. This is a forum, not an SMS telephone exchange. Please use real words and vowels since many here, including myself and yourself, are not native English speakers and communication is difficult enough with the technical nature of DataStage.
2. While most of the subject matter is freely visible, some is only visible to those who have opted to support the forum by becoming premium members.
The initial part of my earlier message is visible and provides enough information to suggest the path to a solution.
1. This is a forum, not an SMS telephone exchange. Please use real words and vowels since many here, including myself and yourself, are not native English speakers and communication is difficult enough with the technical nature of DataStage.
2. While most of the subject matter is freely visible, some is only visible to those who have opted to support the forum by becoming premium members.
The initial part of my earlier message is visible and provides enough information to suggest the path to a solution.
ok I am sorry for using short forms.
where can I see the input link data ?
In my research I found this block values can be defined in job properties and it can be determined by considering the largest records in the link of a job and setting this value more than the largest record value.
we can set this value in job parameters APT_Default_TRANSPORT_BLOCK_SIZE.
Here is more info please correct me if i am wrong.
APT_AUTO_TRANSPORT_BLOCK_SIZE- does this take the required amount of space to pass the records . Rather using the defined amount of disk space.
By using this variable we can allow the job to use the required amount of disk space.
where can I see the input link data ?
In my research I found this block values can be defined in job properties and it can be determined by considering the largest records in the link of a job and setting this value more than the largest record value.
we can set this value in job parameters APT_Default_TRANSPORT_BLOCK_SIZE.
Here is more info please correct me if i am wrong.
APT_AUTO_TRANSPORT_BLOCK_SIZE- does this take the required amount of space to pass the records . Rather using the defined amount of disk space.
By using this variable we can allow the job to use the required amount of disk space.