expecting 1 segments, read 2 segments
Moderators: chulett, rschirm, roy
expecting 1 segments, read 2 segments
Hi All,
While i am trying to appending the same dataset from different jobs i am getting the following warning although the job is running fine.Could any one elaborate on this warning.
main_program: Dataset: /detld2/etl/GPA/WM/log//Exception_613.ds, expecting 1 segments, read 2 segments.
Your help will greatly appreciated.
Thanks in Advance
Ramesh Venkata
While i am trying to appending the same dataset from different jobs i am getting the following warning although the job is running fine.Could any one elaborate on this warning.
main_program: Dataset: /detld2/etl/GPA/WM/log//Exception_613.ds, expecting 1 segments, read 2 segments.
Your help will greatly appreciated.
Thanks in Advance
Ramesh Venkata
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Using the Data Set Management utility determine how many segments (data files) exist on each partition.
I'd be concerned about the // in the pathname also. But this is unrelated to any message about segments.
I'd be concerned about the // in the pathname also. But this is unrelated to any message about segments.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Hi,
Actually multiple jobs in a sequence job is using the same (.ds) file and the file is being appended, we are using the default partitioning method(Auto).
All the way we are using execution mode as Prallel in all the jobs. Will it get solved if we change the option to Sequential in all the jobs.
And when we view the dataset file in unix , it shows two nodes.
Thanks for all your response.
Actually multiple jobs in a sequence job is using the same (.ds) file and the file is being appended, we are using the default partitioning method(Auto).
All the way we are using execution mode as Prallel in all the jobs. Will it get solved if we change the option to Sequential in all the jobs.
And when we view the dataset file in unix , it shows two nodes.
Thanks for all your response.
Is the dataset always being opened in "append" mode?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You have to select one of the partitions for the Segments grid to be populated, and it is then populated with the pathnames of the segment files that are used on that partition.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
What, that the Data Set has no segments? Or is it 2 segments? Or 1? I am getting thoroughly confused. What - precisely - is your issue?
And what happened (in the Segments grid) when you selected a partition in the Data Set Management utility?
And what happened (in the Segments grid) when you selected a partition in the Data Set Management utility?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Hi Ray,
We have been using the same job with different invocation id's, Few of invocations are running successfully and few of them are throwing warning like "expecting 4 segments, read 6 segments."
When we view the dataset management utility it is showing like below message
Exception_745
##I TFCN 000001 06:34:42(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.1A
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved
##I TUTL 000031 06:34:42(001) <main_program> The open files limit is 1024; raising to 10000.
##I TFSC 000001 06:34:43(000) <main_program> APT configuration file: /tmp/aptoa3229983eb88
Name: //detld2/etl/GPA/WM/log/Exception_745.ds
Version: ORCHESTRATE V7.5.1 DM Block Format 6.
Time of Creation: 08/13/08 04:29:55
Number of Partitions: 2
Number of Segments: 4
Valid Segments: 4
Preserve Partitioning: false
Segment Creation Time:
0: 08/13/08 04:29:55
1: 08/13/08 04:30:53
2: 08/13/08 04:31:11
3: 08/13/08 04:31:31
Partition 0
node : node1
records: 0
blocks : 0
bytes : 0
files :
Segment 0 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0000.0000.0000.16ad.ca6be683.0000.7c0032cb 0 bytes
Segment 1 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0001.0000.0000.19c3.ca6be6bd.0000.0e68ce63 0 bytes
Segment 2 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0002.0000.0000.1a47.ca6be6cf.0000.0ec89603 0 bytes
Segment 3 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0003.0000.0000.1ad5.ca6be6e3.0000.1a982633 0 bytes
total : 0 bytes
Partition 1
node : node2
records: 0
blocks : 0
bytes : 0
files :
Segment 0 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0000.0001.0000.16ad.ca6be683.0001.5c422c40 0 bytes
Segment 1 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0001.0001.0000.19c3.ca6be6bd.0001.befe3f18 0 bytes
Segment 2 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0002.0001.0000.1a47.ca6be6cf.0001.2b0e79b8 0 bytes
Segment 3 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0003.0001.0000.1ad5.ca6be6e3.0001.7706b068 0 bytes
total : 0 bytes
Totals:
records : 0
blocks : 0
bytes : 0
filesize: 0
min part: 0
max part: 0
Please through some inputs on this.
We have been using the same job with different invocation id's, Few of invocations are running successfully and few of them are throwing warning like "expecting 4 segments, read 6 segments."
When we view the dataset management utility it is showing like below message
Exception_745
##I TFCN 000001 06:34:42(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.1A
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved
##I TUTL 000031 06:34:42(001) <main_program> The open files limit is 1024; raising to 10000.
##I TFSC 000001 06:34:43(000) <main_program> APT configuration file: /tmp/aptoa3229983eb88
Name: //detld2/etl/GPA/WM/log/Exception_745.ds
Version: ORCHESTRATE V7.5.1 DM Block Format 6.
Time of Creation: 08/13/08 04:29:55
Number of Partitions: 2
Number of Segments: 4
Valid Segments: 4
Preserve Partitioning: false
Segment Creation Time:
0: 08/13/08 04:29:55
1: 08/13/08 04:30:53
2: 08/13/08 04:31:11
3: 08/13/08 04:31:31
Partition 0
node : node1
records: 0
blocks : 0
bytes : 0
files :
Segment 0 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0000.0000.0000.16ad.ca6be683.0000.7c0032cb 0 bytes
Segment 1 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0001.0000.0000.19c3.ca6be6bd.0000.0e68ce63 0 bytes
Segment 2 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0002.0000.0000.1a47.ca6be6cf.0000.0ec89603 0 bytes
Segment 3 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0003.0000.0000.1ad5.ca6be6e3.0000.1a982633 0 bytes
total : 0 bytes
Partition 1
node : node2
records: 0
blocks : 0
bytes : 0
files :
Segment 0 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0000.0001.0000.16ad.ca6be683.0001.5c422c40 0 bytes
Segment 1 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0001.0001.0000.19c3.ca6be6bd.0001.befe3f18 0 bytes
Segment 2 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0002.0001.0000.1a47.ca6be6cf.0001.2b0e79b8 0 bytes
Segment 3 :
/detld2/etl/ascential/scratch/datasets/Exception_745.ds.p475639.dasomg03.0003.0001.0000.1ad5.ca6be6e3.0001.7706b068 0 bytes
total : 0 bytes
Totals:
records : 0
blocks : 0
bytes : 0
filesize: 0
min part: 0
max part: 0
Please through some inputs on this.