Write To Dataset Failed. Broken Pipe

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
gauravrb
Participant
Posts: 28
Joined: Wed Dec 27, 2006 11:31 pm
Location: Mumbai

Write To Dataset Failed. Broken Pipe

Post by gauravrb »

The Job Design is

DB2(Read)-->cpy-->Dataset(Write Append)

No of Records 578056.

The job is getting aborted giving the following error.

APT_CombinedOperatorController,0: Write to dataset on [fd 28] failed (Error 0) on node node1, hostname huxd0208
APT_CombinedOperatorController,0: Orchestrate was unable to write to any of the following files:
APT_CombinedOperatorController,0: /opt/IBM/InformationServer/Server/Datasets/ds_rt_li_return.dsadm.huxd0208.0000.0000.0000.18a042.ca6d3fe0.0000.bd2049ab
APT_CombinedOperatorController,0: Block write failure. Partition: 0
dsW_RT_LI_RETURN_int,0: Failure during execution of operator logic.
dsW_RT_LI_RETURN_int,0: Input 0 consumed 46690 records.
APT_CombinedOperatorController,0: Fatal Error: File data set, file "/etl/IS/Data/datasets/transaction/ds_rt_li_return".; output of "dsW_RT_LI_RETURN_int": DM getOutputRecord error.
dbeR_RT_LI_RETURN_src,0: Write to dataset on [fd 5: L10.144.37.7:11000, R10.144.37.8:37737] failed (Broken pipe) on node db2node1, hostname huxd0207

Is the error due to some invalid data or space related issue in environment?
Gaurav.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Most likely that "/opt/IBM/InformationServer/Server/Datasets/" has filled.
gauravrb
Participant
Posts: 28
Joined: Wed Dec 27, 2006 11:31 pm
Location: Mumbai

Post by gauravrb »

ArndW wrote:Most likely that "/opt/IBM/InformationServer/Server/Datasets/" has filled. ...
Are the datasets created in above folder automatically whenever error occurs or they are always created there irespective whether error occurs or not?

will it be a good idea clearing the datasets in the above path and will it resolve the issue?
Gaurav.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Data Set data files are stored in the directories specified as "resource disk" in your configuration file.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Do not delete the files in that directory directly. Find the DataSet descriptor files and delete those files using the "orchadmin rm" command or do it from the DataSet Management tab in the clients.
Post Reply