dataset ; no such file or directory

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsscholar
Premium Member
Premium Member
Posts: 195
Joined: Thu Oct 19, 2006 2:45 pm

dataset ; no such file or directory

Post by dsscholar »

Hi all,

In my job, am loading a dataset with 4 million records. In between a lookup is there where partitioning is hash and after that its "same" till the end.

Now when i tried to read the data from the dataset, i get a weird error like
"No such file or directory".. But it happened after reading 7 lakh data. I assesed the dataset using dataset management tool and the dataset is splitted into 14 segments, in which only 2 segments contains the data and remaining segments doesnt contain data. My dataset segment is '0' and it has zero bytes of data. Please advise in this context.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Advise you post any error message in full, unedited. It also sounds like your hash keys aren't appropriate.
-craig

"You can never have too many knives" -- Logan Nine Fingers
dsscholar
Premium Member
Premium Member
Posts: 195
Joined: Thu Oct 19, 2006 2:45 pm

Post by dsscholar »

Chulett,

Please find the error message below..

##E IIS-DSEE-TFOR-00001 05:00:28(000) <Data_Set_0,0> Failure during execution of operator logic.
##F IIS-DSEE-TFIO-00161 05:00:28(003) <APT_CombinedOperatorController,0> Fatal Error: I/O subsystem: Open of /D=/IBM/InformationServer/Server/Datasets/RELTTRH_EDWQ_REJECTS.ds.dsdesign.A300SM111.0000.0000.0000.554c.d00531fe.0000.ad81f0ca failed: No such file or directory
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... and does it exist? Do you (the executing user ID) have appropriate permission to it and its parent directory?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
SURA
Premium Member
Premium Member
Posts: 1229
Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney

Post by SURA »

Hence it is reading upto 7 lakh records!!

Might be space / memory issue?

DS User
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Sounds like your dataset is corrupt.
-craig

"You can never have too many knives" -- Logan Nine Fingers
karthikeyan M
Participant
Posts: 2
Joined: Wed Aug 10, 2011 1:45 am

Post by karthikeyan M »

The issue is due to size of the file system might be full.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

karthikeyan M wrote:The issue is due to size of the file system might be full.
Are you sure? On what evidence? What other possibilties might exist?

Maybe someone else on the system has deleted one of the data set segment files?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply