dataset file reading error

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
India2000
Participant
Posts: 274
Joined: Sun Aug 22, 2010 11:07 am

dataset file reading error

Post by India2000 »

HI
I get this error while executing my job

/Transaction.ds: Data set initialization for "/usr/local/input/Transaction.ds": This input-file data set does not exist: /usr/local/input/Transaction.ds.

any one please What is the reason for this eror.This file exist in the directory.How to resolve this issue?

Thanks,
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Re: dataset file reading error

Post by Developer9 »

1.What are you trying to do exactly ??Here you could be more specific by specifying the job flow..then you can get more responses..

Ex:Dataset stage >>>xfm>>peek/sequential file

2.Did you Souce file pathname correctly??
Output link >properties tab>>source/file

3.Did you specify the meta data correctly ??
Dataset stage >>columns tab

4.Can you able to view the data in the source (dataset)??

you can go to Designer >>>Tools>>Dataset Management>>select your dataset >>Dataset viewer option

I think these are some of preliminary items to be checked before we run the job

Experts:please correct my explanation if any changes

Thank you
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

That's the error to expect when the file actually does not exist. Can you show the ls -l /usr/local/input/Transaction.ds output? Make sure the file doesn't have anything strange in the filename, like a trailing space.
Choose a job you love, and you will never have to work a day in your life. - Confucius
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Another possibility is related to file permissions. Can the userid running the datastage job actually see the file? If they have no permissions to the file at any level (user, group, world), it will not be seen by the job.
- james wiles


All generalizations are false, including this one - Mark Twain.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Could it possibly mean that the while descriptor file may still exist that the actual dataset files it references could not be found?
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I would expect the error message to name the segment file it couldn't find in that case, not the descriptor (.ds) file.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Ok, fair enough. Then I suspect our friend is incorrect about it existing in that location with that exact spelling... with enough permissions to allow it to be read.
Last edited by chulett on Sat Dec 10, 2011 8:49 pm, edited 1 time in total.
-craig

"You can never have too many knives" -- Logan Nine Fingers
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Here are some possible errors from 8.5.

View Data error when the *.ds file does not exist:

Code: Select all

</path/file.ds> Data set initialization for "/path/file.ds": This input-file data set does not exist: /path/file.ds.
Creation of a step finished with status = FAILED.
View Data error when the *.ds file exists but you don't have read permissions on it:

Code: Select all

Unable to open descriptor file  to read from: Permission denied
Error reading ORCHESTRATE File Dataset descriptor for '/path/file.ds'.
</path/file.ds> Data set initialization for "/path/file.ds": Input-file data set open failure: /path/file.ds.
Creation of a step finished with status = FAILED.
View Data error when one of the dataset data files does not exist:

Code: Select all

Failure during execution of operator logic.
Input 0 consumed 0 records.
Output 0 produced 0 records.
Fatal Error: I/O subsystem: Open of /path/file.ds....0000.0000.0000.3e0156.d04366cf.0000.20ce707d failed: No such file or directory
Player 1 terminated unexpectedly.
APT_PMsectionLeader(1, node1), player 1 - Unexpected exit status 1.
Step execution finished with status = FAILED.
View Data error when one of the dataset data files exist but you don't have read permissions on it:

Code: Select all

Failure during execution of operator logic.
Input 0 consumed 0 records.
Output 0 produced 0 records.
Fatal Error: I/O subsystem: Open of /path/file.ds....0000.0000.0000.3e0156.d04366cf.0000.20ce707d failed: Permission denied
Player 1 terminated unexpectedly.
APT_PMsectionLeader(1, node1), player 1 - Unexpected exit status 1.
Failure during execution of operator logic.
Input 0 consumed 0 records.
Output 0 produced 0 records.
Fatal Error: waitForWriteSignal(): Premature EOF on node node_name Socket operation on non-socket
Player 2 terminated unexpectedly.
APT_PMsectionLeader(1, node1), player 2 - Unexpected exit status 1.
Step execution finished with status = FAILED.
Choose a job you love, and you will never have to work a day in your life. - Confucius
India2000
Participant
Posts: 274
Joined: Sun Aug 22, 2010 11:07 am

Post by India2000 »

Thanks all for your analysis .

If hard code the dataset path through the sequence job activity properties it does read the file from the location but if I pass the path as a parameter job aborts saying Controller problem: Unhandled abort encountered in job ...and in the job it says .ds file in the file pathe location /../../file.ds doesn' exist. Could anyone please let me know how to fix this issue?


Thanks
Post Reply