Unable to view dataset using Data Set Managment in Manager

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Unable to view dataset using Data Set Managment in Manager

Post by y2ariyas »

Hi DataStage Gurus,

I'm unable to view dataset using Data Set Managment. I'm getting the following error.

Cannot read '/Data0/TestSCD2_1.ds.u496970.uschus1200.0000.0001.0001.6893.c780bde8.0007.cf431052

This is not a valid dataset file, or its format is not currently supported.


also usually Datasets have ds extension. why am i getting the login id, and server names after the ds extension in this file?

Can somebody help me with this,

thank you.[/i]
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

The file shown is a partfile for the dataset. Check your sytem to see if this file exists or might have been deleted.
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Post by y2ariyas »

ArndW wrote:The file shown is a partfile for the dataset. Check your sytem to see if this file exists or might have been deleted.
ArndW,

when you say partfile, what do you mean by that?
when you said check in my system, do you mean check by going into Unix and looking for this file in the same /Data0 folder?
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Yes, check in your unix folder /Data0.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Post by y2ariyas »

I can see that file in unix
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Post by y2ariyas »

are the dataset header files saved in a different directory?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

y2ariyas - in this case it might be easier to figure out the issue by using the command line interface. If you set your DS/PX environment appropriately in a shell and execute the command orchadmin ll {path to dataset} could you post the output here?
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Post by y2ariyas »

ArndW,

Here is the messeage i got from running orchadmin

$MYNAME$ orchadmin dump -name /Data0/TestSCD2_File1.ds.u496970.uschus1200.0000.0000.0000.37b8.c7810455.0000.2b797a12
##I TFCN 000001 13:23:48(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.2
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved


##E TFDM 000000 13:23:48(001) <main_program> The file identified as '/Data0/TestSCD2_File1.ds.u496970.uschus1200.0000.0000.0000.37b8.c7810455.0000.2b797a12' is not an ORCHESTRATE Data Set descriptor.
##I TCOA 000046 13:23:48(002) <main_program> WARNING: could not dump /Data0/TestSCD2_File1.ds.u496970.uschus1200.0000.0000.0000.37b8.c7810455.0000.2b797a12
dataset descriptor file has unrecognizeable contents.



also are the path of datasets defined in the configuration file?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

A DataSet consists of two things:
  • a control file, whose name ends in ".ds", which contains the record schema and the location of the actual data files

    one or more data files per partition, which reside on the resource disk for that node
It is the former that you provide to the Data Set stage or the Data Set Management utility.

It is one of the latter that is giving the problem. The file name in the error message certainly indicates that it was written with a Data Set stage.

But, Data Sets preserve partitioning. Are you perhaps attempting to read the Data Set using a different configuration file than the one with which it was created?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

The filename format indicates that you are trying to view a dataset by referencing one of the data files and not the descriptor file. You need to reference your .ds descriptor file to view the dataset.
y2ariyas
Premium Member
Premium Member
Posts: 19
Joined: Sun Feb 05, 2006 3:24 pm
Contact:

Post by y2ariyas »

ArndW,
where are the descriptor files located?

Ray,

i am using the same configuration file to to read as the one that was used to create the data set.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The descriptor files (which I called control files - the ones with names ending in ".ds") are wherever you located them. If you did not provide a pathname, but just a "xyz.ds" file name, in the Data Set stage that wrote the Data Set, then the descriptor file is in your project directory.

Neither orchadmin nor the Data Set Management tool can be used to look at a Data Set "part file" directly (which you have already discovered).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply