DSXchange

Hello all, After searching in Server forum and with no success, I'm posting my questions 1) Is there a way to find the path of a job, in Designer, using a UNIX script? I do the following manual steps in UNIX shell - uv - SELECT * FROM DS_JOBS WHERE NAME = 'test1' 2) Is there a way to use the above c...

Thanks Ray!

What do you understand to be the point of a key-based partitioning algorithm such as Hash or Modulus? Ray, Correct me if I'm wrong. The point of a key-based partitioning algorithm is to get all records with same keys in the same partition. Below is the job which I'm working on- DataSet3 DataSet4 | ...

Hello, I've a job in which there is a requirement to Hash partition on two different key sets in two different stages. Assume keys A & B for Stage2 and keys C & D for Stage3. Partial job design below: Stage1 -> Stage2 -> Stage3 ... If I Hash partition on keys A, B, C & D in Stage1 then w...

Ray,

Please correct me if I'm wrong.

By

ray.wurlod wrote: inspecting the record schema of the Data Set ...

did you mean

orchadmin ll <datasetname.ds> ?

For the above command here is what I see for a single varchar column and I don't see additional four fields anywhere.

Schema:
record
( col1: string;
)

Now I get it.

Thanks for your time Ray.

Hello, Can anyone please explain to me the use of Link Ordering in Transformer stage and in which scenario this should be used? Will this make sense to use only when Transformer executes in sequential mode? Are links processed in the order specified? Then wouldn't the purpose of parallelism be defea...

Not sure where that is documented other than in posts here. Unbounded varchar fields are stored as you would expect but declare a size (which most everyone does) and it takes that full size in the dataset. I created a tiny job to verify it and what you said is correct. Thank you! Thanks jcthornton!

jcthornton, Second, there is additional metadata that is stored in the dataset that will not be in a similar text file. Does additional metadata include indexes on key columns? What are the other things that are included in metadata? The only other item that comes to mind is that perhaps you are doi...

Hello, A job is reading from sequential file, passing it through a transformer and writing to a DataSet. There are 7 key columns for source and destination. The sequential file has 293 fields and 5 million records. The DataSet has same number of fields and records. But I see that DataSet is occupyin...

"Added the 2 nodes in the node map constraint field " ->Do you have any particular reason for adding this?

Can you remove it from node map constraint field and check?

Ray,
I already have 2 seconds delay between consecutive exports. Guess that's too short. I'll increase it to 30 seconds and update you.
Thanks.

Craig,
It seems somewhat random.

Ray,
1) The project name is correctly spelled and cased.
2) The project exists.
3) The authentication details are correct.

Hello all, I've written a script which takes a .dsx export, every Friday, by running dscmdexport.exe command on Windows client. I've created this script to handle multiple project names as input. However for past few runs I observed that it exports all the projects but errors out with one or atleast...

Thanks Craig. I'll keep that in mind :D