DSXchange

What is your data flow in the job, can you let us know.

I believe you must be using some transformation to get the output.

Try using a dataset and check if you can get the desired output.

I have a multiple instance job, I checked the job in the monitor only to find that the transformer stage finished with an 'Unknown' status, and the over all job finished with a status of finished. When i try to see the detailed log of the job for that particular instance I cannot see the logs for th...

Hey Nitin,

I am facing a similar issue in my project.
The situation here is when I run the job then one or more stage in the job finish with and unknown status. As result we cannot see the logs.

Wondering if i can get a solution to this isse.

skumar, how is the data flow of your job. ?

2 things that you can check is :

o check for any nulls in your sources. that could be the cause of this issue.
o check if you have enough space to the place where you are writing your output file.

Thank you all for your replies.

What would be the case when I have defined say 8 nodes, with no pools defined. As in I would only have one pool which is the default pool. How would it affect the DS jobs execution? Currently, my cofiguration is set to 8 nodes on a 16 CPU system (SMP), it has a SAN and all my disk and scratch space ...

I am trying to understand a few things related to the configuration file. SAMPLE: { node "node1" { fastname "my_fastname" pools "" resource disk "/fs_stage_dataset/Datasets" {pools ""} resource scratchdisk "/fs_stage_dataset/Scratch" {pools...

Using the trim function as you have mentioned Trim("columnname","0","L") would only remove the leading zeros from the "columnname" specified. You need to be clear if you would want to remove leading 0 or trailing 0 or anything in betn as well.. Using option &q...

If I have the RCP turned off.. what happens to those columns?? The point that I am trying to make and understand it to know: what happens to columns that are not propagated to the next stage, how does it affect the processing of such columns? The situation could be, either they are dropped or they c...

So, what happens to the columns that are not propogated to the next stage???

Ray, why does the precision needs to be larger than scale?? Any particular reason, and if the scale=percision what's the problem in there?

Thanks for the reply Ray.

As I know, if I did not propogate any column in Transformer from input to output, the stray column still remains in the stream and utilizes resources, and hence its recommended to use modify stage to drop columns that are not required. Based on this knowledge, I am wondering which stages would autom...

Ray, I understand that the operator APT_PLAYER_MEMORY will provide me the memory required by each player. But the point that I am trying to make is .. I would like to understand the memory required by my jobs.. (May be I am not sure how is a player linked to a job.. pls help me here, would be great)...

I was wondering if there is any way that can help me understand the memory consumption by the data stage jobs. Suppose, I have a lookup job that has a sequential file as its lookup set, how can I estimate if it is small enough to be held in the memory. Lets say that sequential file contains 4 cols w...