DSXchange

Hi All,

For some reason, I need to get counts of (i) no. of jobs, (ii) no. of stages, used in my project.

I know how to get the count for (i).
Is there any way to find out the count for (ii)? Of course other than opening all the jobs to count manually.

Thanks!

1. You cannot use a Sparse lookup with DB2 API stage. See this post. I am not sure about ODBC.

2. A lookup can fetch multiple records from lookup table, if you check "Multiple rows returned from link" option in Constraints properties of Lookup stage.

Thanks guys.

Information by kumar_s in viewtopic.php?t=99456&highlight=dsrecords post is helpful.

Craig, it does work in v7.5.1

In Command: rm In Parameters: /DataStage/751A/Ascential/*.blp The plus point with the above logic is you can even use job parameter if you want to change the directory runtime. In Command: rm In Parameters: #prmDirName# /*.blp >> prmDirName is a job parameter >> prmDirName can be set to /DataStage/...

Try this..

In Command: rm
In Parameters: /DataStage/751A/Ascential/*.blp

Cheers!

Hi All, I have many parallel jobs, which create and populate datasets. After all the jobs finish, I want to get the count of records present in each of the datasets. All the datasets are stored in a single directory. I am aware of just one approach which doesn't look efficient to me - creating new j...

Bingo.. It worked :D

Thanks Craig!

Guys, Same issue here. The log file for a job exceeded 2GB and on finding this, the developer manually removed the files (using rm command) under RT_LOGnnn folder. He should have used CLEAR.FILE command!! Now the job has been locked. I want to delete this job. Will appreciate if any of you could gui...

Hi,

I have a query on JOIN stage with Hash partitioning.

Is there any scenario when Sorting should not be done while joining two streams with Hash partitioning? Or should I blindly check the Sort option whenever partition type is set to Hash.

Thanks!

Bingo!!!

It worked, I just appended @FM for equality check.
Ray, you are a genious. Thanks much.

Guys, thanks for the suggestions. Even I was thinking to use Copy stage - unfortunately my job looks like a spidernet, and becomes very unreadable.

Thanks Kim. I think the ExecuteCommand is returning correct output (may be in wrong format). In the first case above, Director is displaying correct no. of files present in the directory, i.e. 9. When I try to match $CommanOutput value with 9 or '9', it doesn't match. I tried out with Trim(), Num(),...

Found another way to see which jobs have used Basic transformer stages (or any other stages):

Go to DS Manager,
Select Stage Types -> parallel -> processing -> Basic Transformer -> Right click and select usage analysis.

Hi, I have a ExecuteCommand activity with following properties set: ExecCommand page Command : ls Parameters : #prmDirXml# | wc -l | tr -s ' '' ' | cut -f2 -d" " Triggers page Name : Link1 Expression Type :ReturnValue - (Conditional) Expression : = 0 Name : Link2 Expression Type :Otherwise...