Search found 726 matches

by zulfi123786
Tue Jul 08, 2014 2:21 pm
Forum: General
Topic: dsjob -report vs DataStage C++ API
Replies: 5
Views: 2187

dsjob -report vs DataStage C++ API

Hi, We have DataStage 8.5 (Does it make sense if I say "we would better have individual version in the Release drop down as there is much difference within 8.x versions" ?) There are 10000 jobs in a project to collect the run time statistics and currently we are using dsjob -report (withou...
by zulfi123786
Tue Jul 08, 2014 1:50 pm
Forum: General
Topic: Delete/Remove multiple instances of jobs
Replies: 10
Views: 5986

??? Not sure I follow that statement. Appears like my post was unclear. What I meant was, The jobs run every weekday and on every weekday all of its 7000 instances are triggered, this populates too much data into the log file and when ever the Director is opened it has to look into the log file (or...
by zulfi123786
Tue Jul 08, 2014 8:56 am
Forum: General
Topic: Delete/Remove multiple instances of jobs
Replies: 10
Views: 5986

Project level auto purge is set for one day, problem is that all of the 7000 instances run on week days so the auto purge won't help :(

Thanks
by zulfi123786
Tue Jul 08, 2014 5:52 am
Forum: General
Topic: elapsed time in "-report" for multi instance jobs
Replies: 10
Views: 4802

It just got more interesting :) etlld0001|zsyed10|/u/zsyed10> dsjob -report dev_fab DF_batch_Poc ************************************************** STATUS REPORT FOR JOB: DF_batch_Poc Generated: 2014-07-08 06:48:47 Job start time=2013-12-13 01:02:54 Job end time=2014-07-08 06:48:47 Job elapsed time=...
by zulfi123786
Tue Jul 08, 2014 5:38 am
Forum: General
Topic: Delete/Remove multiple instances of jobs
Replies: 10
Views: 5986

Hi, I am exactly in the same situation, Just got into a project where there are too many (7000) instances of a job and there are few jobs like this. Because of too many instances the Director crashes when launched. It has been three years since this thread but posting with a hope if any workaround w...
by zulfi123786
Mon Jul 07, 2014 1:59 pm
Forum: General
Topic: elapsed time in "-report" for multi instance jobs
Replies: 10
Views: 4802

What number do you get when you add the invocation ID to your jobname? When the invocation id is used with the job name the result is all good but in our project (unfortunately) there are cases where a job was later changed to enable multi instance and I have to capture elapsed time of the parent j...
by zulfi123786
Mon Jul 07, 2014 12:14 pm
Forum: General
Topic: elapsed time in "-report" for multi instance jobs
Replies: 10
Views: 4802

wouldn't that be serious misrepresentation of information ?

Anyways, I was designing a script to fetch elapsed times for all jobs including the multi instance ones. Is there a way to get through this issue or am I at a dead end ?

Thanks
by zulfi123786
Mon Jul 07, 2014 10:52 am
Forum: General
Topic: What's the Coolest Feature of DataStage?
Replies: 18
Views: 9659

I started using DataStage from 7.5 version to 8.5. I feel the best part of DataStage is the GUI and its simplicity. Just out of college with not much programming background I was able to use it effectively in a couple of weeks (gaining deeper insight took considerable time though) Also the Cross pro...
by zulfi123786
Mon Jul 07, 2014 9:27 am
Forum: General
Topic: elapsed time in "-report" for multi instance jobs
Replies: 10
Views: 4802

elapsed time in "-report" for multi instance jobs

Hi, There is a multi instance job which is run with around 10 instances each taking around 5 minutes for each run but when I try to get the elapsed time using dsjob -report Its giving a huge value etlld0001|zsyed10|/tmp> dsjob -report dev_fab DF_batch_Poc 2>/dev/null ********************************...
by zulfi123786
Mon Jul 07, 2014 8:55 am
Forum: General
Topic: dssearch returning <none>
Replies: 4
Views: 3415

Its a Development environment Craig, hence the job designs exist so not the case pointed out.
by zulfi123786
Mon Jul 07, 2014 4:43 am
Forum: General
Topic: dssearch returning <none>
Replies: 4
Views: 3415

dssearch returning <none>

Hi, There seems to be a problem with the dssearch command (Using DataStage 8.5) It always returns <none> for no good reason. Tried finding a job "DFPLookUpTableLoadDB2Job" using dsjob and its listed etlld0001|zsyed10|/u/zsyed10> dsjob -jobinfo dev_fab DFPLookUpTableLoadDB2Job Job Status : ...
by zulfi123786
Wed Jun 11, 2014 2:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SAS cluster configuration
Replies: 0
Views: 837

SAS cluster configuration

Hi, We have a couple of SAS datasets to be read on DataStage server. SAS is installed over another AIX box and I am making its inclusion in the config file. Issue is that the unix id on DataStage server is different compared to the one we use for SAS access and it would take considerable time to hav...
by zulfi123786
Tue Jun 10, 2014 4:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage not optimized out of the job
Replies: 4
Views: 1715

jerome_rajan wrote:Try running the job and analyze the check the job score (set APT_DUMP_SCORE environment variable) to see if the copy operator appears there
as mentioned in my original post the stage stays in the score of the job.
zulfi123786 wrote:but the copy stays in the compiled code and in the score of the job.
by zulfi123786
Tue Jun 10, 2014 4:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage not optimized out of the job
Replies: 4
Views: 1715

Copy stage not optimized out of the job

Hi, I added a copy stage to the job just to make the job design look appealing and I expected it to be optimized during compilation (Force='FALSE') The stage has one input link and one output link and all columns just dragged to from input to output but the copy stays in the compiled code and in the...
by zulfi123786
Thu Apr 24, 2014 6:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: migrating build stage excluding source code
Replies: 0
Views: 1061

migrating build stage excluding source code

Hi, I have created a build stage and would have to migrate that to different other development environments and production env, I dont want the source code of the build stage to be available for developer who might change that to create nightmares. Is it as simple as exporting only the executables a...