Search found 112 matches

by chetan.c
Fri May 25, 2012 1:48 am
Forum: General
Topic: Shell script takes longer execution time in DS than prompt
Replies: 8
Views: 3778

Shell script takes longer execution time in DS than prompt

Hi, I have a unix script which i am executing through datastage in a sequence job. The script takes 16 seconds on the command prompt but takes around 55 seconds when the job is run. In the sequence job I have only the Execute Command Stage. What could be the reason for this behaviour? Thanks, Chetan.C
by chetan.c
Wed May 23, 2012 8:06 am
Forum: General
Topic: DSJE_BADSTATE error even after recompiling and restting
Replies: 6
Views: 3828

"RESTART resumes a restartable job sequence from the last checkpoint using the original job parameter values. .
Using this now, as my sequence is restartable.
Creating some sample jobs and aborting them to test this out.


Thanks craig.
by chetan.c
Wed May 23, 2012 7:57 am
Forum: General
Topic: DSJE_BADSTATE error even after recompiling and restting
Replies: 6
Views: 3828

chulett wrote: my launch scripts always check first and reset if need ...
Thanks Craig.
What I assumed was like in Job activity where we have option like

Code: Select all

Reset if required,then run
.So there has to be branching like if status_Code=3 then Reset else just

Code: Select all

-run without -mode 
is fine ?

Thanks,
Chetan.C
by chetan.c
Wed May 23, 2012 7:18 am
Forum: General
Topic: DSJE_BADSTATE error even after recompiling and restting
Replies: 6
Views: 3828

Removed the -mode RESET and the job ran fine.

Here RESET means reset if required or something else?

Thanks,
Chetan.C
by chetan.c
Wed May 23, 2012 6:36 am
Forum: General
Topic: DSJE_BADSTATE error even after recompiling and restting
Replies: 6
Views: 3828

DSJE_BADSTATE error even after recompiling and restting

Hi, I'm trying to run a sequence from command line using the below command. $DSHome/bin/dsjob -authfile /home/logondev -run -mode RESET -wait -warn 0 -param Directory=$folder -jobstatus proj1 SEQ_MASTER The job ran fine for 2 runs and aborted with an issue in an underlying job. The issue with that j...
by chetan.c
Wed May 23, 2012 2:09 am
Forum: General
Topic: Issue abort after 50 warnings
Replies: 1
Views: 1142

Found the solution to it.

Its the option -warn 0 (Unlimited warnings)
by chetan.c
Wed May 23, 2012 1:18 am
Forum: General
Topic: Issue abort after 50 warnings
Replies: 1
Views: 1142

Issue abort after 50 warnings

Hi,
I am running a job from Command line.
The job aborts after 50 wanings.

When run from director i have set in options no limit for warnings and hence it does not abort there.

How should this be handled when running from command line?


Thanks,
Chetan.C
by chetan.c
Mon Apr 30, 2012 9:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slower downstream stage affects performance of upstream stag
Replies: 7
Views: 2780

Well... then it sounds like you're stuck with the neck of that particular bottle. ... :) yes right at the neck ..we are trying to improve performance of the Java code right now.. Hi Jerome, Thanks . I did think about buffer memory but thought first let us tune the java code as much as possible and ...
by chetan.c
Mon Apr 30, 2012 12:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slower downstream stage affects performance of upstream stag
Replies: 7
Views: 2780

What's going on in the Java transformers? Any way to replace them with native DataStage functionality? ... Hi Craig, The java transformer has the code to generate XPATH,element name and value.We are using this as the xsd of the XML's that we get comes from over 1000 applications and all have their ...
by chetan.c
Sun Apr 29, 2012 7:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slower downstream stage affects performance of upstream stag
Replies: 7
Views: 2780

Slower downstream stage affects performance of upstream stag

Hi, My job design looks like below. Ext_Source---transformer---Java Transaformer---Java Transaformer---Transformer--dataset. When i run the Code only from External source --Transformer---Dataset , the rows/second from the stages are around 1400rows/sec. But if the Complete design is included the Ext...
by chetan.c
Sat Apr 28, 2012 2:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Increase in number of instances of the job increases time.
Replies: 7
Views: 3116

Thanks Eric.

Will work on it and post if i make any improvements.

Thanks,
Chetan.C
by chetan.c
Thu Apr 26, 2012 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Increase in number of instances of the job increases time.
Replies: 7
Views: 3116

Thanks Ray, I have very little knowledge on that. Reading up on that and searching through the forum for that. It can depend on if the bottleneck is memory, CPU, disk, network. Tune the job design first. Also check any OS settings that can impose limits. Thanks eric. Can you give me some pointers on...
by chetan.c
Thu Apr 26, 2012 1:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Increase in number of instances of the job increases time.
Replies: 7
Views: 3116

:) Oh but i have to process that volume.One instance processes around 100 mb data and i have 5 instances to touch 500 mb.
Is there a workaround for this?


Thanks,
Chetan.C
by chetan.c
Wed Apr 25, 2012 10:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Increase in number of instances of the job increases time.
Replies: 7
Views: 3116

Increase in number of instances of the job increases time.

Hi , I have a multiple instance job which im calling through a sequence job which is also multiple instance. There is another sequence where i call instances of the sequence. Master_Sequence--->Sequence(multiple instance)--->Parallel job(multipleinstance) . In the master sequence if the number of in...