Search found 33 matches

by suman27
Thu Jun 14, 2012 4:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to get cumulative sum
Replies: 14
Views: 7913

Re: how to get cumulative sum

No need of S3.
Also records need to be sorted by by ID :)
by suman27
Tue Oct 11, 2011 4:27 am
Forum: General
Topic: Multiple instance log
Replies: 1
Views: 1741

Multiple instance log

Hi, we developed a job which will run in multiple instances parallel, One of the instance finished with warnings according to the log of a sequencer. But there is no log for that particular instance not even an entry. Earlier when it used finish successfully I can see status of that instance in dire...
by suman27
Fri Aug 19, 2011 6:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Non Equi joins
Replies: 5
Views: 3355

Non Equi joins

Hi
Is there any way to do non equi join in data stage parallel job?

Regards,
Suman.
by suman27
Mon Feb 07, 2011 8:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Resource Estimation
Replies: 0
Views: 1438

Resource Estimation

Hi, I was trying to estimate resources for parallel jobs. But i could not able to open the resource estimate tool . Its throwing an error as " Exception occured in ResetData setupDatabase(): Could not delete from specified tables " My DataStage Admin has no clue. How can i resolve this? Re...
by suman27
Sat Feb 05, 2011 2:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I fix performance bottleneck at Sort stage?
Replies: 12
Views: 7574

Hi Abhilash,

You can remove the duplicates in the sort stage itself if you are using same key for remove duplicates..
Increase the sort memory size in sort stage.Check whether it makes any difference in performance.


Regards,
Suman.
by suman27
Fri Feb 04, 2011 5:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can I make a job "always on"?
Replies: 8
Views: 4596

Hi ramsubbiah, We had a similar requirement. If you tried to run the mq stage on multinode config file it will duplicate messages times the number of nodes. So we developed a saparate job which read from MQ and runs on single config file. And the second job will process data with multinode config fi...
by suman27
Fri Feb 04, 2011 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Scratch folder size
Replies: 0
Views: 1428

Scratch folder size

Hi, We have many sequencers that run parallely. Some times jobs are getting aborted with insufficiant space in scratch folder. After removing files from scratch folder jobs are running fine. Is there any way to estimate the scrath folder size. Any best prctices in estimating the scratch file would b...
by suman27
Wed May 26, 2010 9:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs attached to the sequencer
Replies: 5
Views: 3149

DSearch -ljobs SequencerName gives list of jobs used by the sequencer. Thanks Craig
by suman27
Wed May 26, 2010 8:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs attached to the sequencer
Replies: 5
Views: 3149

Thanks Craig. But can I take this details using any DSJob function? I need to implement a logic based on the jobs on which sequencer is attached. From the forum I come to know, using DSGetJoBInfo(vhandle, DSJ.JOBCONTROLLER) , it is possible to get the sequence name for the job. Similarly is there an...
by suman27
Wed May 26, 2010 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs attached to the sequencer
Replies: 5
Views: 3149

Jobs attached to the sequencer

Hi, I have a requirement to log the warning for all jobs attached to the particular sequencer. For example, I have 3 sequencers. So I will have three log files one for each sequencer. Log file will have the warning/Fatal messages of the jobs attached to the particular sequencer. Is there any way to ...
by suman27
Fri May 07, 2010 9:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting Sequence if job finshed with warnings
Replies: 9
Views: 12864

Another option would be to build a custom routine that scans the current job log for warnings and aborts the Sequence if it finds any. ... Hi chulett, Thanks for your suggestion. This option will not work for me,because before the routine finds warnings in job and trigger abort for the sequence , t...
by suman27
Fri May 07, 2010 8:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ reading twice with 2 node cofig
Replies: 2
Views: 2135

Re: MQ reading twice with 2 node cofig

Hi, I have paralell job reading MQ messages using WebSphereMQ stage. working correctly with single node config file. But when i changed to 2nodes. Job is reading twice of MassageQuantity mentioned in the stage. I changed the config file just copying the node1 and pasting it again as node2. Am I doi...
by suman27
Fri May 07, 2010 8:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting Sequence if job finshed with warnings
Replies: 9
Views: 12864

then there is not many options left for you. either abort the sequence on 1 warning by setting the warning limit or insert a after job subroutine in each job to raise exception if the INTRIM JOB STATUS is not equal to 1. Hi Priyadarshikunal, I tried setting that limit to 1, but still job is not get...
by suman27
Fri May 07, 2010 7:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting Sequence if job finshed with warnings
Replies: 9
Views: 12864

Exception Handler is only triggered by a failure, not by a warning. If you want to manage warnings, you need explicit triggers. ... Thanks ray, Could you suggest any alternatives for this situation. How to abort job if there are any warnings. We have to use exception handler as there are many jobs(...
by suman27
Fri May 07, 2010 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting Sequence if job finshed with warnings
Replies: 9
Views: 12864

Aborting Sequence if job finshed with warnings

Hi, We are using an ' exception handler' stage in the sequencer to capture the job status. We want to abort the sequence if job finished with warnings or job is aborted. Exception handler is working if job is aborted but not working if job is finished with warnings, All job triggers in the sequence ...