No need of S3.
Also records need to be sorted by by ID
Search found 33 matches
- Thu Jun 14, 2012 4:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to get cumulative sum
- Replies: 14
- Views: 7945
- Tue Oct 11, 2011 4:27 am
- Forum: General
- Topic: Multiple instance log
- Replies: 1
- Views: 1741
Multiple instance log
Hi, we developed a job which will run in multiple instances parallel, One of the instance finished with warnings according to the log of a sequencer. But there is no log for that particular instance not even an entry. Earlier when it used finish successfully I can see status of that instance in dire...
- Fri Aug 19, 2011 6:47 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non Equi joins
- Replies: 5
- Views: 3367
Non Equi joins
Hi
Is there any way to do non equi join in data stage parallel job?
Regards,
Suman.
Is there any way to do non equi join in data stage parallel job?
Regards,
Suman.
- Mon Feb 07, 2011 8:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Resource Estimation
- Replies: 0
- Views: 1441
Resource Estimation
Hi, I was trying to estimate resources for parallel jobs. But i could not able to open the resource estimate tool . Its throwing an error as " Exception occured in ResetData setupDatabase(): Could not delete from specified tables " My DataStage Admin has no clue. How can i resolve this? Re...
- Sat Feb 05, 2011 2:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How do I fix performance bottleneck at Sort stage?
- Replies: 12
- Views: 7616
- Fri Feb 04, 2011 5:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How can I make a job "always on"?
- Replies: 8
- Views: 4617
Hi ramsubbiah, We had a similar requirement. If you tried to run the mq stage on multinode config file it will duplicate messages times the number of nodes. So we developed a saparate job which read from MQ and runs on single config file. And the second job will process data with multinode config fi...
- Fri Feb 04, 2011 6:39 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Scratch folder size
- Replies: 0
- Views: 1432
Scratch folder size
Hi, We have many sequencers that run parallely. Some times jobs are getting aborted with insufficiant space in scratch folder. After removing files from scratch folder jobs are running fine. Is there any way to estimate the scrath folder size. Any best prctices in estimating the scratch file would b...
- Wed May 26, 2010 9:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs attached to the sequencer
- Replies: 5
- Views: 3159
- Wed May 26, 2010 8:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs attached to the sequencer
- Replies: 5
- Views: 3159
Thanks Craig. But can I take this details using any DSJob function? I need to implement a logic based on the jobs on which sequencer is attached. From the forum I come to know, using DSGetJoBInfo(vhandle, DSJ.JOBCONTROLLER) , it is possible to get the sequence name for the job. Similarly is there an...
- Wed May 26, 2010 7:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobs attached to the sequencer
- Replies: 5
- Views: 3159
Jobs attached to the sequencer
Hi, I have a requirement to log the warning for all jobs attached to the particular sequencer. For example, I have 3 sequencers. So I will have three log files one for each sequencer. Log file will have the warning/Fatal messages of the jobs attached to the particular sequencer. Is there any way to ...
- Fri May 07, 2010 9:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Aborting Sequence if job finshed with warnings
- Replies: 9
- Views: 12887
Another option would be to build a custom routine that scans the current job log for warnings and aborts the Sequence if it finds any. ... Hi chulett, Thanks for your suggestion. This option will not work for me,because before the routine finds warnings in job and trigger abort for the sequence , t...
- Fri May 07, 2010 8:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ reading twice with 2 node cofig
- Replies: 2
- Views: 2141
Re: MQ reading twice with 2 node cofig
Hi, I have paralell job reading MQ messages using WebSphereMQ stage. working correctly with single node config file. But when i changed to 2nodes. Job is reading twice of MassageQuantity mentioned in the stage. I changed the config file just copying the node1 and pasting it again as node2. Am I doi...
- Fri May 07, 2010 8:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Aborting Sequence if job finshed with warnings
- Replies: 9
- Views: 12887
then there is not many options left for you. either abort the sequence on 1 warning by setting the warning limit or insert a after job subroutine in each job to raise exception if the INTRIM JOB STATUS is not equal to 1. Hi Priyadarshikunal, I tried setting that limit to 1, but still job is not get...
- Fri May 07, 2010 7:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Aborting Sequence if job finshed with warnings
- Replies: 9
- Views: 12887
Exception Handler is only triggered by a failure, not by a warning. If you want to manage warnings, you need explicit triggers. ... Thanks ray, Could you suggest any alternatives for this situation. How to abort job if there are any warnings. We have to use exception handler as there are many jobs(...
- Fri May 07, 2010 4:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Aborting Sequence if job finshed with warnings
- Replies: 9
- Views: 12887
Aborting Sequence if job finshed with warnings
Hi, We are using an ' exception handler' stage in the sequencer to capture the job status. We want to abort the sequence if job finished with warnings or job is aborted. Exception handler is working if job is aborted but not working if job is finished with warnings, All job triggers in the sequence ...