Hi All,
Can anyone please let me know is there anyway we can compare two datastage jobs?
Search found 98 matches
- Wed Jul 29, 2009 5:41 am
- Forum: General
- Topic: Compare two Datastage jobs
- Replies: 13
- Views: 21296
- Wed Jul 22, 2009 5:00 am
- Forum: General
- Topic: how to Run DSjobs on command prompt on Unix machine
- Replies: 7
- Views: 6869
I tried to start my car this morning. But it didn't work out. Please suggest. Your issue is no easier to solve BECAUSE you have not provided any useful diagnostic information. What error message did you get? Do you even understand what the PATH and LD_LIBRARY_PATH environment variables do? Can anyo...
- Mon Jul 20, 2009 5:30 am
- Forum: General
- Topic: how to Run DSjobs on command prompt on Unix machine
- Replies: 7
- Views: 6869
how to Run DSjobs on command prompt on Unix machine
hi All, Can anyone please guide me how to run DS jobs on command prompt and Unix server Please suggest the commands to start with? One more question jobs are in different folders of that application, can i access any folder and run that job or should it kept in some directory path? i tried using the...
- Mon Jul 20, 2009 4:26 am
- Forum: General
- Topic: Version control and documentation of DS
- Replies: 4
- Views: 1552
The type and level of documentation for DataStage is entirely dependant upon what the client or user wishes. There a capabilities at all levels to add documentation to jobs - in fact there are far too many places where one can add information and using all of them would be very tedious. At Version ...
- Mon Jul 20, 2009 3:15 am
- Forum: General
- Topic: Version control and documentation of DS
- Replies: 4
- Views: 1552
Version control and documentation of DS
Hi All, I have few general question of DS. What kind of documentation we do in DS? Is any version control software available for DS jobs , where do we find them? and How so we work with the DS jobs. I seen lot of links , but still not clear how people for acheiving this... Can anyone please guide me...
- Wed Jul 15, 2009 4:38 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Processing in input data in batch wise
- Replies: 4
- Views: 1582
Do you mean that you wish to process your input in batches of 100,000 or that you wish to parcle out your output to files limited to 100,000 lines each? If you create one output file you could use th ... Thanks for the quick response. i mean i wish to process your input in batches of 100,000. Could...
- Wed Jul 15, 2009 12:24 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Processing in input data in batch wise
- Replies: 4
- Views: 1582
Processing in input data in batch wise
Hi Have a requirement in which i need to proceess the input records based onbatches of 100,000 records to the final output file.. This requirement is because to resolve performance issue.. Please suggest.. As it has 15month's old record so we extracting all the transaction records and limiting in th...
- Sun Jul 12, 2009 11:37 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Limiting the records to load into sequential file
- Replies: 8
- Views: 2926
As long as the data is sorted coming into your final transformer such that the 10 current records are first, the previously suggested use of @OUTROWNUM < 100001 as a constraint would be the way to go. Then you can add a second link off the same transformer with a constraint of @OUTROWNUM > 100000 (...
- Fri Jul 10, 2009 3:35 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Limiting the records to load into sequential file
- Replies: 8
- Views: 2926
The requirement is decidedly unclear. Which 100,000 records do you load into the output file? The first 100,000 for the day, the last 100,000 for the day, or is it based on some other criterion? ... Sorry for not giving an clear requirement Let me make more clear and precise 1. The job executes on ...
- Fri Jul 10, 2009 3:28 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Limiting the records to load into sequential file
- Replies: 8
- Views: 2926
- Fri Jul 10, 2009 12:11 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Limiting the records to load into sequential file
- Replies: 8
- Views: 2926
Limiting the records to load into sequential file
Hi All, I have a requriement in which i need to load only 100,000 records into final output file . My input is the table where we expect around 200,000 records per day. but the requirement is that i need to load only 100,000 records into the output file and the remaining data on the next the same jo...
- Wed Jul 01, 2009 2:42 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: APT_CombinedOperatorController,0
- Replies: 5
- Views: 2226
There should be other error messages in the log that detail the cause; this message doesn't help much. Does the data contain more than 31685 records? Notice that one less output than input rows came i ... Thanks for your reponse.. Can you please guide me what could have gone wrong from myend.. I am...
- Wed Jul 01, 2009 1:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: APT_CombinedOperatorController,0
- Replies: 5
- Views: 2226
Your first step is to set APT_DISABLE_COMBINATION to true so that you can find out which stage is causing the error. You also need to look into your log file and find the real error message, the one y ... Thank you so much appreciate your quick response. I find that it was transformer problem and n...
- Wed Jul 01, 2009 12:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: APT_CombinedOperatorController,0
- Replies: 5
- Views: 2226
APT_CombinedOperatorController,0
Hi All, My requriement is extracting the dataset records from the previous job and in the existing job i am reading the dataset and loading in the sequential file Dataset--->Transformer---.seq uential file The job is aborting by below fatal APT_CombinedOperatorController,0: Caught unknown exception ...
- Mon Jun 29, 2009 11:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Join returns wrong result with Partitioning
- Replies: 14
- Views: 4621
Sort the data by using sort stage(join key column) and derive the key change column. Have a constraint (keychangecolumn=0)in transformer before writing the dataset. We can avoid one-to-many relationship. The other option is to sort and remove duplicates on the lookup stream prior to performing the ...