Search found 98 matches

by monaz
Wed Jul 29, 2009 5:41 am
Forum: General
Topic: Compare two Datastage jobs
Replies: 13
Views: 21296

Compare two Datastage jobs

Hi All,

Can anyone please let me know is there anyway we can compare two datastage jobs?
by monaz
Wed Jul 22, 2009 5:00 am
Forum: General
Topic: how to Run DSjobs on command prompt on Unix machine
Replies: 7
Views: 6869

I tried to start my car this morning. But it didn't work out. Please suggest. Your issue is no easier to solve BECAUSE you have not provided any useful diagnostic information. What error message did you get? Do you even understand what the PATH and LD_LIBRARY_PATH environment variables do? Can anyo...
by monaz
Mon Jul 20, 2009 5:30 am
Forum: General
Topic: how to Run DSjobs on command prompt on Unix machine
Replies: 7
Views: 6869

how to Run DSjobs on command prompt on Unix machine

hi All, Can anyone please guide me how to run DS jobs on command prompt and Unix server Please suggest the commands to start with? One more question jobs are in different folders of that application, can i access any folder and run that job or should it kept in some directory path? i tried using the...
by monaz
Mon Jul 20, 2009 4:26 am
Forum: General
Topic: Version control and documentation of DS
Replies: 4
Views: 1552

The type and level of documentation for DataStage is entirely dependant upon what the client or user wishes. There a capabilities at all levels to add documentation to jobs - in fact there are far too many places where one can add information and using all of them would be very tedious. At Version ...
by monaz
Mon Jul 20, 2009 3:15 am
Forum: General
Topic: Version control and documentation of DS
Replies: 4
Views: 1552

Version control and documentation of DS

Hi All, I have few general question of DS. What kind of documentation we do in DS? Is any version control software available for DS jobs , where do we find them? and How so we work with the DS jobs. I seen lot of links , but still not clear how people for acheiving this... Can anyone please guide me...
by monaz
Wed Jul 15, 2009 4:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Processing in input data in batch wise
Replies: 4
Views: 1582

Do you mean that you wish to process your input in batches of 100,000 or that you wish to parcle out your output to files limited to 100,000 lines each? If you create one output file you could use th ... Thanks for the quick response. i mean i wish to process your input in batches of 100,000. Could...
by monaz
Wed Jul 15, 2009 12:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Processing in input data in batch wise
Replies: 4
Views: 1582

Processing in input data in batch wise

Hi Have a requirement in which i need to proceess the input records based onbatches of 100,000 records to the final output file.. This requirement is because to resolve performance issue.. Please suggest.. As it has 15month's old record so we extracting all the transaction records and limiting in th...
by monaz
Sun Jul 12, 2009 11:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Limiting the records to load into sequential file
Replies: 8
Views: 2926

As long as the data is sorted coming into your final transformer such that the 10 current records are first, the previously suggested use of @OUTROWNUM < 100001 as a constraint would be the way to go. Then you can add a second link off the same transformer with a constraint of @OUTROWNUM > 100000 (...
by monaz
Fri Jul 10, 2009 3:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Limiting the records to load into sequential file
Replies: 8
Views: 2926

The requirement is decidedly unclear. Which 100,000 records do you load into the output file? The first 100,000 for the day, the last 100,000 for the day, or is it based on some other criterion? ... Sorry for not giving an clear requirement Let me make more clear and precise 1. The job executes on ...
by monaz
Fri Jul 10, 2009 3:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Limiting the records to load into sequential file
Replies: 8
Views: 2926

A constraint of "@OUTROWNUM<100001' on the last transform would do the trick. ... Thanks for all for there quick response. My requirement is that they will run the job on daily basis , so based on the date feild if the date feild is having a value of today then i need to pass those records int...
by monaz
Fri Jul 10, 2009 12:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Limiting the records to load into sequential file
Replies: 8
Views: 2926

Limiting the records to load into sequential file

Hi All, I have a requriement in which i need to load only 100,000 records into final output file . My input is the table where we expect around 200,000 records per day. but the requirement is that i need to load only 100,000 records into the output file and the remaining data on the next the same jo...
by monaz
Wed Jul 01, 2009 2:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_CombinedOperatorController,0
Replies: 5
Views: 2226

There should be other error messages in the log that detail the cause; this message doesn't help much. Does the data contain more than 31685 records? Notice that one less output than input rows came i ... Thanks for your reponse.. Can you please guide me what could have gone wrong from myend.. I am...
by monaz
Wed Jul 01, 2009 1:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_CombinedOperatorController,0
Replies: 5
Views: 2226

Your first step is to set APT_DISABLE_COMBINATION to true so that you can find out which stage is causing the error. You also need to look into your log file and find the real error message, the one y ... Thank you so much appreciate your quick response. I find that it was transformer problem and n...
by monaz
Wed Jul 01, 2009 12:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_CombinedOperatorController,0
Replies: 5
Views: 2226

APT_CombinedOperatorController,0

Hi All, My requriement is extracting the dataset records from the previous job and in the existing job i am reading the dataset and loading in the sequential file Dataset--->Transformer---.seq uential file The job is aborting by below fatal APT_CombinedOperatorController,0: Caught unknown exception ...
by monaz
Mon Jun 29, 2009 11:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join returns wrong result with Partitioning
Replies: 14
Views: 4621

Sort the data by using sort stage(join key column) and derive the key change column. Have a constraint (keychangecolumn=0)in transformer before writing the dataset. We can avoid one-to-many relationship. The other option is to sort and remove duplicates on the lookup stream prior to performing the ...