Search found 200 matches

by dnat
Fri Jun 17, 2011 2:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sparse lookup-join
Replies: 4
Views: 3290

sparse lookup-join

Hi, We have used sparse lookup in a job where the condition in the oracle stage is select value from table where lowsc<=orchestrate.sc and highsc>=orchestrate.sc. So, i pass the field "value" to the output, based on the field sc from input . Now, the job is failing with heap allocation err...
by dnat
Fri May 13, 2011 1:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: improving performance
Replies: 2
Views: 2217

improving performance

Hi, I have several datastage jobs which run to update multiple dim and fact tables in a data warehousing application. Most of the jobs take around 3 to 4 minutes to complete and 2 or 3 jobs take around 40 minutes to complete. Altogether it takes around 4 to 5 hours to complete. We have an SLA for th...
by dnat
Wed Apr 06, 2011 1:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: isnull function
Replies: 8
Views: 6153

Hi, i manually typed in the code, just to mention that i am using a isnull() function. When i see the input data through datastage using "View Data", the fields are having values as "NULL". And when i use the same code in derivations, it works. Only in stage variables it is eithe...
by dnat
Mon Apr 04, 2011 11:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: isnull function
Replies: 8
Views: 6153

isnull function

Hi, I have an oracle stage as input where there are null values in field A. The next stage is a transformer, and in the stage variable i want to do some validations based on the field A's value. I use this function If isnull(Lnk.A) Then 1 Else 0. But even if the value is isnull, it always goes to th...
by dnat
Tue Feb 15, 2011 5:07 am
Forum: General
Topic: connection between job and sequencer
Replies: 4
Views: 2586

No, nothing was changed in the job in the recent past..
by dnat
Tue Feb 15, 2011 3:40 am
Forum: General
Topic: connection between job and sequencer
Replies: 4
Views: 2586

connection between job and sequencer

Hi, I have a Job sequence like this which calls multiple job sequences like this Job sequence1-->Job sequence 2-->Job sequence3-->Parallel job1 Job sequence 3 has aborted with the error message "JobControl (fatal error from @ABORT_JOB_FAILED): Job Failed" But when i look at the Parallel jo...
by dnat
Mon Feb 07, 2011 4:31 am
Forum: General
Topic: not able to connect to oracle
Replies: 1
Views: 1447

not able to connect to oracle

Hi, I have a sequencer which calls another sequencer which in turn another sequencer. It has been running fine for a while without any issues. Now suddenly i am getting the ORA-12541 error when the job inside the sequencer is running. I tried connecting the db through sqlplus and it just connects, s...
by dnat
Thu Feb 11, 2010 4:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: join in different environment
Replies: 3
Views: 2433

there is no difference, because i exported the job from dev and imported the same in test env.

The unusual output is, the key columns are joined properly in dev, but when i run with the same data in test(by pointing the DB to dev DB). it is not joining.
by dnat
Thu Feb 11, 2010 1:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: join in different environment
Replies: 3
Views: 2433

join in different environment

Hi I have a job which joins a source and reference and it gives perfect results When i run the same job in test environment, fetching the data from dev tables, it is not joining properly. I am wondering what could be the problem because the data is same i am doing a sort and hash join in both the in...
by dnat
Wed Feb 10, 2010 4:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: question regarding join and null
Replies: 4
Views: 5346

i checked the join conditions by creating two tables and having nulls. A null in source is joining with a null in target..so even if i change it to some other value like -1, it is going to give me the same ouput.
by dnat
Mon Feb 08, 2010 10:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: question regarding join and null
Replies: 4
Views: 5346

question regarding join and null

Hi How does datastage handle null in the input key column and the reference key column. I have millions of data in the input as well as reference and the key columns which i use to join is having nulls. So, will the null in input join with the null in reference?. Because i am doing a left join and g...
by dnat
Sun Feb 07, 2010 11:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sort and hash partitioning
Replies: 4
Views: 3169

sort and hash partitioning

Hi I have a question on sorting before join. Is it good to use explicit sort stage or doing a sort in the stage itself(by checking "Perform Sort") and do a hash partitioning? If we are doing hash partitioning, then why do we need to sort the data, as the hash partitioning is done on keys? ...
by dnat
Wed Feb 03, 2010 9:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: importing metadata as decimal
Replies: 1
Views: 1049

importing metadata as decimal

Hi I have a col defined as Number in oracle. When i import it in datastage, the datatype is decimal for that column. First i want to know why this is done. and also, should i just leave it as decimal and perform my operations or change it to integer in the metadata after i import and then do the tra...
by dnat
Wed Feb 03, 2010 4:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: join different data type
Replies: 3
Views: 1722

join different data type

Hi I have a col which is coming as integer in the input and the same col in reference is defined as decimal. When i join source and reference using this column as the key, what will be the situation. should it join or should it not join. The value from souce is 10 The value from target is 10.00 For ...
by dnat
Thu Jan 21, 2010 8:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage error
Replies: 2
Views: 2670

Thanks Arndw..I had overlooked one column..I had defined that in the initial oracle stage metadata, but had a user-defined sql so was not pulling that column at all. I included that and the error went away..