Search found 97 matches

by tostay2003
Fri Jul 22, 2011 8:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Transformations
Replies: 1
Views: 1720

Generic Transformations

Hi All, We have a requirement to create a generic job for processing multiple extract files. As part of this requirement we have to make certain validations. Since the datastage job would be RCP enabled. We want to implement a C++ code (with required fields as arguments) and call it through generic ...
by tostay2003
Wed Dec 22, 2010 1:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Estimate Lookup Size
Replies: 3
Views: 2188

Yes. The size of each data type is documented (from memory in Chapter 2 of the Parallel Job Developer's Guide ). Add these together for all the columns in the row that you're processing, then ... Hi Ray, Sorry I didn't post my question properly. After calculating the size, how can we determine whet...
by tostay2003
Tue Dec 21, 2010 8:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Estimate Lookup Size
Replies: 3
Views: 2188

Estimate Lookup Size

Hi,

Is there any way to estimate the max possible size of data that can be used as secondary link for Lookup Stage.

Thanks
by tostay2003
Wed Jul 28, 2010 8:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: notnull conversion with non-nullable input
Replies: 9
Views: 8962

Are you renaming from "input0Int8nLDD_X1" to "X1"? Is the source field Not Null? ... Hi Kumar, I am not renaming the field input0Int8n_X1 (it was generated internally within datastage) Is X1 nullable in your source link? Hi, X1 is nullable in source (secondary link) Probably you...
by tostay2003
Mon Jul 26, 2010 6:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: notnull conversion with non-nullable input
Replies: 9
Views: 8962

I am doing left outer join using Join Stage. X1 is non-key field from secondary link.
by tostay2003
Mon Jul 26, 2010 5:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: notnull conversion with non-nullable input
Replies: 9
Views: 8962

notnull conversion with non-nullable input

Hi All, I am getting the following error from the transformer When binding input interface field "input0Int8nLDD_X1" to field "X1": Using "notnull" conversion with non-nullable input. I am using a left outer join and checking the value of a hardcoded field X1 of seconda...
by tostay2003
Fri Jul 03, 2009 10:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Few doubts (PS not interview questions)
Replies: 8
Views: 4254

Thanks for the example of sort.

could you let me know scenario when detrimental added partitioning is introduced by datastage and how to overcome it.

(verbal example as earlier would be sufficient)
by tostay2003
Fri Jun 19, 2009 9:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: empty dataset
Replies: 2
Views: 1642

empty dataset

Since dataset doesn't get created when no records are written to it due to constraints in transformer (or any other stage).

What would be the best approach to create an empty dataset? As this should be called in multiple jobs with dataset name as an argument.
by tostay2003
Wed Jun 17, 2009 11:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Few doubts (PS not interview questions)
Replies: 8
Views: 4254

Thanks for the responses. Can you please provide with an example (score dump) before and after (performance tuning) scoredump .... I found the below in Advanced Developer's Guide The score dump is particularly useful in showing you where DataStage is inserting additional components in the job flow. ...
by tostay2003
Wed Jun 17, 2009 10:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Few doubts (PS not interview questions)
Replies: 8
Views: 4254

A1) Look more carefully at the output structure of each. A2) Please advise in which manual you found the scenarios. A3) No. ... A1) I see the difference in DiffCode() and ChangeCode(). But couldn't find the difference in functionality A2) I found the below in Advanced Developer's Guide The score du...
by tostay2003
Wed Jun 17, 2009 12:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Few doubts (PS not interview questions)
Replies: 8
Views: 4254

Few doubts (PS not interview questions)

Hi, I am trying to learn parallel extender from documents (no software installed). Q1) I didnt find any difference between DIFF stage and CDC Stage. Functionally both are 100% same. Did I miss anything from documentation? Q2) I tried to read about scores and situations that could help in identifying...
by tostay2003
Wed Jun 17, 2009 12:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: database OCI, Enterprise, CLI, Load, Load Express
Replies: 4
Views: 2020

mandyli wrote:Yes. You are right..

All the plug-in stage needs to use depend upon your requirements.

Better to use all native Enterprise stage is always good.

what are the others used for i.e. the oci, cli stages and again when to use load vs load express stage
by tostay2003
Wed Jun 17, 2009 12:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: database OCI, Enterprise, CLI, Load, Load Express
Replies: 4
Views: 2020

database OCI, Enterprise, CLI, Load, Load Express

Hi,

For almost every database plugin we have OCI, Enterprise, CLI, Load, Load Express.

What are the differences between these stages. i.e. when to use them?

Load Express - This appears as a direct load in SQL loader. Am I right?

Thanks
by tostay2003
Mon Jun 01, 2009 6:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: clarification on external filter
Replies: 1
Views: 1431

clarification on external filter

Hi all, I have few newbie questions. PS: I don't have PX installed to verify (I am just going through documents) a) external filter - can we write any unix command (rm/find/grep/awk/sed/cut...) etc? b) Can I write unix scripts to process .ds files (just as txt files) and use external filter c) Does ...
by tostay2003
Mon Jun 01, 2009 6:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sort before lookup/cdc
Replies: 7
Views: 3444

But why is it important to sort before these stages?