Search found 15 matches

by Mallayagari
Mon Jul 19, 2010 9:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: wrapped stage
Replies: 2
Views: 1542

wrapped stage

Hi, I need to run a sequencer in multiple instance mode. I have file say EMP_ID. For each EMP_ID I need to run the sequencer with EMP_ID as the parameter to the sequencer. [b]My requirement is that at any given time only N number of instances should be running untill it finishes for all the EMP_ID.[...
by Mallayagari
Thu Jul 15, 2010 10:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: wrapper stage parameters
Replies: 2
Views: 1574

Re: wrapper stage parameters

[quote="Mallayagari"]How to pass input parameter to the wrapper stage. Any sample syntax are welcome.[/quote]

My requirement is to call a unix script for each record (one column record). The column value will be parameter to the script. Can this be doable in wrapper stage?
by Mallayagari
Wed Jul 14, 2010 1:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: wrapper stage parameters
Replies: 2
Views: 1574

wrapper stage parameters

How to pass input parameter to the wrapper stage. Any sample syntax are welcome.
by Mallayagari
Thu May 08, 2008 1:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need information on Data Extract approach
Replies: 4
Views: 1763

Re: Need information on Data Extract approach

IF you have enough time to pull the records from mainframe using API stage then its better to use API stage. If time is critical factor to your processing then extract and ftp the data is the best method. How much time do you have to pull this data? [quote="nvuradi"]Hi All, We need to extr...
by Mallayagari
Sat Mar 31, 2007 9:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: aggregator max(col)
Replies: 6
Views: 2431

aggregator max(col)

I need to calculate max of decmial(31,0) in aggregator stage. The output is also defined as decimal(31,0). But the output is truncating the values. Is there any limitation(length of column) on max function of aggregator????????????????? For small values its working fine.

Thanks in advance
by Mallayagari
Fri Mar 30, 2007 1:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: aggregator
Replies: 3
Views: 1610

[quote="us1aslam1us"]Aggregator has nothing to do but the max() forces to throw an error. Convert your string to Numeric before sending it to aggregator.[/quote]

USe the preserve type property set to 'True' and it will work
by Mallayagari
Thu Mar 29, 2007 1:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: aggregator
Replies: 3
Views: 1610

aggregator

hi,
I need to use the aggregator stage to aggreagte few numeric fields. Apart from that I have a string field for which I need to get the max() of it. The output is throwing as all zero's. Is it that aggregator doesn't work on string fields?? How can it be done?

Thanksin advance
by Mallayagari
Mon Mar 19, 2007 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: truncating varchar field
Replies: 5
Views: 2054

truncating varchar field

Hi
I am writing a large varcharfield(2000) to a sequential file(fixed widh) but its truncating the value and writing. Is there any limitation on varchar field or fixed width file??


Thanks in advance
by Mallayagari
Tue May 23, 2006 12:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sequencer
Replies: 6
Views: 2700

[quote="ray.wurlod"]There is nothing within a job sequence that allows you to access a table. A job sequence processes no data whatsoever; it prescribes the flow of control. Probably your best solution is to construc ...[/quote] ******************************************************* In yo...
by Mallayagari
Wed Mar 01, 2006 11:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loop in Transformer
Replies: 12
Views: 6766

Re: Loop in Transformer

Hi

In this case you need to use a buil-op (custom stage) to do this. If the data is small then you can go for a unix script but if the data is huge then build-op is the right option.

Thanks
Malla
by Mallayagari
Wed Mar 01, 2006 11:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Joining Billions of records with millions
Replies: 9
Views: 3898

Re: Joining Billions of records with millions

Hi Senthil As others said using look-u is big NO. There are two options (a) if the two tables can be indexed on the keys that you are trying to join then join those two tables on the database instead on Datastage. (b)If you want to join the two tables on Datastage, check with your Datastage admin wh...
by Mallayagari
Wed Mar 01, 2006 11:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap Allocation Error
Replies: 2
Views: 2085

What is the volume of data that you are expecting in the look-up?? Look-up can't handle huge(depends on system config) data as it bring entire data to memory before processing the input data. If the data is huge use a join stage and it has no issues on the heap memory.

Thanks
Maddy
by Mallayagari
Thu Feb 02, 2006 1:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rows to single Column
Replies: 2
Views: 1482

[quote="reachthiru"]Hi Madhav, There are multiple ways to do that. If you want it to write to a sequential file, you can read each record and whle writing it to a sequential file, write it with the record delimiter as 'comma(,)'. So all the records will be written to a single record. Other...
by Mallayagari
Thu Feb 02, 2006 10:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rows to single Column
Replies: 2
Views: 1482

Rows to single Column

I have multiple records (varies from 10 to 50) having only one date field and I want to write to a sequentail file as one record with all the dates appended.

I want to use these in a job parameter in the next job. Is there any other way of passing the parameters to the next job??

Thanks
Madhav
by Mallayagari
Tue Apr 20, 2004 3:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to restart ETL job automatically when a job fails
Replies: 3
Views: 1977

How to restart ETL job automatically when a job fails

How can I provide restart instructions in the ETL program when a job/step fails. Can it be done with datastage?? if not how can it be done.
TIA
Macks