Search found 51 matches

by sudeepmantri
Mon Apr 23, 2007 4:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Agregator failed
Replies: 6
Views: 3689

Re: Agregator failed

Hi Cristina, Whenever u perform Aggregation based on the key fields, u also make a Heap sort based on the key fields correct. For this the system internally creates a Heap table. For Larger volume of data this table grows in size exponentially, cause of which u might run into the issue. Ask ur admin...
by sudeepmantri
Mon Apr 16, 2007 12:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Trim issues
Replies: 12
Views: 4979

Re: Trim issues

Why Use a trim for this, U can very well use left and right functions provided in the transaformer.

KBN12390 -> to get KBN and 12390
234BN -> to get 234 and BN.

Thanks[/quote]
by sudeepmantri
Thu Apr 12, 2007 1:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Question about Job parameters ?
Replies: 2
Views: 1190

Re: Question about Job parameters ?

Am afraid but this can not be done. Instead u can have 3 different Job parameters and use them accordingly. However the stages u have talked about in your Job, if they are all Transformers u can assign the Job parameter value to a transformer stage varible value , do the needed modification based on...
by sudeepmantri
Fri Feb 16, 2007 12:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Row Count
Replies: 5
Views: 3715

Re: Row Count

Hi, Yup u r right. We can use the DSGetlinkInfo function. U have to associate ur job with an after job subroutine first. Follow the code snipet intNoRecInput=DSGetLinkInfo(DSJ.ME,Stage_Input,Link_Input,DSJ.LINKROWCOUNT) //here the row count on Link_input is stored in variable intNoRecInput //Now wri...
by sudeepmantri
Fri Feb 16, 2007 12:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Splitting input data into files
Replies: 2
Views: 685

Re: Splitting input data into files

[Splitting of data can be done thru stages named as Head and Tail. U can Mention the Percentage of records that goes to one file and the rest goes to the other
by sudeepmantri
Fri Feb 16, 2007 12:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: capturing reject records in transformer stage
Replies: 6
Views: 2796

Re: capturing reject records in transformer stage

Hi, I think u wont be able to capture the reject records in Parallel job in transformer. U got to use a server job
by sudeepmantri
Fri Feb 16, 2007 12:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: datastage
Replies: 5
Views: 1298

Re: datastage

Hi, If u click stage property button in Transformer u'll be presented with a dialogue box. Select the input tab. Select the partitioning u wanna use (Most probably Hash). Select 2 check boxes Sort, unique. Select the key column on which u wanna perform the Sorting....That's it. It will eliminate any...
by sudeepmantri
Fri Feb 16, 2007 12:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata_Enterprise issue
Replies: 4
Views: 1232

Re: Teradata_Enterprise issue

Hi, are u using correct database to log in to? We have a Property called Database in terada Enterprise to submit the database name? are u passing that value? Double check the parameters passed from the DSJobs. After checking all that try to view data by clicking on the view data in the Enterprise st...
by sudeepmantri
Wed Jan 03, 2007 1:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HowTo extract data from binary file?
Replies: 15
Views: 7122

Re: HowTo extract data from binary file?

Hi, first of all u got to convert the binary file to ascii, in oreder to read data from it. In the format tab of the Sequential file property dialogue box set record length as fixed,character set as EBCDIC and add a property "Export EBCDIC as ascii". This will export the binary data in Asc...
by sudeepmantri
Wed Jan 03, 2007 12:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lkp and join
Replies: 6
Views: 3176

Re: lkp and join

Hi, a lookup is basicaaly an Inner join. However the major difference which I can think of is the memory issue. What a lookup(Normal, not sparse) does is, it executes the query only once in the reference table and brings the whole bulk of data to the main memory and then performs the inner join on t...
by sudeepmantri
Tue Jan 02, 2007 5:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adding a new column
Replies: 8
Views: 3742

Re: Adding a new column

Use a column generator to generate a column of type integer. In the column tab of the column generator stage, double click the name of the column(short-cut method). Add the type as cycle. Initial value as 1 and increament by 0(Initial value and Increament are tsub-property of type)
by sudeepmantri
Tue Jan 02, 2007 4:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: reject rows thru column derivation
Replies: 7
Views: 6117

Re: reject rows thru column derivation

Hi, is this a server Job? or a parallel job. If it is a parallel job, then I am afraid u got to use a filter or anything else. Cause I dont think parallel transformer has got capacity to reject the rows(Though they can drop the rows which do not meet their constraints). Server jobs has got special p...
by sudeepmantri
Tue Jan 02, 2007 4:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Trim
Replies: 6
Views: 2647

Re: Trim

Hi, what you want to do is a TRIm, which is a transform function. Hence a lookup can not do such things. Lookup is meant only to find a match and map to output or reject records. U need to add a transformer, and use thhe trim fuction
by sudeepmantri
Tue Jan 02, 2007 3:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Space problem in Windows
Replies: 14
Views: 7740

Re: Lookup Space problem in Windows

This happens wen ur lookup try to get many records from the refernce link to the main memory. That is when the memory gives up. If ur refernce link is having say more than a million records then I would suggest go for "Join" rather than lookup
by sudeepmantri
Tue Jan 02, 2007 3:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filtering Look Up Table
Replies: 6
Views: 1797

Re: Filtering Look Up Table

Hi, What I understand is u need to add one more column to the intermediate dataset, that column is a key field in your reference table n u dont have anything to make lookup. If this is ur problem, try out this. After ur intermediate dataset, add a column generator to generate a dummy integer value o...