Search found 51 matches
- Mon Apr 23, 2007 4:35 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Agregator failed
- Replies: 6
- Views: 3689
Re: Agregator failed
Hi Cristina, Whenever u perform Aggregation based on the key fields, u also make a Heap sort based on the key fields correct. For this the system internally creates a Heap table. For Larger volume of data this table grows in size exponentially, cause of which u might run into the issue. Ask ur admin...
- Mon Apr 16, 2007 12:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Trim issues
- Replies: 12
- Views: 4979
Re: Trim issues
Why Use a trim for this, U can very well use left and right functions provided in the transaformer.
KBN12390 -> to get KBN and 12390
234BN -> to get 234 and BN.
Thanks[/quote]
KBN12390 -> to get KBN and 12390
234BN -> to get 234 and BN.
Thanks[/quote]
- Thu Apr 12, 2007 1:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Question about Job parameters ?
- Replies: 2
- Views: 1190
Re: Question about Job parameters ?
Am afraid but this can not be done. Instead u can have 3 different Job parameters and use them accordingly. However the stages u have talked about in your Job, if they are all Transformers u can assign the Job parameter value to a transformer stage varible value , do the needed modification based on...
- Fri Feb 16, 2007 12:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Row Count
- Replies: 5
- Views: 3715
Re: Row Count
Hi, Yup u r right. We can use the DSGetlinkInfo function. U have to associate ur job with an after job subroutine first. Follow the code snipet intNoRecInput=DSGetLinkInfo(DSJ.ME,Stage_Input,Link_Input,DSJ.LINKROWCOUNT) //here the row count on Link_input is stored in variable intNoRecInput //Now wri...
- Fri Feb 16, 2007 12:38 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Splitting input data into files
- Replies: 2
- Views: 685
Re: Splitting input data into files
[Splitting of data can be done thru stages named as Head and Tail. U can Mention the Percentage of records that goes to one file and the rest goes to the other
- Fri Feb 16, 2007 12:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: capturing reject records in transformer stage
- Replies: 6
- Views: 2796
Re: capturing reject records in transformer stage
Hi, I think u wont be able to capture the reject records in Parallel job in transformer. U got to use a server job
- Fri Feb 16, 2007 12:22 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: datastage
- Replies: 5
- Views: 1298
Re: datastage
Hi, If u click stage property button in Transformer u'll be presented with a dialogue box. Select the input tab. Select the partitioning u wanna use (Most probably Hash). Select 2 check boxes Sort, unique. Select the key column on which u wanna perform the Sorting....That's it. It will eliminate any...
- Fri Feb 16, 2007 12:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata_Enterprise issue
- Replies: 4
- Views: 1232
Re: Teradata_Enterprise issue
Hi, are u using correct database to log in to? We have a Property called Database in terada Enterprise to submit the database name? are u passing that value? Double check the parameters passed from the DSJobs. After checking all that try to view data by clicking on the view data in the Enterprise st...
- Wed Jan 03, 2007 1:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: HowTo extract data from binary file?
- Replies: 15
- Views: 7122
Re: HowTo extract data from binary file?
Hi, first of all u got to convert the binary file to ascii, in oreder to read data from it. In the format tab of the Sequential file property dialogue box set record length as fixed,character set as EBCDIC and add a property "Export EBCDIC as ascii". This will export the binary data in Asc...
- Wed Jan 03, 2007 12:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lkp and join
- Replies: 6
- Views: 3176
Re: lkp and join
Hi, a lookup is basicaaly an Inner join. However the major difference which I can think of is the memory issue. What a lookup(Normal, not sparse) does is, it executes the query only once in the reference table and brings the whole bulk of data to the main memory and then performs the inner join on t...
- Tue Jan 02, 2007 5:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Adding a new column
- Replies: 8
- Views: 3742
Re: Adding a new column
Use a column generator to generate a column of type integer. In the column tab of the column generator stage, double click the name of the column(short-cut method). Add the type as cycle. Initial value as 1 and increament by 0(Initial value and Increament are tsub-property of type)
- Tue Jan 02, 2007 4:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: reject rows thru column derivation
- Replies: 7
- Views: 6117
Re: reject rows thru column derivation
Hi, is this a server Job? or a parallel job. If it is a parallel job, then I am afraid u got to use a filter or anything else. Cause I dont think parallel transformer has got capacity to reject the rows(Though they can drop the rows which do not meet their constraints). Server jobs has got special p...
- Tue Jan 02, 2007 4:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Trim
- Replies: 6
- Views: 2647
Re: Trim
Hi, what you want to do is a TRIm, which is a transform function. Hence a lookup can not do such things. Lookup is meant only to find a match and map to output or reject records. U need to add a transformer, and use thhe trim fuction
- Tue Jan 02, 2007 3:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Lookup Space problem in Windows
- Replies: 14
- Views: 7740
Re: Lookup Space problem in Windows
This happens wen ur lookup try to get many records from the refernce link to the main memory. That is when the memory gives up. If ur refernce link is having say more than a million records then I would suggest go for "Join" rather than lookup
- Tue Jan 02, 2007 3:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Filtering Look Up Table
- Replies: 6
- Views: 1797
Re: Filtering Look Up Table
Hi, What I understand is u need to add one more column to the intermediate dataset, that column is a key field in your reference table n u dont have anything to make lookup. If this is ur problem, try out this. After ur intermediate dataset, add a column generator to generate a dummy integer value o...